Sep 28 11:39:07 devstack cinder-volume[76018]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 11:39:07 devstack cinder-volume[76018]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 11:39:07 devstack cinder-volume[76018]: we strongly recommend against using it for new projects. Sep 28 11:39:07 devstack cinder-volume[76018]: If you are already using Eventlet, we recommend migrating to a different Sep 28 11:39:07 devstack cinder-volume[76018]: framework. For more detail see Sep 28 11:39:07 devstack cinder-volume[76018]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 11:39:07 devstack cinder-volume[76018]: import eventlet # noqa Sep 28 11:39:10 devstack cinder-volume[76018]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76018) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 11:39:10 devstack cinder-volume[76018]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76018) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 11:39:10 devstack cinder-volume[76018]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76018) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 11:39:11 devstack cinder-volume[76018]: INFO dbcounter [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] Registered counter for database cinder Sep 28 11:39:11 devstack cinder-volume[76018]: DEBUG oslo_db.sqlalchemy.engines [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76018) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG dbcounter [-] [76018] Writer thread running {{(pid=76018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 11:39:12 devstack cinder-volume[76018]: INFO cinder.rpc [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 11:39:12 devstack cinder-volume[76018]: INFO cinder.rpc [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_db.sqlalchemy.engines [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76018) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 11:39:12 devstack cinder-volume[76018]: INFO cinder.volume.manager [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] Determined volume DB was empty at startup. Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG cinder.volume.manager [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76018) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 11:39:12 devstack cinder-volume[76018]: INFO cinder.volume.manager [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 28 11:39:12 devstack cinder-volume[76018]: WARNING stevedore.named [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 11:39:12 devstack cinder-volume[76018]: WARNING castellan.key_manager [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 11:39:12 devstack cinder-volume[76018]: WARNING cinder.keymgr.conf_key_mgr [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG cinder.volume.drivers.lvm [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76018) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] CMD "cinder-rtstool verify" returned: 0 in 0.426s {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_db.sqlalchemy.engines [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76018) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 11:39:12 devstack cinder-volume[76018]: INFO cinder.rpc [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 28 11:39:12 devstack cinder-volume[76018]: INFO cinder.rpc [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 28 11:39:12 devstack cinder-volume[76018]: WARNING stevedore.named [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 11:39:12 devstack cinder-volume[76018]: WARNING castellan.key_manager [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 11:39:12 devstack cinder-volume[76018]: INFO cinder.volume.manager [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_db.sqlalchemy.engines [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76018) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 11:39:12 devstack cinder-volume[76018]: INFO oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] Starting 1 workers Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] Started child 76178 {{(pid=76018) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] Full set of CONF: {{(pid=76018) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] ******************************************************************************** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] Configuration options gathered from: {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] ================================================================================ {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] allow_availability_zone_fallback = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] allow_compression_on_image_upload = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:12 devstack cinder-volume[76178]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] allowed_direct_url_schemes = [] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] api_rate_limit = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] auth_strategy = keystone {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] az_cache_duration = 3600 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_availability_zone = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_host = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_name = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_stats_polling_interval = 60 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backup_api_class = cinder.backup.api.API {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backup_name_template = backup-%s {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backup_use_same_host = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backup_use_temp_snapshot = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] chap_password = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] chap_username = {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] cinder_internal_tenant_project_id = 884121c8305742fca27342f2bbd0cce0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] cinder_internal_tenant_user_id = bf7ac1c3ba9c41e88b2609f464878c7d {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] cloned_volume_same_az = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] cluster = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] compression_format = gzip {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] compute_api_class = cinder.compute.nova.API {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] config_dir = [] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] config_source = [] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] control_exchange = openstack {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] debug = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] default_availability_zone = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] default_group_type = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] default_volume_type = lvmdriver-1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] disk_geometry = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] driver_client_cert = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] driver_client_cert_key = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] driver_data_namespace = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] driver_ssl_cert_path = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] driver_ssl_cert_verify = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] driver_use_ssl = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] enable_force_upload = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] enable_new_services = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] enable_unsupported_driver = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] enforce_multipath_for_image_xfer = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] filter_function = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] glance_api_insecure = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] glance_api_servers = ['http://192.168.122.185/image'] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:12 devstack cinder-volume[76178]: INFO cinder.volume.manager [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 28 11:39:12 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] glance_api_ssl_compression = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:12 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] glance_ca_certificates_file = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] glance_catalog_info = image:glance:publicURL {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] glance_certfile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] glance_keyfile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] glance_num_retries = 3 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] glance_request_timeout = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] goodness_function = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] graceful_shutdown_timeout = 5 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] group_api_class = cinder.group.api.API {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] host = devstack {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] image_compress_on_upload = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] image_conversion_address_space_limit = 1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] image_conversion_cpu_limit = 60 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] image_conversion_disable = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] image_introspection_address_space_limit = 1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] image_introspection_cpu_limit = 60 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] image_upload_use_cinder_backend = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] image_upload_use_internal_tenant = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] image_volume_cache_enabled = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] image_volume_cache_max_count = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] image_volume_cache_max_size_gb = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] init_host_max_objects_retrieval = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] instance_format = [instance: %(uuid)s] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] iscsi_target_flags = {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] iscsi_write_cache = on {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] iser_helper = tgtadm {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] iser_ip_address = 192.168.122.185 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] iser_port = 3260 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] log_color = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] log_config_append = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] log_dir = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] log_file = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] log_options = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] log_rotate_interval = 1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] log_rotate_interval_type = days {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] log_rotation_type = none {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] max_age = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] max_logfile_count = 30 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] max_logfile_size_mb = 200 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] max_over_subscription_ratio = 20.0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] message_reap_interval = 86400 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] message_ttl = 2592000 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] migration_create_volume_timeout_secs = 300 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] monkey_patch = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] monkey_patch_modules = [] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] my_ip = 192.168.122.185 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] no_snapshot_gb_quota = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] num_iser_scan_tries = 3 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] num_shell_tries = 3 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] num_volume_device_scan_tries = 3 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] nvmeof_conn_info_version = 1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] nvmet_ns_id = 10 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] nvmet_port_id = 1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] osapi_max_limit = 1000 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] osapi_volume_ext_list = [] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] osapi_volume_listen_port = 8776 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] osapi_volume_use_ssl = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] osapi_volume_workers = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] per_volume_size_limit = -1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] periodic_fuzzy_delay = 60 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] periodic_interval = 60 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] public_endpoint = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] publish_errors = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] quota_backup_gigabytes = 1000 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] quota_backups = 10 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] quota_gigabytes = 1000 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] quota_groups = 10 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] quota_snapshots = 10 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] quota_volumes = 10 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] rate_limit_burst = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] rate_limit_except_level = CRITICAL {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] rate_limit_interval = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] reinit_driver_count = 3 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] replication_device = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] report_discard_supported = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] report_interval = 120 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] reservation_clean_interval = 86400 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] reservation_expire = 86400 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] reserved_image_namespaces = [] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] reserved_percentage = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] rpc_response_timeout = 120 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] run_external_periodic_tasks = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] scst_target_driver = iscsi {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] scst_target_iqn_name = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] service_down_time = 720 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] shell_completion = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] snapshot_name_template = snapshot-%s {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] snapshot_same_host = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] split_loggers = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] state_path = /opt/stack/data/cinder {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] storage_availability_zone = nova {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] storage_protocol = iSCSI {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] syslog_log_facility = LOG_USER {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] target_helper = lioadm {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] target_ip_address = 192.168.122.185 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] target_port = 3260 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:39:13 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] target_protocol = iscsi {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] target_secondary_ip_addresses = [] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] trace_flags = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] transport_url = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] until_refresh = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] use_chap_auth = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] use_default_quota_class = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] use_journal = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] use_json = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] use_multipath_for_image_xfer = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] use_stderr = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] use_syslog = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] verify_glance_signatures = enabled {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] volume_api_class = cinder.volume.api.API {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] volume_backend_name = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] volume_clear = zero {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] volume_clear_ionice = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] volume_clear_size = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] volume_copy_bps_limit = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] volume_dd_blocksize = 1M {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] volume_name_template = volume-%s {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] volume_service_inithost_offload = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] volume_usage_audit_period = month {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] zoning_mode = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_concurrency.disable_process_locking = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:39:13 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] keystone_authtoken.auth_section = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] keystone_authtoken.auth_type = password {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] keystone_authtoken.auth_version = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] keystone_authtoken.cache = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] keystone_authtoken.certfile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] keystone_authtoken.include_service_catalog = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] keystone_authtoken.insecure = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] keystone_authtoken.interface = public {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] keystone_authtoken.keyfile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] keystone_authtoken.memcache_password = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] keystone_authtoken.memcache_username = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] keystone_authtoken.region_name = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] keystone_authtoken.service_type = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.185/identity {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] cache.backend = dogpile.cache.null {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] cache.backend_argument = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] cache.backend_expiration_time = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] cache.config_prefix = cache.oslo {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] cache.debug_cache_backend = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] cache.enable_retry_client = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] cache.enable_socket_keepalive = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] cache.enabled = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] cache.expiration_time = 600 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] cache.hashclient_retry_attempts = 2 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] cache.memcache_dead_retry = 300 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] cache.memcache_pool_maxsize = 10 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] cache.memcache_sasl_enabled = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack sudo[76182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] cache.password = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] cache.proxies = [] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] cache.redis_db = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack sudo[76182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] cache.redis_server = localhost:6379 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] cache.retry_attempts = 2 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] cache.retry_delay = 0.0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] cache.socket_keepalive_count = 1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] cache.socket_keepalive_idle = 1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] cache.socket_keepalive_interval = 1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] cache.socket_timeout = 1.0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] cache.tls_allowed_ciphers = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] cache.tls_cafile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] cache.tls_certfile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] cache.tls_enabled = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] cache.tls_keyfile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] cache.username = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] coordination.backend_url = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] database.asyncio_connection = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] database.asyncio_slave_connection = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] database.backend = sqlalchemy {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] database.connection = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] database.connection_debug = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] database.connection_parameters = {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] database.connection_recycle_time = 3600 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] database.connection_trace = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] database.db_inc_retry_interval = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] database.db_max_retries = 20 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] database.db_max_retry_interval = 10 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] database.db_retry_interval = 1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] database.max_overflow = 50 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] database.max_pool_size = 5 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] database.max_retries = 10 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] database.mysql_wsrep_sync_wait = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] database.pool_timeout = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] database.retry_interval = 10 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] database.slave_connection = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] database.sqlite_synchronous = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] database.synchronous_reader = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] database.use_db_reconnect = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_messaging_tracing.insecure = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] profiler.connection_string = messaging:// {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] profiler.enabled = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] profiler.es_doc_type = notification {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] profiler.es_scroll_size = 10000 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] profiler.es_scroll_time = 2m {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] profiler.filter_error_trace = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] profiler.hmac_keys = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] profiler.sentinel_service_name = mymaster {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] profiler.socket_timeout = 0.1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] profiler.trace_requests = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] profiler.trace_sqlalchemy = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] profiler_jaeger.process_tags = {} {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] profiler_jaeger.service_name_prefix = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] profiler_otlp.service_name_prefix = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_policy.enforce_new_defaults = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_policy.policy_default_rule = default {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_policy.policy_file = policy.yaml {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] privsep_osbrick.group = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] privsep_osbrick.helper_command = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] privsep_osbrick.user = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] cinder_sys_admin.group = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] cinder_sys_admin.helper_command = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] cinder_sys_admin.user = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] service_user.auth_section = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] service_user.auth_type = password {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] service_user.cafile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] service_user.certfile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] service_user.collect_timing = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] service_user.insecure = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] service_user.keyfile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] service_user.send_service_user_token = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] service_user.split_loggers = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] service_user.timeout = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] service_user.tls_ciphers = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] service_user.tls_min_version = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] glance.auth_section = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] glance.auth_type = password {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] glance.certfile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] glance.collect_timing = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] glance.insecure = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] glance.keyfile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] glance.region_name = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] glance.split_loggers = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] glance.timeout = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] glance.tls_ciphers = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] glance.tls_min_version = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.backend_availability_zone = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.chap_password = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.chap_username = {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.disk_geometry = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.driver_client_cert = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.driver_client_cert_key = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.driver_data_namespace = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.driver_use_ssl = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.extra_capabilities = {} {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.filter_function = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.goodness_function = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.iscsi_target_flags = {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.iscsi_write_cache = on {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.iser_helper = tgtadm {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.iser_ip_address = 192.168.122.185 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.iser_port = 3260 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.lvm_share_target = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.lvm_type = auto {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.num_shell_tries = 3 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.replication_device = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.report_discard_supported = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.reserved_percentage = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.target_helper = tgtadm {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.target_ip_address = 192.168.122.185 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.target_port = 3260 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.target_protocol = iscsi {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.trace_flags = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.unique_fqdn_network = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.use_chap_auth = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.volume_backend_name = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.volume_clear = zero {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.volume_clear_ionice = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.volume_clear_size = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_reports.file_event_handler = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_reports.log_dir = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.backend_host = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.chap_password = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.chap_username = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.disk_geometry = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.driver_client_cert = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.extra_capabilities = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.filter_function = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.goodness_function = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.iser_helper = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.iser_ip_address = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.iser_port = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.lvm_share_target = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.lvm_type = auto {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.num_shell_tries = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.replication_device = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.report_discard_supported = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.reserved_percentage = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.scst_target_driver = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.storage_protocol = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.target_helper = lioadm {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.target_ip_address = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.target_port = 3260 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.trace_flags = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.use_chap_auth = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.volume_clear = zero {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.volume_clear_size = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] lvmdriver-1.volumes_dir = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_messaging_rabbit.ssl = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_messaging_notifications.driver = [] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_messaging_notifications.retry = -1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] key_manager.fixed_key = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] barbican.barbican_api_version = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] barbican.barbican_endpoint = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] barbican.barbican_endpoint_type = public {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] barbican.barbican_region_name = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] barbican.cafile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] barbican.certfile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] barbican.collect_timing = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] barbican.insecure = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] barbican.keyfile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] barbican.number_of_retries = 60 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] barbican.retry_delay = 1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] barbican.send_service_user_token = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] barbican.split_loggers = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] barbican.timeout = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] barbican.tls_ciphers = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] barbican.tls_min_version = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] barbican.verify_ssl = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] barbican.verify_ssl_path = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] barbican_service_user.auth_section = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] barbican_service_user.auth_type = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] barbican_service_user.cafile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] barbican_service_user.certfile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] barbican_service_user.collect_timing = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] barbican_service_user.insecure = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] barbican_service_user.keyfile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] barbican_service_user.split_loggers = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] barbican_service_user.timeout = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] barbican_service_user.tls_ciphers = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] barbican_service_user.tls_min_version = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] vault.approle_role_id = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] vault.approle_secret_id = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] vault.auth_method = approle {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] vault.auth_path = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] vault.kv_mountpoint = secret {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] vault.kv_path = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] vault.kv_version = 2 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] vault.namespace = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] vault.root_token_id = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] vault.ssl_ca_crt_file = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] vault.timeout = 60.0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] vault.token_file = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] vault.token_role = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] vault.use_ssl = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:39:13 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] ******************************************************************************** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 11:39:13 devstack sudo[76182]: pam_unix(sudo:session): session closed for user root Sep 28 11:39:13 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.405s {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:39:13 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:39:13 devstack sudo[76204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 11:39:13 devstack sudo[76204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:39:13 devstack sudo[76204]: pam_unix(sudo:session): session closed for user root Sep 28 11:39:13 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.281s {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:39:13 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 11:39:13 devstack cinder-volume[76178]: INFO cinder.brick.local_dev.lvm [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 28 11:39:13 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:39:13 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:39:13 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:39:13 devstack sudo[76345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 11:39:13 devstack sudo[76345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:39:14 devstack sudo[76345]: pam_unix(sudo:session): session closed for user root Sep 28 11:39:14 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:39:14 devstack cinder-volume[76178]: DEBUG cinder.brick.local_dev.lvm [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76178) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 28 11:39:14 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:39:14 devstack sudo[76420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 11:39:14 devstack sudo[76420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:39:14 devstack sudo[76420]: pam_unix(sudo:session): session closed for user root Sep 28 11:39:14 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.494s {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:39:14 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:39:14 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:39:14 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:39:14 devstack sudo[76597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 11:39:14 devstack sudo[76597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:39:14 devstack sudo[76597]: pam_unix(sudo:session): session closed for user root Sep 28 11:39:14 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:39:14 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:39:14 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:39:14 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:39:14 devstack sudo[76690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 28 11:39:14 devstack sudo[76690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:39:15 devstack sudo[76690]: pam_unix(sudo:session): session closed for user root Sep 28 11:39:15 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.325s {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:39:15 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:39:15 devstack sudo[76798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 11:39:15 devstack sudo[76798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:39:15 devstack sudo[76798]: pam_unix(sudo:session): session closed for user root Sep 28 11:39:15 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:39:15 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:39:15 devstack sudo[76801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 11:39:15 devstack sudo[76801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:39:15 devstack sudo[76801]: pam_unix(sudo:session): session closed for user root Sep 28 11:39:15 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.318s {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:39:15 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:39:15 devstack sudo[76884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 11:39:15 devstack sudo[76884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:39:16 devstack sudo[76884]: pam_unix(sudo:session): session closed for user root Sep 28 11:39:16 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:39:16 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:39:16 devstack sudo[76890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 11:39:16 devstack sudo[76890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:39:16 devstack sudo[76890]: pam_unix(sudo:session): session closed for user root Sep 28 11:39:16 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.311s {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:39:16 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:39:16 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.039s {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:39:16 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:39:16 devstack sudo[76960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 11:39:16 devstack sudo[76960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:39:16 devstack sudo[76960]: pam_unix(sudo:session): session closed for user root Sep 28 11:39:16 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.299s {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:39:16 devstack cinder-volume[76178]: INFO cinder.volume.drivers.lvm [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 28 11:39:16 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:39:16 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:39:16 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:39:16 devstack sudo[76984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 11:39:16 devstack sudo[76984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:39:16 devstack sudo[76984]: pam_unix(sudo:session): session closed for user root Sep 28 11:39:16 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.230s {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:39:16 devstack cinder-volume[76178]: DEBUG cinder.volume.drivers.lvm [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] Updating volume stats {{(pid=76178) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 11:39:16 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:39:16 devstack sudo[76987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 11:39:16 devstack sudo[76987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:39:17 devstack sudo[76987]: pam_unix(sudo:session): session closed for user root Sep 28 11:39:17 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:39:17 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:39:17 devstack sudo[76990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 11:39:17 devstack sudo[76990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:39:17 devstack sudo[76990]: pam_unix(sudo:session): session closed for user root Sep 28 11:39:17 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.237s {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:39:17 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:39:17 devstack sudo[76993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 11:39:17 devstack sudo[76993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:39:17 devstack sudo[76993]: pam_unix(sudo:session): session closed for user root Sep 28 11:39:17 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.235s {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:39:17 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:39:17 devstack sudo[76996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 11:39:17 devstack sudo[76996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:39:17 devstack sudo[76996]: pam_unix(sudo:session): session closed for user root Sep 28 11:39:17 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:39:17 devstack cinder-volume[76178]: INFO cinder.volume.driver [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] Driver hasn't implemented _init_vendor_properties() Sep 28 11:39:17 devstack cinder-volume[76178]: DEBUG cinder.volume.driver [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76178) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 11:39:18 devstack cinder-volume[76178]: DEBUG oslo_db.sqlalchemy.engines [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76178) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 11:39:18 devstack cinder-volume[76178]: DEBUG dbcounter [-] [76178] Writer thread running {{(pid=76178) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 11:39:18 devstack cinder-volume[76178]: DEBUG cinder.db.api [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] Building query based on filter {{(pid=76178) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 11:39:18 devstack cinder-volume[76178]: DEBUG cinder.image.image_utils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76178) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 11:39:18 devstack cinder-volume[76178]: INFO cinder.keymgr.migration [None req-9dd4d28c-b5bf-43ef-9d7d-9d7a299f8f93 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 11:39:18 devstack cinder-volume[76178]: DEBUG cinder.volume.drivers.lvm [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] Updating volume stats {{(pid=76178) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 11:39:18 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:39:18 devstack sudo[76999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 11:39:18 devstack sudo[76999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:39:18 devstack sudo[76999]: pam_unix(sudo:session): session closed for user root Sep 28 11:39:18 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:39:18 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:39:18 devstack sudo[77002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 11:39:18 devstack sudo[77002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:39:18 devstack sudo[77002]: pam_unix(sudo:session): session closed for user root Sep 28 11:39:18 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:39:18 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:39:18 devstack sudo[77007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 11:39:18 devstack sudo[77007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:39:18 devstack sudo[77007]: pam_unix(sudo:session): session closed for user root Sep 28 11:39:18 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.273s {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:39:18 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:39:18 devstack sudo[77012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 11:39:18 devstack sudo[77012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:39:19 devstack sudo[77012]: pam_unix(sudo:session): session closed for user root Sep 28 11:39:19 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:39:19 devstack cinder-volume[76178]: DEBUG cinder.manager [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] Notifying Schedulers of capabilities ... {{(pid=76178) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:39:19 devstack cinder-volume[76178]: INFO cinder.volume.manager [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] Driver initialization completed successfully. Sep 28 11:39:19 devstack cinder-volume[76178]: INFO cinder.manager [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] Initiating service 2 cleanup Sep 28 11:39:19 devstack cinder-volume[76178]: INFO cinder.manager [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] Service 2 cleanup completed. Sep 28 11:39:19 devstack cinder-volume[76178]: DEBUG cinder.service [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] Creating RPC server for service cinder-volume {{(pid=76178) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 11:39:19 devstack cinder-volume[76178]: DEBUG cinder.service [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76178) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 11:39:19 devstack cinder-volume[76178]: INFO cinder.volume.manager [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 28 11:39:19 devstack cinder-volume[76178]: DEBUG cinder.volume.drivers.lvm [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] Updating volume stats {{(pid=76178) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 11:39:19 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:39:19 devstack sudo[77021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 11:39:19 devstack sudo[77021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:39:19 devstack sudo[77021]: pam_unix(sudo:session): session closed for user root Sep 28 11:39:19 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:39:19 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:39:19 devstack sudo[77024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 11:39:19 devstack sudo[77024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:39:19 devstack sudo[77024]: pam_unix(sudo:session): session closed for user root Sep 28 11:39:19 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:39:19 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:39:19 devstack sudo[77027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 11:39:19 devstack sudo[77027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:39:20 devstack sudo[77027]: pam_unix(sudo:session): session closed for user root Sep 28 11:39:20 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:39:20 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:39:20 devstack sudo[77032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 11:39:20 devstack sudo[77032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:39:20 devstack sudo[77032]: pam_unix(sudo:session): session closed for user root Sep 28 11:39:20 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:39:20 devstack cinder-volume[76178]: INFO cinder.volume.manager [None req-ac99dd17-b2a8-49e4-9764-a12ecc913f3f None None] Driver post RPC initialization completed successfully. Sep 28 11:39:22 devstack cinder-volume[76018]: DEBUG dbcounter [-] [76018] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 11:39:29 devstack cinder-volume[76178]: DEBUG dbcounter [-] [76178] Writing DB stats cinder:SELECT=2 {{(pid=76178) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 11:39:30 devstack cinder-volume[76178]: DEBUG dbcounter [-] [76178] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76178) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 11:40:09 devstack cinder-volume[76178]: DEBUG oslo_service.periodic_task [None req-8e4ee4b3-6a34-4e29-b74e-2b502bded973 None None] Running periodic task VolumeManager._thread_info {{(pid=76178) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 11:40:09 devstack cinder-volume[76178]: DEBUG cinder.volume.manager [None req-8e4ee4b3-6a34-4e29-b74e-2b502bded973 None None] thread count: 6 {{(pid=76178) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 11:40:09 devstack cinder-volume[76178]: DEBUG cinder.volume.manager [None req-8e4ee4b3-6a34-4e29-b74e-2b502bded973 None None] thread info: [<_MainThread(MainThread, started 130916061302912)>, , , , , ] {{(pid=76178) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 11:41:09 devstack cinder-volume[76178]: DEBUG oslo_service.periodic_task [None req-8e4ee4b3-6a34-4e29-b74e-2b502bded973 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76178) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 11:41:09 devstack cinder-volume[76178]: DEBUG cinder.volume.drivers.lvm [None req-8e4ee4b3-6a34-4e29-b74e-2b502bded973 None None] Updating volume stats {{(pid=76178) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 11:41:09 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-8e4ee4b3-6a34-4e29-b74e-2b502bded973 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:41:09 devstack sudo[82148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 11:41:09 devstack sudo[82148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:41:09 devstack sudo[82148]: pam_unix(sudo:session): session closed for user root Sep 28 11:41:09 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-8e4ee4b3-6a34-4e29-b74e-2b502bded973 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:41:09 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-8e4ee4b3-6a34-4e29-b74e-2b502bded973 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:41:09 devstack sudo[82151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 11:41:09 devstack sudo[82151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:41:10 devstack sudo[82151]: pam_unix(sudo:session): session closed for user root Sep 28 11:41:10 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-8e4ee4b3-6a34-4e29-b74e-2b502bded973 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:41:10 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-8e4ee4b3-6a34-4e29-b74e-2b502bded973 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:41:10 devstack sudo[82154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 11:41:10 devstack sudo[82154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:41:10 devstack sudo[82154]: pam_unix(sudo:session): session closed for user root Sep 28 11:41:10 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-8e4ee4b3-6a34-4e29-b74e-2b502bded973 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:41:10 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-8e4ee4b3-6a34-4e29-b74e-2b502bded973 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:41:10 devstack sudo[82157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 11:41:10 devstack sudo[82157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:41:10 devstack sudo[82157]: pam_unix(sudo:session): session closed for user root Sep 28 11:41:10 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-8e4ee4b3-6a34-4e29-b74e-2b502bded973 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:41:10 devstack cinder-volume[76178]: DEBUG cinder.manager [None req-8e4ee4b3-6a34-4e29-b74e-2b502bded973 None None] Notifying Schedulers of capabilities ... {{(pid=76178) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:41:10 devstack cinder-volume[76178]: DEBUG oslo_service.periodic_task [None req-8e4ee4b3-6a34-4e29-b74e-2b502bded973 None None] Running periodic task VolumeManager._thread_info {{(pid=76178) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 11:41:10 devstack cinder-volume[76178]: DEBUG cinder.volume.manager [None req-8e4ee4b3-6a34-4e29-b74e-2b502bded973 None None] thread count: 6 {{(pid=76178) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 11:41:10 devstack cinder-volume[76178]: DEBUG cinder.volume.manager [None req-8e4ee4b3-6a34-4e29-b74e-2b502bded973 None None] thread info: [<_MainThread(MainThread, started 130916061302912)>, , , , , ] {{(pid=76178) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 11:41:30 devstack cinder-volume[76178]: DEBUG dbcounter [-] [76178] Writing DB stats cinder:SELECT=1 {{(pid=76178) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 11:41:30 devstack cinder-volume[76178]: DEBUG dbcounter [-] [76178] Writing DB stats cinder:UPDATE=1 {{(pid=76178) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 11:42:09 devstack cinder-volume[76178]: DEBUG oslo_service.periodic_task [None req-8e4ee4b3-6a34-4e29-b74e-2b502bded973 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76178) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 11:42:09 devstack cinder-volume[76178]: DEBUG cinder.volume.drivers.lvm [None req-8e4ee4b3-6a34-4e29-b74e-2b502bded973 None None] Updating volume stats {{(pid=76178) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 11:42:09 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-8e4ee4b3-6a34-4e29-b74e-2b502bded973 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:42:09 devstack sudo[83946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 11:42:09 devstack sudo[83946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:42:09 devstack sudo[83946]: pam_unix(sudo:session): session closed for user root Sep 28 11:42:09 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-8e4ee4b3-6a34-4e29-b74e-2b502bded973 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:42:09 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-8e4ee4b3-6a34-4e29-b74e-2b502bded973 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:42:09 devstack sudo[83969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 11:42:09 devstack sudo[83969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:42:09 devstack sudo[83969]: pam_unix(sudo:session): session closed for user root Sep 28 11:42:09 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-8e4ee4b3-6a34-4e29-b74e-2b502bded973 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:42:09 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-8e4ee4b3-6a34-4e29-b74e-2b502bded973 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:42:10 devstack sudo[83972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 11:42:10 devstack sudo[83972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:42:10 devstack sudo[83972]: pam_unix(sudo:session): session closed for user root Sep 28 11:42:10 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-8e4ee4b3-6a34-4e29-b74e-2b502bded973 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:42:10 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-8e4ee4b3-6a34-4e29-b74e-2b502bded973 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:42:10 devstack sudo[83986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 11:42:10 devstack sudo[83986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:42:10 devstack sudo[83986]: pam_unix(sudo:session): session closed for user root Sep 28 11:42:10 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-8e4ee4b3-6a34-4e29-b74e-2b502bded973 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:42:10 devstack cinder-volume[76178]: DEBUG cinder.manager [None req-8e4ee4b3-6a34-4e29-b74e-2b502bded973 None None] Notifying Schedulers of capabilities ... {{(pid=76178) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:43:09 devstack cinder-volume[76178]: DEBUG oslo_service.periodic_task [None req-8e4ee4b3-6a34-4e29-b74e-2b502bded973 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76178) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 11:43:09 devstack cinder-volume[76178]: DEBUG cinder.volume.drivers.lvm [None req-8e4ee4b3-6a34-4e29-b74e-2b502bded973 None None] Updating volume stats {{(pid=76178) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 11:43:09 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-8e4ee4b3-6a34-4e29-b74e-2b502bded973 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:43:09 devstack sudo[85271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 11:43:09 devstack sudo[85271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:43:09 devstack sudo[85271]: pam_unix(sudo:session): session closed for user root Sep 28 11:43:09 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-8e4ee4b3-6a34-4e29-b74e-2b502bded973 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:43:09 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-8e4ee4b3-6a34-4e29-b74e-2b502bded973 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:43:09 devstack sudo[85274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 11:43:09 devstack sudo[85274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:43:09 devstack sudo[85274]: pam_unix(sudo:session): session closed for user root Sep 28 11:43:09 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-8e4ee4b3-6a34-4e29-b74e-2b502bded973 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:43:09 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-8e4ee4b3-6a34-4e29-b74e-2b502bded973 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:43:10 devstack sudo[85277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 11:43:10 devstack sudo[85277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:43:10 devstack sudo[85277]: pam_unix(sudo:session): session closed for user root Sep 28 11:43:10 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-8e4ee4b3-6a34-4e29-b74e-2b502bded973 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:43:10 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-8e4ee4b3-6a34-4e29-b74e-2b502bded973 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:43:10 devstack sudo[85280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 11:43:10 devstack sudo[85280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:43:10 devstack sudo[85280]: pam_unix(sudo:session): session closed for user root Sep 28 11:43:10 devstack cinder-volume[76178]: DEBUG oslo_concurrency.processutils [None req-8e4ee4b3-6a34-4e29-b74e-2b502bded973 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:43:10 devstack cinder-volume[76178]: DEBUG cinder.manager [None req-8e4ee4b3-6a34-4e29-b74e-2b502bded973 None None] Notifying Schedulers of capabilities ... {{(pid=76178) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:43:10 devstack cinder-volume[76178]: DEBUG oslo_service.periodic_task [None req-8e4ee4b3-6a34-4e29-b74e-2b502bded973 None None] Running periodic task VolumeManager._thread_info {{(pid=76178) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 11:43:10 devstack cinder-volume[76178]: DEBUG cinder.volume.manager [None req-8e4ee4b3-6a34-4e29-b74e-2b502bded973 None None] thread count: 6 {{(pid=76178) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 11:43:10 devstack cinder-volume[76178]: DEBUG cinder.volume.manager [None req-8e4ee4b3-6a34-4e29-b74e-2b502bded973 None None] thread info: [<_MainThread(MainThread, started 130916061302912)>, , , , , ] {{(pid=76178) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 11:43:30 devstack cinder-volume[76178]: DEBUG dbcounter [-] [76178] Writing DB stats cinder:SELECT=1 {{(pid=76178) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 11:43:30 devstack cinder-volume[76178]: DEBUG dbcounter [-] [76178] Writing DB stats cinder:UPDATE=1 {{(pid=76178) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 11:43:43 devstack cinder-volume[76018]: INFO oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] Caught SIGTERM, stopping children Sep 28 11:43:43 devstack cinder-volume[76018]: DEBUG oslo_concurrency.lockutils [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] Acquiring lock "singleton_lock" {{(pid=76018) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 11:43:43 devstack cinder-volume[76018]: DEBUG oslo_concurrency.lockutils [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] Acquired lock "singleton_lock" {{(pid=76018) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 11:43:43 devstack cinder-volume[76018]: DEBUG oslo_concurrency.lockutils [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] Releasing lock "singleton_lock" {{(pid=76018) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 11:43:43 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] Stop services. {{(pid=76018) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 28 11:43:43 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] Killing children. {{(pid=76018) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 28 11:43:43 devstack cinder-volume[76018]: INFO oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] Waiting on 1 children to exit Sep 28 11:43:44 devstack cinder-volume[76178]: DEBUG oslo_concurrency.lockutils [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] Acquiring lock "singleton_lock" {{(pid=76178) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 11:43:44 devstack cinder-volume[76178]: DEBUG oslo_concurrency.lockutils [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] Acquired lock "singleton_lock" {{(pid=76178) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 11:43:44 devstack cinder-volume[76178]: DEBUG oslo_concurrency.lockutils [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] Releasing lock "singleton_lock" {{(pid=76178) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 11:43:44 devstack cinder-volume[76178]: WARNING amqp [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 11:43:44 devstack cinder-volume[76178]: WARNING amqp [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 11:43:44 devstack cinder-volume[76018]: INFO oslo_service.backend._eventlet.service [None req-b4b9b8a5-05a6-473b-82e8-3b968d7025d6 None None] Child 76178 exited with status 0 Sep 28 11:43:44 devstack cinder-volume[86055]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 11:43:44 devstack cinder-volume[86055]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 11:43:44 devstack cinder-volume[86055]: we strongly recommend against using it for new projects. Sep 28 11:43:44 devstack cinder-volume[86055]: If you are already using Eventlet, we recommend migrating to a different Sep 28 11:43:44 devstack cinder-volume[86055]: framework. For more detail see Sep 28 11:43:44 devstack cinder-volume[86055]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 11:43:44 devstack cinder-volume[86055]: import eventlet # noqa Sep 28 11:43:46 devstack cinder-volume[86055]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86055) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 11:43:46 devstack cinder-volume[86055]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86055) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 11:43:46 devstack cinder-volume[86055]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86055) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 11:43:47 devstack cinder-volume[86055]: INFO dbcounter [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] Registered counter for database cinder Sep 28 11:43:47 devstack cinder-volume[86055]: DEBUG oslo_db.sqlalchemy.engines [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86055) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 11:43:47 devstack cinder-volume[86055]: DEBUG dbcounter [-] [86055] Writer thread running {{(pid=86055) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 11:43:47 devstack cinder-volume[86055]: INFO cinder.rpc [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 11:43:47 devstack cinder-volume[86055]: INFO cinder.rpc [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_db.sqlalchemy.engines [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86055) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 11:43:48 devstack cinder-volume[86055]: INFO cinder.volume.manager [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] Determined volume DB was empty at startup. Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG cinder.volume.manager [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86055) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 11:43:48 devstack cinder-volume[86055]: INFO cinder.volume.manager [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 28 11:43:48 devstack cinder-volume[86055]: WARNING stevedore.named [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 11:43:48 devstack cinder-volume[86055]: WARNING castellan.key_manager [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 11:43:48 devstack cinder-volume[86055]: WARNING cinder.keymgr.conf_key_mgr [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 11:43:48 devstack cinder-volume[86055]: INFO cinder.volume.manager [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_db.sqlalchemy.engines [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86055) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 11:43:48 devstack cinder-volume[86055]: INFO oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] Starting 1 workers Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] Started child 86271 {{(pid=86055) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] Full set of CONF: {{(pid=86055) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] ******************************************************************************** {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] Configuration options gathered from: {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] ================================================================================ {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] allow_availability_zone_fallback = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] allow_compression_on_image_upload = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] allowed_direct_url_schemes = [] {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] api_rate_limit = True {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] auth_strategy = keystone {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_availability_zone = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_host = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_name = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_stats_polling_interval = 60 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backup_api_class = cinder.backup.api.API {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backup_name_template = backup-%s {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backup_use_same_host = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backup_use_temp_snapshot = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] chap_password = **** {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] chap_username = {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] cinder_internal_tenant_project_id = 884121c8305742fca27342f2bbd0cce0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] cinder_internal_tenant_user_id = bf7ac1c3ba9c41e88b2609f464878c7d {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] cluster = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86271]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] compression_format = gzip {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] compute_api_class = cinder.compute.nova.API {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] config_dir = [] {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] config_source = [] {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] control_exchange = openstack {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] debug = True {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] default_availability_zone = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] default_group_type = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] default_volume_type = QuobyteHD {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] disk_geometry = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] driver_client_cert = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] driver_client_cert_key = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] driver_data_namespace = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] driver_ssl_cert_path = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] driver_ssl_cert_verify = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] driver_use_ssl = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] enable_new_services = True {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] enable_unsupported_driver = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] enabled_backends = ['QuobyteHD'] {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] enforce_multipath_for_image_xfer = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] filter_function = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] glance_api_insecure = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] glance_api_servers = ['http://192.168.122.185/image'] {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] glance_api_ssl_compression = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] glance_ca_certificates_file = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] glance_catalog_info = image:glance:publicURL {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] glance_certfile = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] glance_keyfile = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] glance_num_retries = 3 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] glance_request_timeout = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] goodness_function = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] graceful_shutdown_timeout = 5 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] group_api_class = cinder.group.api.API {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] host = devstack {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] image_compress_on_upload = True {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] image_conversion_address_space_limit = 1 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] image_conversion_cpu_limit = 60 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] image_conversion_disable = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] image_introspection_address_space_limit = 1 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] image_introspection_cpu_limit = 60 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] image_upload_use_cinder_backend = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] image_upload_use_internal_tenant = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] image_volume_cache_enabled = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] image_volume_cache_max_count = 0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] image_volume_cache_max_size_gb = 0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] init_host_max_objects_retrieval = 0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] instance_format = [instance: %(uuid)s] {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] iscsi_target_flags = {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] iscsi_write_cache = on {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] iser_helper = tgtadm {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] iser_ip_address = 192.168.122.185 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] iser_port = 3260 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] log_color = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] log_config_append = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] log_dir = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] log_file = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] log_options = True {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] log_rotate_interval = 1 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] log_rotate_interval_type = days {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] log_rotation_type = none {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] max_age = 0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] max_logfile_count = 30 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] max_logfile_size_mb = 200 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] max_over_subscription_ratio = 20.0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] message_reap_interval = 86400 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] message_ttl = 2592000 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] migration_create_volume_timeout_secs = 300 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] monkey_patch = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] monkey_patch_modules = [] {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] my_ip = 192.168.122.185 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] no_snapshot_gb_quota = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] num_iser_scan_tries = 3 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] num_shell_tries = 3 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] num_volume_device_scan_tries = 3 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] nvmeof_conn_info_version = 1 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] nvmet_ns_id = 10 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] nvmet_port_id = 1 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] osapi_max_limit = 1000 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] osapi_volume_ext_list = [] {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] osapi_volume_listen = 0.0.0.0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] osapi_volume_listen_port = 8776 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] osapi_volume_use_ssl = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] osapi_volume_workers = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] per_volume_size_limit = -1 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] periodic_fuzzy_delay = 60 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] periodic_interval = 60 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] project_id_regex = [0-9a-f\-]+ {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] public_endpoint = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] publish_errors = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] quota_backup_gigabytes = 1000 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] quota_backups = 10 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] quota_gigabytes = 1000 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] quota_groups = 10 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] quota_snapshots = 10 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] quota_volumes = 10 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] rate_limit_burst = 0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] rate_limit_except_level = CRITICAL {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] rate_limit_interval = 0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] reinit_driver_count = 3 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] replication_device = **** {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] report_discard_supported = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] report_interval = 120 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] reservation_clean_interval = 86400 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] reservation_expire = 86400 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] reserved_image_namespaces = [] {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] reserved_percentage = 0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] rpc_response_timeout = 120 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] run_external_periodic_tasks = True {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] scst_target_driver = iscsi {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] scst_target_iqn_name = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] service_down_time = 720 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] shell_completion = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] snapshot_name_template = snapshot-%s {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] split_loggers = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] state_path = /opt/stack/data/cinder {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] storage_availability_zone = nova {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] storage_protocol = iSCSI {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] syslog_log_facility = LOG_USER {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] target_helper = lioadm {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] target_ip_address = 192.168.122.185 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] target_port = 3260 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] target_protocol = iscsi {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] target_secondary_ip_addresses = [] {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] trace_flags = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] transfer_api_class = cinder.transfer.api.API {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] transport_url = **** {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] until_refresh = 0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] use_chap_auth = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] use_default_quota_class = True {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] use_journal = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] use_json = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] use_multipath_for_image_xfer = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] use_stderr = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] use_syslog = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] verify_glance_signatures = enabled {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] volume_api_class = cinder.volume.api.API {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] volume_backend_name = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] volume_clear = zero {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] volume_clear_ionice = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] volume_clear_size = 0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] volume_copy_bps_limit = 0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] volume_dd_blocksize = 1M {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] volume_name_template = volume-%s {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] volume_service_inithost_offload = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] volume_usage_audit_period = month {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] zoning_mode = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_concurrency.disable_process_locking = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] keystone_authtoken.auth_section = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] keystone_authtoken.auth_type = password {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] keystone_authtoken.auth_version = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] keystone_authtoken.cache = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] keystone_authtoken.certfile = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] keystone_authtoken.delay_auth_decision = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] keystone_authtoken.http_connect_timeout = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] keystone_authtoken.include_service_catalog = True {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] keystone_authtoken.insecure = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] keystone_authtoken.interface = public {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] keystone_authtoken.keyfile = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] keystone_authtoken.memcache_password = **** {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86271]: INFO cinder.volume.manager [None req-76f855c1-25f4-4dda-b968-a163ef588000 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 28 11:43:48 devstack cinder-volume[86271]: DEBUG cinder.volume.drivers.remotefs [None req-76f855c1-25f4-4dda-b968-a163ef588000 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86271) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] keystone_authtoken.memcache_username = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] keystone_authtoken.region_name = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] keystone_authtoken.service_token_roles_required = True {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] keystone_authtoken.service_type = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] keystone_authtoken.token_cache_time = 300 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.185/identity {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] cache.backend = dogpile.cache.null {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] cache.backend_argument = **** {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] cache.backend_expiration_time = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] cache.config_prefix = cache.oslo {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] cache.debug_cache_backend = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] cache.enable_retry_client = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] cache.enable_socket_keepalive = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] cache.enabled = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] cache.expiration_time = 600 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] cache.hashclient_retry_attempts = 2 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] cache.memcache_dead_retry = 300 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] cache.memcache_pool_maxsize = 10 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] cache.memcache_sasl_enabled = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] cache.password = **** {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] cache.proxies = [] {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] cache.redis_db = 0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] cache.redis_sentinel_service_name = mymaster {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] cache.redis_server = localhost:6379 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] cache.retry_attempts = 2 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] cache.retry_delay = 0.0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] cache.socket_keepalive_count = 1 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] cache.socket_keepalive_idle = 1 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] cache.socket_keepalive_interval = 1 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] cache.socket_timeout = 1.0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] cache.tls_allowed_ciphers = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] cache.tls_cafile = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] cache.tls_certfile = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] cache.tls_enabled = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] cache.tls_keyfile = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] cache.username = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] coordination.backend_url = **** {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] database.asyncio_connection = **** {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] database.asyncio_slave_connection = **** {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] database.backend = sqlalchemy {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] database.connection = **** {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] database.connection_debug = 0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] database.connection_parameters = {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] database.connection_recycle_time = 3600 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] database.connection_trace = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] database.db_inc_retry_interval = True {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] database.db_max_retries = 20 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] database.db_max_retry_interval = 10 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] database.db_retry_interval = 1 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] database.max_overflow = 50 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] database.max_pool_size = 5 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] database.max_retries = 10 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] database.mysql_wsrep_sync_wait = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] database.pool_timeout = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] database.retry_interval = 10 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] database.slave_connection = **** {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] database.sqlite_synchronous = True {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] database.synchronous_reader = True {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] database.use_db_reconnect = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_messaging_tracing.insecure = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] profiler.connection_string = messaging:// {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] profiler.enabled = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] profiler.es_doc_type = notification {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] profiler.es_scroll_size = 10000 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] profiler.es_scroll_time = 2m {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] profiler.filter_error_trace = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] profiler.hmac_keys = **** {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] profiler.sentinel_service_name = mymaster {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] profiler.socket_timeout = 0.1 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] profiler.trace_requests = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] profiler.trace_sqlalchemy = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] profiler_jaeger.process_tags = {} {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] profiler_jaeger.service_name_prefix = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] profiler_otlp.service_name_prefix = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_policy.enforce_new_defaults = True {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_policy.policy_default_rule = default {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_policy.policy_file = policy.yaml {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_policy.remote_timeout = 60.0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] privsep_osbrick.group = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] privsep_osbrick.helper_command = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] privsep_osbrick.user = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] cinder_sys_admin.group = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] cinder_sys_admin.helper_command = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] cinder_sys_admin.user = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] service_user.auth_section = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] service_user.auth_type = password {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] service_user.cafile = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] service_user.certfile = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] service_user.collect_timing = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] service_user.insecure = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] service_user.keyfile = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] service_user.send_service_user_token = True {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] service_user.split_loggers = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] service_user.timeout = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] service_user.tls_ciphers = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] service_user.tls_min_version = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] glance.auth_section = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] glance.auth_type = password {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] glance.certfile = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] glance.collect_timing = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] glance.insecure = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] glance.keyfile = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] glance.region_name = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] glance.split_loggers = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] glance.timeout = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] glance.tls_ciphers = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86271]: DEBUG cinder.volume.drivers.quobyte [None req-76f855c1-25f4-4dda-b968-a163ef588000 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86271) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 28 11:43:48 devstack cinder-volume[86271]: WARNING cinder.volume.drivers.quobyte [None req-76f855c1-25f4-4dda-b968-a163ef588000 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 28 11:43:48 devstack cinder-volume[86271]: WARNING cinder.volume.drivers.quobyte [None req-76f855c1-25f4-4dda-b968-a163ef588000 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] glance.tls_min_version = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.backend_availability_zone = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.chap_password = **** {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.chap_username = {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.disk_geometry = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86271]: DEBUG oslo_concurrency.processutils [None req-76f855c1-25f4-4dda-b968-a163ef588000 None None] Running cmd (subprocess): mount.quobyte {{(pid=86271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.driver_client_cert = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.driver_client_cert_key = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.driver_data_namespace = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.driver_use_ssl = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.enable_unsupported_driver = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.extra_capabilities = {} {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.filter_function = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.goodness_function = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.iscsi_target_flags = {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.iscsi_write_cache = on {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.iser_helper = tgtadm {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.iser_ip_address = 192.168.122.185 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.iser_port = 3260 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.nas_host = {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.nas_login = admin {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.nas_mount_options = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.nas_password = **** {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.nas_private_key = {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.nas_share_path = {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.nas_ssh_port = 22 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.num_shell_tries = 3 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.nvmet_port_id = 1 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.quobyte_client_cfg = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.quobyte_volume_url = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.replication_device = **** {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.report_discard_supported = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.reserved_percentage = 0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.scst_target_driver = iscsi {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.scst_target_iqn_name = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.storage_protocol = iSCSI {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.target_helper = tgtadm {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.target_ip_address = 192.168.122.185 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.target_port = 3260 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.target_protocol = iscsi {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.trace_flags = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.unique_fqdn_network = True {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.use_chap_auth = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.volume_backend_name = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.volume_clear = zero {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.volume_clear_ionice = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.volume_clear_size = 0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_reports.file_event_handler = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_reports.log_dir = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.backend_availability_zone = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.backend_host = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.chap_password = **** {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.chap_username = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.chiscsi_conf = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.disk_geometry = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.driver_client_cert = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.driver_client_cert_key = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.driver_data_namespace = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.driver_use_ssl = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.extra_capabilities = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.filter_function = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.goodness_function = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.iscsi_target_flags = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.iscsi_write_cache = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.iser_helper = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.iser_ip_address = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.iser_port = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.iser_target_prefix = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.nas_host = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.nas_login = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.nas_mount_options = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.nas_password = **** {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.nas_private_key = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.nas_share_path = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.nas_ssh_port = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.num_shell_tries = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.nvmet_ns_id = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.nvmet_port_id = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.replication_device = **** {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.report_discard_supported = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.reserved_percentage = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.scst_target_driver = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.storage_protocol = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.target_helper = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.target_ip_address = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.target_port = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.target_prefix = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.target_protocol = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.trace_flags = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.unique_fqdn_network = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.use_chap_auth = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.volume_clear = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.volume_clear_ionice = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.volume_clear_size = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] QuobyteHD.volumes_dir = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack quobyte-client[86276]: Reading configuration file: /etc/quobyte/client.cfg Sep 28 11:43:48 devstack quobyte-client[86276]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86271]: DEBUG oslo_concurrency.processutils [None req-76f855c1-25f4-4dda-b968-a163ef588000 None None] CMD "mount.quobyte" returned: 1 in 0.096s {{(pid=86271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86271]: DEBUG oslo_concurrency.lockutils [None req-76f855c1-25f4-4dda-b968-a163ef588000 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86271]: DEBUG oslo_concurrency.lockutils [None req-76f855c1-25f4-4dda-b968-a163ef588000 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86271]: DEBUG cinder.volume.drivers.quobyte [None req-76f855c1-25f4-4dda-b968-a163ef588000 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_messaging_rabbit.ssl = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_messaging_rabbit.ssl_version = {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_messaging_notifications.driver = [] {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86271]: INFO cinder.volume.drivers.quobyte [None req-76f855c1-25f4-4dda-b968-a163ef588000 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 ... Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_messaging_notifications.retry = -1 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86271]: DEBUG oslo_concurrency.processutils [None req-76f855c1-25f4-4dda-b968-a163ef588000 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 -c /etc/quobyte/client-cinder.cfg {{(pid=86271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] oslo_messaging_notifications.transport_url = **** {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] key_manager.fixed_key = **** {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] barbican.barbican_api_version = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] barbican.barbican_endpoint = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] barbican.barbican_endpoint_type = public {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] barbican.barbican_region_name = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] barbican.cafile = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] barbican.certfile = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] barbican.collect_timing = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] barbican.insecure = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] barbican.keyfile = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] barbican.number_of_retries = 60 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] barbican.retry_delay = 1 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] barbican.send_service_user_token = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] barbican.split_loggers = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] barbican.timeout = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] barbican.tls_ciphers = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] barbican.tls_min_version = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] barbican.verify_ssl = True {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] barbican.verify_ssl_path = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] barbican_service_user.auth_section = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] barbican_service_user.auth_type = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] barbican_service_user.cafile = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] barbican_service_user.certfile = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] barbican_service_user.collect_timing = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] barbican_service_user.insecure = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] barbican_service_user.keyfile = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] barbican_service_user.split_loggers = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] barbican_service_user.timeout = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] barbican_service_user.tls_ciphers = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] barbican_service_user.tls_min_version = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] vault.approle_role_id = **** {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] vault.approle_secret_id = **** {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] vault.auth_method = approle {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] vault.auth_path = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] vault.kv_mountpoint = secret {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] vault.kv_path = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] vault.kv_version = 2 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] vault.namespace = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] vault.root_token_id = **** {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] vault.ssl_ca_crt_file = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] vault.timeout = 60.0 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] vault.token_file = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] vault.token_role = None {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] vault.use_ssl = False {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:43:48 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] ******************************************************************************** {{(pid=86055) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 11:43:48 devstack sudo[86277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 -c /etc/quobyte/client-cinder.cfg Sep 28 11:43:48 devstack sudo[86277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:43:49 devstack sudo[86277]: pam_unix(sudo:session): session closed for user root Sep 28 11:43:49 devstack cinder-volume[86271]: DEBUG oslo_concurrency.processutils [None req-76f855c1-25f4-4dda-b968-a163ef588000 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.468s {{(pid=86271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:43:49 devstack cinder-volume[86271]: INFO cinder.volume.drivers.quobyte [None req-76f855c1-25f4-4dda-b968-a163ef588000 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 succeeded Sep 28 11:43:49 devstack cinder-volume[86271]: DEBUG cinder.volume.drivers.quobyte [None req-76f855c1-25f4-4dda-b968-a163ef588000 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:43:49 devstack cinder-volume[86271]: DEBUG oslo_concurrency.lockutils [None req-76f855c1-25f4-4dda-b968-a163ef588000 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.491s {{(pid=86271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:43:49 devstack cinder-volume[86271]: DEBUG oslo_concurrency.processutils [None req-76f855c1-25f4-4dda-b968-a163ef588000 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:43:49 devstack sudo[86377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:43:49 devstack sudo[86377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:43:49 devstack sudo[86377]: pam_unix(sudo:session): session closed for user root Sep 28 11:43:49 devstack cinder-volume[86271]: DEBUG oslo_concurrency.processutils [None req-76f855c1-25f4-4dda-b968-a163ef588000 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.251s {{(pid=86271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:43:49 devstack cinder-volume[86271]: INFO cinder.volume.driver [None req-76f855c1-25f4-4dda-b968-a163ef588000 None None] Driver hasn't implemented _init_vendor_properties() Sep 28 11:43:49 devstack cinder-volume[86271]: DEBUG cinder.volume.driver [None req-76f855c1-25f4-4dda-b968-a163ef588000 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.2163124084473, 'free_capacity_gb': 1775.2163124084473, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86271) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 11:43:49 devstack cinder-volume[86271]: DEBUG oslo_db.sqlalchemy.engines [None req-76f855c1-25f4-4dda-b968-a163ef588000 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86271) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 11:43:49 devstack cinder-volume[86271]: DEBUG dbcounter [-] [86271] Writer thread running {{(pid=86271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 11:43:49 devstack cinder-volume[86271]: DEBUG cinder.db.api [None req-76f855c1-25f4-4dda-b968-a163ef588000 None None] Building query based on filter {{(pid=86271) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 11:43:49 devstack cinder-volume[86271]: DEBUG cinder.image.image_utils [None req-76f855c1-25f4-4dda-b968-a163ef588000 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86271) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 11:43:49 devstack cinder-volume[86271]: INFO cinder.keymgr.migration [None req-42dbf8d4-f9fc-4e1a-8cd5-957d88d85e61 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 11:43:49 devstack cinder-volume[86271]: DEBUG oslo_concurrency.lockutils [None req-76f855c1-25f4-4dda-b968-a163ef588000 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:43:49 devstack cinder-volume[86271]: DEBUG oslo_concurrency.lockutils [None req-76f855c1-25f4-4dda-b968-a163ef588000 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:43:49 devstack cinder-volume[86271]: DEBUG cinder.volume.drivers.quobyte [None req-76f855c1-25f4-4dda-b968-a163ef588000 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:43:49 devstack cinder-volume[86271]: DEBUG cinder.volume.drivers.quobyte [None req-76f855c1-25f4-4dda-b968-a163ef588000 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:43:49 devstack cinder-volume[86271]: DEBUG oslo_concurrency.lockutils [None req-76f855c1-25f4-4dda-b968-a163ef588000 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:43:49 devstack cinder-volume[86271]: DEBUG oslo_concurrency.processutils [None req-76f855c1-25f4-4dda-b968-a163ef588000 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:43:49 devstack sudo[86380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:43:49 devstack sudo[86380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:43:49 devstack sudo[86380]: pam_unix(sudo:session): session closed for user root Sep 28 11:43:49 devstack cinder-volume[86271]: DEBUG oslo_concurrency.processutils [None req-76f855c1-25f4-4dda-b968-a163ef588000 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.246s {{(pid=86271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:43:49 devstack cinder-volume[86271]: DEBUG cinder.manager [None req-76f855c1-25f4-4dda-b968-a163ef588000 None None] Notifying Schedulers of capabilities ... {{(pid=86271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:43:49 devstack cinder-volume[86271]: INFO cinder.volume.manager [None req-76f855c1-25f4-4dda-b968-a163ef588000 None None] Driver initialization completed successfully. Sep 28 11:43:49 devstack cinder-volume[86271]: INFO cinder.manager [None req-76f855c1-25f4-4dda-b968-a163ef588000 None None] Initiating service 3 cleanup Sep 28 11:43:49 devstack cinder-volume[86271]: INFO cinder.manager [None req-76f855c1-25f4-4dda-b968-a163ef588000 None None] Service 3 cleanup completed. Sep 28 11:43:49 devstack cinder-volume[86271]: DEBUG cinder.service [None req-76f855c1-25f4-4dda-b968-a163ef588000 None None] Creating RPC server for service cinder-volume {{(pid=86271) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 11:43:49 devstack cinder-volume[86271]: DEBUG cinder.service [None req-76f855c1-25f4-4dda-b968-a163ef588000 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86271) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 11:43:49 devstack cinder-volume[86271]: INFO cinder.volume.manager [None req-76f855c1-25f4-4dda-b968-a163ef588000 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 28 11:43:49 devstack cinder-volume[86271]: DEBUG oslo_concurrency.lockutils [None req-76f855c1-25f4-4dda-b968-a163ef588000 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:43:49 devstack cinder-volume[86271]: DEBUG oslo_concurrency.lockutils [None req-76f855c1-25f4-4dda-b968-a163ef588000 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:43:49 devstack cinder-volume[86271]: DEBUG cinder.volume.drivers.quobyte [None req-76f855c1-25f4-4dda-b968-a163ef588000 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:43:49 devstack cinder-volume[86271]: DEBUG cinder.volume.drivers.quobyte [None req-76f855c1-25f4-4dda-b968-a163ef588000 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:43:49 devstack cinder-volume[86271]: DEBUG oslo_concurrency.lockutils [None req-76f855c1-25f4-4dda-b968-a163ef588000 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:43:49 devstack cinder-volume[86271]: DEBUG oslo_concurrency.processutils [None req-76f855c1-25f4-4dda-b968-a163ef588000 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:43:50 devstack sudo[86408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:43:50 devstack sudo[86408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:43:50 devstack sudo[86408]: pam_unix(sudo:session): session closed for user root Sep 28 11:43:50 devstack cinder-volume[86271]: DEBUG oslo_concurrency.processutils [None req-76f855c1-25f4-4dda-b968-a163ef588000 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.276s {{(pid=86271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:43:50 devstack cinder-volume[86271]: INFO cinder.volume.manager [None req-76f855c1-25f4-4dda-b968-a163ef588000 None None] Driver post RPC initialization completed successfully. Sep 28 11:43:53 devstack cinder-volume[86271]: DEBUG oslo_concurrency.lockutils [None req-ce6c9193-6f45-45cb-b945-df3f32bfa4f2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:43:53 devstack cinder-volume[86271]: DEBUG oslo_concurrency.lockutils [None req-ce6c9193-6f45-45cb-b945-df3f32bfa4f2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:43:53 devstack cinder-volume[86271]: DEBUG cinder.volume.drivers.quobyte [None req-ce6c9193-6f45-45cb-b945-df3f32bfa4f2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86271) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:43:53 devstack cinder-volume[86271]: DEBUG cinder.volume.drivers.quobyte [None req-ce6c9193-6f45-45cb-b945-df3f32bfa4f2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86271) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:43:53 devstack cinder-volume[86271]: DEBUG oslo_concurrency.lockutils [None req-ce6c9193-6f45-45cb-b945-df3f32bfa4f2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86271) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:43:53 devstack cinder-volume[86271]: DEBUG oslo_concurrency.processutils [None req-ce6c9193-6f45-45cb-b945-df3f32bfa4f2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:43:53 devstack sudo[86510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:43:53 devstack sudo[86510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:43:54 devstack sudo[86510]: pam_unix(sudo:session): session closed for user root Sep 28 11:43:54 devstack cinder-volume[86271]: DEBUG oslo_concurrency.processutils [None req-ce6c9193-6f45-45cb-b945-df3f32bfa4f2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.231s {{(pid=86271) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:43:54 devstack cinder-volume[86271]: DEBUG cinder.manager [None req-ce6c9193-6f45-45cb-b945-df3f32bfa4f2 None None] Notifying Schedulers of capabilities ... {{(pid=86271) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:43:54 devstack cinder-volume[86055]: INFO oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] Caught SIGTERM, stopping children Sep 28 11:43:54 devstack cinder-volume[86055]: DEBUG oslo_concurrency.lockutils [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] Acquiring lock "singleton_lock" {{(pid=86055) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 11:43:54 devstack cinder-volume[86055]: DEBUG oslo_concurrency.lockutils [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] Acquired lock "singleton_lock" {{(pid=86055) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 11:43:54 devstack cinder-volume[86055]: DEBUG oslo_concurrency.lockutils [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] Releasing lock "singleton_lock" {{(pid=86055) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 11:43:54 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] Stop services. {{(pid=86055) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 28 11:43:54 devstack cinder-volume[86055]: DEBUG oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] Killing children. {{(pid=86055) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 28 11:43:54 devstack cinder-volume[86055]: INFO oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] Waiting on 1 children to exit Sep 28 11:43:55 devstack cinder-volume[86271]: DEBUG oslo_service.periodic_task [None req-5faf9365-51dd-4a2a-9ce3-df232f7c0703 None None] Running periodic task VolumeManager._thread_info {{(pid=86271) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 11:43:55 devstack cinder-volume[86271]: DEBUG cinder.volume.manager [None req-5faf9365-51dd-4a2a-9ce3-df232f7c0703 None None] thread count: 6 {{(pid=86271) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 11:43:55 devstack cinder-volume[86271]: DEBUG cinder.volume.manager [None req-5faf9365-51dd-4a2a-9ce3-df232f7c0703 None None] thread info: [<_MainThread(MainThread, started 138860176932992)>, , , , , ] {{(pid=86271) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 11:43:58 devstack cinder-volume[86271]: DEBUG oslo_concurrency.lockutils [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] Acquiring lock "singleton_lock" {{(pid=86271) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 11:43:58 devstack cinder-volume[86271]: DEBUG oslo_concurrency.lockutils [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] Acquired lock "singleton_lock" {{(pid=86271) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 11:43:58 devstack cinder-volume[86271]: DEBUG oslo_concurrency.lockutils [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] Releasing lock "singleton_lock" {{(pid=86271) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 11:43:58 devstack cinder-volume[86271]: WARNING amqp [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 11:43:58 devstack cinder-volume[86271]: WARNING amqp [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 11:43:58 devstack cinder-volume[86055]: INFO oslo_service.backend._eventlet.service [None req-e7343df9-cb11-4c76-91e3-4ddcaf370e0c None None] Child 86271 exited with status 0 Sep 28 11:43:58 devstack cinder-volume[86617]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 11:43:58 devstack cinder-volume[86617]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 11:43:58 devstack cinder-volume[86617]: we strongly recommend against using it for new projects. Sep 28 11:43:58 devstack cinder-volume[86617]: If you are already using Eventlet, we recommend migrating to a different Sep 28 11:43:58 devstack cinder-volume[86617]: framework. For more detail see Sep 28 11:43:58 devstack cinder-volume[86617]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 11:43:58 devstack cinder-volume[86617]: import eventlet # noqa Sep 28 11:44:02 devstack cinder-volume[86617]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86617) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 11:44:02 devstack cinder-volume[86617]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86617) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 11:44:02 devstack cinder-volume[86617]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86617) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 11:44:02 devstack cinder-volume[86617]: INFO dbcounter [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] Registered counter for database cinder Sep 28 11:44:02 devstack cinder-volume[86617]: DEBUG oslo_db.sqlalchemy.engines [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86617) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG dbcounter [-] [86617] Writer thread running {{(pid=86617) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 11:44:03 devstack cinder-volume[86617]: INFO cinder.rpc [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 11:44:03 devstack cinder-volume[86617]: INFO cinder.rpc [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_db.sqlalchemy.engines [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86617) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 11:44:03 devstack cinder-volume[86617]: INFO cinder.volume.manager [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] Determined volume DB was empty at startup. Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG cinder.volume.manager [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86617) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 11:44:03 devstack cinder-volume[86617]: WARNING stevedore.named [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 11:44:03 devstack cinder-volume[86617]: WARNING castellan.key_manager [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 11:44:03 devstack cinder-volume[86617]: WARNING cinder.keymgr.conf_key_mgr [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 11:44:03 devstack cinder-volume[86617]: INFO cinder.volume.manager [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_db.sqlalchemy.engines [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86617) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 11:44:03 devstack cinder-volume[86617]: INFO oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] Starting 1 workers Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] Started child 86916 {{(pid=86617) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] Full set of CONF: {{(pid=86617) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] ******************************************************************************** {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] Configuration options gathered from: {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] ================================================================================ {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] allow_availability_zone_fallback = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] allow_compression_on_image_upload = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] allowed_direct_url_schemes = [] {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] api_rate_limit = True {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86916]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] auth_strategy = keystone {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_availability_zone = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_host = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_name = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_stats_polling_interval = 60 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backup_api_class = cinder.backup.api.API {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backup_name_template = backup-%s {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backup_use_same_host = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backup_use_temp_snapshot = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] chap_password = **** {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] chap_username = {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] cinder_internal_tenant_project_id = 884121c8305742fca27342f2bbd0cce0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] cinder_internal_tenant_user_id = bf7ac1c3ba9c41e88b2609f464878c7d {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] cluster = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] compression_format = gzip {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] compute_api_class = cinder.compute.nova.API {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] config_dir = [] {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] config_source = [] {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] control_exchange = openstack {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] debug = True {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] default_availability_zone = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] default_group_type = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] default_volume_type = QuobyteHD {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] disk_geometry = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] driver_client_cert = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] driver_client_cert_key = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] driver_data_namespace = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] driver_ssl_cert_path = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] driver_ssl_cert_verify = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] driver_use_ssl = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] enable_new_services = True {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] enable_unsupported_driver = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] enabled_backends = ['QuobyteHD'] {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] enforce_multipath_for_image_xfer = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] filter_function = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] glance_api_insecure = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] glance_api_servers = ['http://192.168.122.185/image'] {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] glance_api_ssl_compression = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] glance_ca_certificates_file = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] glance_catalog_info = image:glance:publicURL {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] glance_certfile = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] glance_keyfile = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] glance_num_retries = 3 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] glance_request_timeout = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] goodness_function = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] graceful_shutdown_timeout = 5 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] group_api_class = cinder.group.api.API {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] host = devstack {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] image_compress_on_upload = True {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] image_conversion_address_space_limit = 1 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] image_conversion_cpu_limit = 60 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] image_conversion_disable = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] image_introspection_address_space_limit = 1 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] image_introspection_cpu_limit = 60 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] image_upload_use_cinder_backend = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] image_upload_use_internal_tenant = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] image_volume_cache_enabled = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] image_volume_cache_max_count = 0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] image_volume_cache_max_size_gb = 0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] init_host_max_objects_retrieval = 0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] instance_format = [instance: %(uuid)s] {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] iscsi_target_flags = {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-a7f1bb4c-a19f-4586-9fac-7e28fd953315 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] iscsi_write_cache = on {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] iser_helper = tgtadm {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] iser_ip_address = 192.168.122.185 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] iser_port = 3260 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] log_color = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] log_config_append = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-a7f1bb4c-a19f-4586-9fac-7e28fd953315 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86916) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] log_dir = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] log_file = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] log_options = True {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] log_rotate_interval = 1 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] log_rotate_interval_type = days {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] log_rotation_type = none {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] max_age = 0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] max_logfile_count = 30 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] max_logfile_size_mb = 200 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] max_over_subscription_ratio = 20.0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] message_reap_interval = 86400 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] message_ttl = 2592000 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] migration_create_volume_timeout_secs = 300 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] monkey_patch = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] monkey_patch_modules = [] {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] my_ip = 192.168.122.185 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] no_snapshot_gb_quota = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] num_iser_scan_tries = 3 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] num_shell_tries = 3 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] num_volume_device_scan_tries = 3 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] nvmeof_conn_info_version = 1 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] nvmet_ns_id = 10 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] nvmet_port_id = 1 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] osapi_max_limit = 1000 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] osapi_volume_ext_list = [] {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] osapi_volume_listen_port = 8776 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] osapi_volume_use_ssl = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] osapi_volume_workers = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] per_volume_size_limit = -1 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] periodic_fuzzy_delay = 60 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] periodic_interval = 60 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] public_endpoint = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] publish_errors = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] quota_backup_gigabytes = 1000 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] quota_backups = 10 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] quota_gigabytes = 1000 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] quota_groups = 10 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] quota_snapshots = 10 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] quota_volumes = 10 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] rate_limit_burst = 0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] rate_limit_except_level = CRITICAL {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] rate_limit_interval = 0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] reinit_driver_count = 3 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] replication_device = **** {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] report_discard_supported = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] report_interval = 120 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] reservation_clean_interval = 86400 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] reservation_expire = 86400 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] reserved_image_namespaces = [] {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] reserved_percentage = 0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] rpc_response_timeout = 120 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] run_external_periodic_tasks = True {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] scst_target_driver = iscsi {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] scst_target_iqn_name = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] service_down_time = 720 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] shell_completion = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] snapshot_name_template = snapshot-%s {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] split_loggers = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] state_path = /opt/stack/data/cinder {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] storage_availability_zone = nova {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] storage_protocol = iSCSI {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] syslog_log_facility = LOG_USER {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] target_helper = lioadm {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] target_ip_address = 192.168.122.185 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] target_port = 3260 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] target_protocol = iscsi {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] target_secondary_ip_addresses = [] {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] trace_flags = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] transport_url = **** {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] until_refresh = 0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] use_chap_auth = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] use_default_quota_class = True {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] use_journal = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] use_json = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] use_multipath_for_image_xfer = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] use_stderr = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] use_syslog = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] verify_glance_signatures = enabled {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] volume_api_class = cinder.volume.api.API {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] volume_backend_name = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] volume_clear = zero {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] volume_clear_ionice = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] volume_clear_size = 0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] volume_copy_bps_limit = 0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] volume_dd_blocksize = 1M {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] volume_name_template = volume-%s {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] volume_service_inithost_offload = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] volume_usage_audit_period = month {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] zoning_mode = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_concurrency.disable_process_locking = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] keystone_authtoken.auth_section = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] keystone_authtoken.auth_type = password {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] keystone_authtoken.auth_version = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] keystone_authtoken.cache = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] keystone_authtoken.certfile = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] keystone_authtoken.include_service_catalog = True {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] keystone_authtoken.insecure = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] keystone_authtoken.interface = public {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] keystone_authtoken.keyfile = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] keystone_authtoken.memcache_password = **** {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a7f1bb4c-a19f-4586-9fac-7e28fd953315 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86916) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.quobyte [None req-a7f1bb4c-a19f-4586-9fac-7e28fd953315 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.quobyte [None req-a7f1bb4c-a19f-4586-9fac-7e28fd953315 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a7f1bb4c-a19f-4586-9fac-7e28fd953315 None None] Running cmd (subprocess): mount.quobyte {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] keystone_authtoken.memcache_username = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] keystone_authtoken.region_name = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] keystone_authtoken.service_type = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.185/identity {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] cache.backend = dogpile.cache.null {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] cache.backend_argument = **** {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] cache.backend_expiration_time = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] cache.config_prefix = cache.oslo {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] cache.debug_cache_backend = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] cache.enable_retry_client = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] cache.enable_socket_keepalive = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] cache.enabled = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] cache.expiration_time = 600 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] cache.hashclient_retry_attempts = 2 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] cache.memcache_dead_retry = 300 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] cache.memcache_pool_maxsize = 10 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] cache.memcache_sasl_enabled = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] cache.password = **** {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] cache.proxies = [] {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] cache.redis_db = 0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] cache.redis_server = localhost:6379 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] cache.retry_attempts = 2 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] cache.retry_delay = 0.0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] cache.socket_keepalive_count = 1 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] cache.socket_keepalive_idle = 1 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] cache.socket_keepalive_interval = 1 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] cache.socket_timeout = 1.0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] cache.tls_allowed_ciphers = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] cache.tls_cafile = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] cache.tls_certfile = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] cache.tls_enabled = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] cache.tls_keyfile = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] cache.username = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] coordination.backend_url = **** {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] database.asyncio_connection = **** {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] database.asyncio_slave_connection = **** {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] database.backend = sqlalchemy {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] database.connection = **** {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] database.connection_debug = 0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] database.connection_parameters = {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] database.connection_recycle_time = 3600 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] database.connection_trace = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] database.db_inc_retry_interval = True {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] database.db_max_retries = 20 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] database.db_max_retry_interval = 10 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] database.db_retry_interval = 1 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] database.max_overflow = 50 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] database.max_pool_size = 5 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] database.max_retries = 10 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] database.mysql_wsrep_sync_wait = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] database.pool_timeout = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] database.retry_interval = 10 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] database.slave_connection = **** {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] database.sqlite_synchronous = True {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] database.synchronous_reader = True {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] database.use_db_reconnect = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_messaging_tracing.insecure = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] profiler.connection_string = messaging:// {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] profiler.enabled = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] profiler.es_doc_type = notification {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] profiler.es_scroll_size = 10000 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] profiler.es_scroll_time = 2m {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] profiler.filter_error_trace = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] profiler.hmac_keys = **** {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] profiler.sentinel_service_name = mymaster {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] profiler.socket_timeout = 0.1 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] profiler.trace_requests = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] profiler.trace_sqlalchemy = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] profiler_jaeger.process_tags = {} {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] profiler_jaeger.service_name_prefix = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] profiler_otlp.service_name_prefix = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_policy.enforce_new_defaults = True {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_policy.policy_default_rule = default {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_policy.policy_file = policy.yaml {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] privsep_osbrick.group = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] privsep_osbrick.helper_command = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] privsep_osbrick.user = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] cinder_sys_admin.group = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] cinder_sys_admin.helper_command = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] cinder_sys_admin.user = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] service_user.auth_section = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] service_user.auth_type = password {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] service_user.cafile = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] service_user.certfile = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] service_user.collect_timing = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] service_user.insecure = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] service_user.keyfile = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] service_user.send_service_user_token = True {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] service_user.split_loggers = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] service_user.timeout = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] service_user.tls_ciphers = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] service_user.tls_min_version = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] glance.auth_section = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] glance.auth_type = password {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] glance.certfile = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] glance.collect_timing = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] glance.insecure = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] glance.keyfile = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] glance.region_name = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] glance.split_loggers = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] glance.timeout = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] glance.tls_ciphers = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] glance.tls_min_version = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.backend_availability_zone = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.chap_password = **** {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.chap_username = {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.disk_geometry = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.driver_client_cert = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.driver_client_cert_key = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.driver_data_namespace = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.driver_use_ssl = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.extra_capabilities = {} {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.filter_function = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.goodness_function = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.iscsi_target_flags = {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.iscsi_write_cache = on {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.iser_helper = tgtadm {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.iser_ip_address = 192.168.122.185 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.iser_port = 3260 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.nas_host = {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack quobyte-client[86917]: Reading configuration file: /etc/quobyte/client.cfg Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.nas_login = admin {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.nas_mount_options = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.nas_password = **** {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack quobyte-client[86917]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.nas_private_key = {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.nas_share_path = {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.num_shell_tries = 3 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a7f1bb4c-a19f-4586-9fac-7e28fd953315 None None] CMD "mount.quobyte" returned: 1 in 0.064s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a7f1bb4c-a19f-4586-9fac-7e28fd953315 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a7f1bb4c-a19f-4586-9fac-7e28fd953315 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a7f1bb4c-a19f-4586-9fac-7e28fd953315 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.quobyte_volume_url = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.replication_device = **** {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.report_discard_supported = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.reserved_percentage = 0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.target_helper = tgtadm {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.target_ip_address = 192.168.122.185 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.target_port = 3260 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.target_protocol = iscsi {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.trace_flags = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.unique_fqdn_network = True {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.use_chap_auth = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.volume_backend_name = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.volume_clear = zero {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.volume_clear_ionice = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.volume_clear_size = 0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a7f1bb4c-a19f-4586-9fac-7e28fd953315 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a7f1bb4c-a19f-4586-9fac-7e28fd953315 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a7f1bb4c-a19f-4586-9fac-7e28fd953315 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_reports.file_event_handler = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_reports.log_dir = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.backend_availability_zone = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.backend_host = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.chap_password = **** {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.chap_username = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.chiscsi_conf = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.disk_geometry = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.driver_client_cert = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.driver_data_namespace = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.driver_use_ssl = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.extra_capabilities = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.filter_function = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.goodness_function = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.iser_helper = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.iser_ip_address = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.iser_port = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.iser_target_prefix = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.nas_host = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.nas_login = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.nas_mount_options = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.nas_password = **** {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.nas_private_key = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.nas_share_path = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.nas_ssh_port = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.num_shell_tries = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.nvmet_port_id = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.replication_device = **** {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.report_discard_supported = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.reserved_percentage = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.scst_target_driver = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.storage_protocol = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.target_helper = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.target_ip_address = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.target_port = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack sudo[86918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.target_prefix = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.target_protocol = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.trace_flags = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack sudo[86918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.use_chap_auth = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.volume_clear = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.volume_clear_size = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] QuobyteHD.volumes_dir = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_messaging_rabbit.ssl = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_messaging_notifications.driver = [] {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_messaging_notifications.retry = -1 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] key_manager.fixed_key = **** {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] barbican.barbican_api_version = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] barbican.barbican_endpoint = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] barbican.barbican_endpoint_type = public {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] barbican.barbican_region_name = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] barbican.cafile = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] barbican.certfile = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] barbican.collect_timing = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] barbican.insecure = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] barbican.keyfile = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] barbican.number_of_retries = 60 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] barbican.retry_delay = 1 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] barbican.send_service_user_token = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] barbican.split_loggers = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] barbican.timeout = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] barbican.tls_ciphers = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] barbican.tls_min_version = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] barbican.verify_ssl = True {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] barbican.verify_ssl_path = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] barbican_service_user.auth_section = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] barbican_service_user.auth_type = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] barbican_service_user.cafile = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] barbican_service_user.certfile = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] barbican_service_user.collect_timing = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] barbican_service_user.insecure = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] barbican_service_user.keyfile = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] barbican_service_user.split_loggers = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] barbican_service_user.timeout = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] barbican_service_user.tls_ciphers = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] barbican_service_user.tls_min_version = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] vault.approle_role_id = **** {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] vault.approle_secret_id = **** {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] vault.auth_method = approle {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] vault.auth_path = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] vault.kv_mountpoint = secret {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] vault.kv_path = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] vault.kv_version = 2 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] vault.namespace = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] vault.root_token_id = **** {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] vault.ssl_ca_crt_file = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] vault.timeout = 60.0 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] vault.token_file = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] vault.token_role = None {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] vault.use_ssl = False {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 11:44:03 devstack cinder-volume[86617]: DEBUG oslo_service.backend._eventlet.service [None req-508d4f17-8955-47b4-a412-af3e59b20267 None None] ******************************************************************************** {{(pid=86617) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 11:44:03 devstack sudo[86918]: pam_unix(sudo:session): session closed for user root Sep 28 11:44:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a7f1bb4c-a19f-4586-9fac-7e28fd953315 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.238s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:44:03 devstack cinder-volume[86916]: INFO cinder.volume.driver [None req-a7f1bb4c-a19f-4586-9fac-7e28fd953315 None None] Driver hasn't implemented _init_vendor_properties() Sep 28 11:44:03 devstack cinder-volume[86916]: DEBUG cinder.volume.driver [None req-a7f1bb4c-a19f-4586-9fac-7e28fd953315 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.2163124084473, 'free_capacity_gb': 1775.2163124084473, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86916) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 11:44:03 devstack cinder-volume[86916]: DEBUG oslo_db.sqlalchemy.engines [None req-a7f1bb4c-a19f-4586-9fac-7e28fd953315 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86916) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 11:44:03 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writer thread running {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 11:44:03 devstack cinder-volume[86916]: DEBUG cinder.db.api [None req-a7f1bb4c-a19f-4586-9fac-7e28fd953315 None None] Building query based on filter {{(pid=86916) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 11:44:03 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-a7f1bb4c-a19f-4586-9fac-7e28fd953315 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86916) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 11:44:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a7f1bb4c-a19f-4586-9fac-7e28fd953315 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:44:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a7f1bb4c-a19f-4586-9fac-7e28fd953315 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:44:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a7f1bb4c-a19f-4586-9fac-7e28fd953315 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:44:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a7f1bb4c-a19f-4586-9fac-7e28fd953315 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:44:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a7f1bb4c-a19f-4586-9fac-7e28fd953315 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:44:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a7f1bb4c-a19f-4586-9fac-7e28fd953315 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:44:03 devstack cinder-volume[86916]: INFO cinder.keymgr.migration [None req-b8bf57ac-a596-4808-b39c-bc68bda3269d None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 11:44:03 devstack sudo[86931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:44:03 devstack sudo[86931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:44:04 devstack sudo[86931]: pam_unix(sudo:session): session closed for user root Sep 28 11:44:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a7f1bb4c-a19f-4586-9fac-7e28fd953315 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.233s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:44:04 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a7f1bb4c-a19f-4586-9fac-7e28fd953315 None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:44:04 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-a7f1bb4c-a19f-4586-9fac-7e28fd953315 None None] Driver initialization completed successfully. Sep 28 11:44:04 devstack cinder-volume[86916]: INFO cinder.manager [None req-a7f1bb4c-a19f-4586-9fac-7e28fd953315 None None] Initiating service 3 cleanup Sep 28 11:44:04 devstack cinder-volume[86916]: INFO cinder.manager [None req-a7f1bb4c-a19f-4586-9fac-7e28fd953315 None None] Service 3 cleanup completed. Sep 28 11:44:04 devstack cinder-volume[86916]: DEBUG cinder.service [None req-a7f1bb4c-a19f-4586-9fac-7e28fd953315 None None] Creating RPC server for service cinder-volume {{(pid=86916) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 11:44:04 devstack cinder-volume[86916]: DEBUG cinder.service [None req-a7f1bb4c-a19f-4586-9fac-7e28fd953315 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86916) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 11:44:04 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-a7f1bb4c-a19f-4586-9fac-7e28fd953315 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 28 11:44:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a7f1bb4c-a19f-4586-9fac-7e28fd953315 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:44:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a7f1bb4c-a19f-4586-9fac-7e28fd953315 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:44:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a7f1bb4c-a19f-4586-9fac-7e28fd953315 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:44:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a7f1bb4c-a19f-4586-9fac-7e28fd953315 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:44:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a7f1bb4c-a19f-4586-9fac-7e28fd953315 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:44:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a7f1bb4c-a19f-4586-9fac-7e28fd953315 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:44:04 devstack sudo[86942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:44:04 devstack sudo[86942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:44:04 devstack sudo[86942]: pam_unix(sudo:session): session closed for user root Sep 28 11:44:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a7f1bb4c-a19f-4586-9fac-7e28fd953315 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.246s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:44:04 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-a7f1bb4c-a19f-4586-9fac-7e28fd953315 None None] Driver post RPC initialization completed successfully. Sep 28 11:44:13 devstack cinder-volume[86617]: DEBUG dbcounter [-] [86617] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86617) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 11:44:14 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=2 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 11:44:14 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 11:44:38 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 11:44:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] thread count: 6 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 11:44:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] thread info: [<_MainThread(MainThread, started 135408582168704)>, , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 11:45:01 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c2e276a-e1fc-40aa-975d-7f0aee5c1f4b tempest-TaggedAttachmentsTest-1813125026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:45:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4c2e276a-e1fc-40aa-975d-7f0aee5c1f4b tempest-TaggedAttachmentsTest-1813125026 None] Flow 'volume_create_manager' (8289383d-e9ce-4a1d-9889-911c10b3d6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:45:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4c2e276a-e1fc-40aa-975d-7f0aee5c1f4b tempest-TaggedAttachmentsTest-1813125026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81b5d450-12ea-4b99-b006-7e802044103e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:45:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4c2e276a-e1fc-40aa-975d-7f0aee5c1f4b tempest-TaggedAttachmentsTest-1813125026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81b5d450-12ea-4b99-b006-7e802044103e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:44:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-943778777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6370651a-8721-4d5b-a87b-69cbcf1b1933,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e1de1a2519f42e09533b84acf83a21a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:45:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:45:02Z,use_quota=True,user_id='a59052588ea54fe091ab46241e2873e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:45:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4c2e276a-e1fc-40aa-975d-7f0aee5c1f4b tempest-TaggedAttachmentsTest-1813125026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1eec870-9561-4084-94f7-e64e59e38c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:45:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4c2e276a-e1fc-40aa-975d-7f0aee5c1f4b tempest-TaggedAttachmentsTest-1813125026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1eec870-9561-4084-94f7-e64e59e38c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:45:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4c2e276a-e1fc-40aa-975d-7f0aee5c1f4b tempest-TaggedAttachmentsTest-1813125026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9c2a27f-f24e-4ff3-8e3b-9c0c213f9f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:45:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4c2e276a-e1fc-40aa-975d-7f0aee5c1f4b tempest-TaggedAttachmentsTest-1813125026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9c2a27f-f24e-4ff3-8e3b-9c0c213f9f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6370651a-8721-4d5b-a87b-69cbcf1b1933', 'volume_name': 'volume-6370651a-8721-4d5b-a87b-69cbcf1b1933', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:45:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4c2e276a-e1fc-40aa-975d-7f0aee5c1f4b tempest-TaggedAttachmentsTest-1813125026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00f27184-de3b-42ef-a6ee-a9ca148c9234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:45:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4c2e276a-e1fc-40aa-975d-7f0aee5c1f4b tempest-TaggedAttachmentsTest-1813125026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00f27184-de3b-42ef-a6ee-a9ca148c9234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:45:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4c2e276a-e1fc-40aa-975d-7f0aee5c1f4b tempest-TaggedAttachmentsTest-1813125026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2580023c-1f28-4e16-a6a5-3c2e58bf4037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:45:02 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-4c2e276a-e1fc-40aa-975d-7f0aee5c1f4b tempest-TaggedAttachmentsTest-1813125026 None] Volume 6370651a-8721-4d5b-a87b-69cbcf1b1933: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6370651a-8721-4d5b-a87b-69cbcf1b1933', 'volume_size': 1} Sep 28 11:45:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4c2e276a-e1fc-40aa-975d-7f0aee5c1f4b tempest-TaggedAttachmentsTest-1813125026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:45:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4c2e276a-e1fc-40aa-975d-7f0aee5c1f4b tempest-TaggedAttachmentsTest-1813125026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:45:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4c2e276a-e1fc-40aa-975d-7f0aee5c1f4b tempest-TaggedAttachmentsTest-1813125026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:44:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-943778777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6370651a-8721-4d5b-a87b-69cbcf1b1933,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e1de1a2519f42e09533b84acf83a21a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:45:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:45:02Z,use_quota=True,user_id='a59052588ea54fe091ab46241e2873e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:45:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-4c2e276a-e1fc-40aa-975d-7f0aee5c1f4b tempest-TaggedAttachmentsTest-1813125026 None] Creating volume 6370651a-8721-4d5b-a87b-69cbcf1b1933 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:45:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4c2e276a-e1fc-40aa-975d-7f0aee5c1f4b tempest-TaggedAttachmentsTest-1813125026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:45:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4c2e276a-e1fc-40aa-975d-7f0aee5c1f4b tempest-TaggedAttachmentsTest-1813125026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:45:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4c2e276a-e1fc-40aa-975d-7f0aee5c1f4b tempest-TaggedAttachmentsTest-1813125026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:45:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4c2e276a-e1fc-40aa-975d-7f0aee5c1f4b tempest-TaggedAttachmentsTest-1813125026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:45:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4c2e276a-e1fc-40aa-975d-7f0aee5c1f4b tempest-TaggedAttachmentsTest-1813125026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:45:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4c2e276a-e1fc-40aa-975d-7f0aee5c1f4b tempest-TaggedAttachmentsTest-1813125026 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:45:02 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-4c2e276a-e1fc-40aa-975d-7f0aee5c1f4b tempest-TaggedAttachmentsTest-1813125026 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:45:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4c2e276a-e1fc-40aa-975d-7f0aee5c1f4b tempest-TaggedAttachmentsTest-1813125026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-6370651a-8721-4d5b-a87b-69cbcf1b1933 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:45:02 devstack sudo[87232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-6370651a-8721-4d5b-a87b-69cbcf1b1933 1073741824 Sep 28 11:45:02 devstack sudo[87232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:45:02 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [req-24636da1-86e9-498d-be82-a16aea822563 req-a22d803d-5131-4d57-9cb0-47c07888f4c4 tempest-VolumesGetTestJSON-1110093216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:45:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-24636da1-86e9-498d-be82-a16aea822563 req-a22d803d-5131-4d57-9cb0-47c07888f4c4 tempest-VolumesGetTestJSON-1110093216 None] Flow 'volume_create_manager' (e61e6640-f831-4a9b-b3ec-5f5d344dde7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:45:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-24636da1-86e9-498d-be82-a16aea822563 req-a22d803d-5131-4d57-9cb0-47c07888f4c4 tempest-VolumesGetTestJSON-1110093216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6eb1e65-78e1-4051-9ea5-ceffed2400f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:45:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-24636da1-86e9-498d-be82-a16aea822563 req-a22d803d-5131-4d57-9cb0-47c07888f4c4 tempest-VolumesGetTestJSON-1110093216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6eb1e65-78e1-4051-9ea5-ceffed2400f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:44:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-452519612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ab07374-51f8-47c7-b643-976d8d32b5fa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2156c2bf0df5483bacaefa16d4e98a34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:45:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:45:03Z,use_quota=True,user_id='5e2815e42b654e6a972cbd13f9043b7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:45:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-24636da1-86e9-498d-be82-a16aea822563 req-a22d803d-5131-4d57-9cb0-47c07888f4c4 tempest-VolumesGetTestJSON-1110093216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43e8d67e-9d44-4c40-b34d-52d454e4768d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:45:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-24636da1-86e9-498d-be82-a16aea822563 req-a22d803d-5131-4d57-9cb0-47c07888f4c4 tempest-VolumesGetTestJSON-1110093216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43e8d67e-9d44-4c40-b34d-52d454e4768d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:45:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-24636da1-86e9-498d-be82-a16aea822563 req-a22d803d-5131-4d57-9cb0-47c07888f4c4 tempest-VolumesGetTestJSON-1110093216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc9cf3df-513e-4df2-bb03-5d33a3338d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:45:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-24636da1-86e9-498d-be82-a16aea822563 req-a22d803d-5131-4d57-9cb0-47c07888f4c4 tempest-VolumesGetTestJSON-1110093216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc9cf3df-513e-4df2-bb03-5d33a3338d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ab07374-51f8-47c7-b643-976d8d32b5fa', 'volume_name': 'volume-2ab07374-51f8-47c7-b643-976d8d32b5fa', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:45:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-24636da1-86e9-498d-be82-a16aea822563 req-a22d803d-5131-4d57-9cb0-47c07888f4c4 tempest-VolumesGetTestJSON-1110093216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69efc7b0-e32e-4d14-b248-f4aeaf59fa8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:45:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-24636da1-86e9-498d-be82-a16aea822563 req-a22d803d-5131-4d57-9cb0-47c07888f4c4 tempest-VolumesGetTestJSON-1110093216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69efc7b0-e32e-4d14-b248-f4aeaf59fa8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:45:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-24636da1-86e9-498d-be82-a16aea822563 req-a22d803d-5131-4d57-9cb0-47c07888f4c4 tempest-VolumesGetTestJSON-1110093216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ce6d994-fec3-4ab3-a338-9ead06176e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:45:02 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [req-24636da1-86e9-498d-be82-a16aea822563 req-a22d803d-5131-4d57-9cb0-47c07888f4c4 tempest-VolumesGetTestJSON-1110093216 None] Volume 2ab07374-51f8-47c7-b643-976d8d32b5fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ab07374-51f8-47c7-b643-976d8d32b5fa', 'volume_size': 1} Sep 28 11:45:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-24636da1-86e9-498d-be82-a16aea822563 req-a22d803d-5131-4d57-9cb0-47c07888f4c4 tempest-VolumesGetTestJSON-1110093216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:45:02 devstack sudo[87232]: pam_unix(sudo:session): session closed for user root Sep 28 11:45:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4c2e276a-e1fc-40aa-975d-7f0aee5c1f4b tempest-TaggedAttachmentsTest-1813125026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-6370651a-8721-4d5b-a87b-69cbcf1b1933 1073741824" returned: 0 in 0.653s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:45:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4c2e276a-e1fc-40aa-975d-7f0aee5c1f4b tempest-TaggedAttachmentsTest-1813125026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-6370651a-8721-4d5b-a87b-69cbcf1b1933 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:45:02 devstack sudo[87551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-6370651a-8721-4d5b-a87b-69cbcf1b1933 Sep 28 11:45:02 devstack sudo[87551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:45:03 devstack sudo[87551]: pam_unix(sudo:session): session closed for user root Sep 28 11:45:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4c2e276a-e1fc-40aa-975d-7f0aee5c1f4b tempest-TaggedAttachmentsTest-1813125026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-6370651a-8721-4d5b-a87b-69cbcf1b1933" returned: 0 in 0.292s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:45:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4c2e276a-e1fc-40aa-975d-7f0aee5c1f4b tempest-TaggedAttachmentsTest-1813125026 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:45:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4c2e276a-e1fc-40aa-975d-7f0aee5c1f4b tempest-TaggedAttachmentsTest-1813125026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:45:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-24636da1-86e9-498d-be82-a16aea822563 req-a22d803d-5131-4d57-9cb0-47c07888f4c4 tempest-VolumesGetTestJSON-1110093216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.375s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:45:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [req-24636da1-86e9-498d-be82-a16aea822563 req-a22d803d-5131-4d57-9cb0-47c07888f4c4 tempest-VolumesGetTestJSON-1110093216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:44:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-452519612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ab07374-51f8-47c7-b643-976d8d32b5fa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2156c2bf0df5483bacaefa16d4e98a34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:45:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:45:03Z,use_quota=True,user_id='5e2815e42b654e6a972cbd13f9043b7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:45:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [req-24636da1-86e9-498d-be82-a16aea822563 req-a22d803d-5131-4d57-9cb0-47c07888f4c4 tempest-VolumesGetTestJSON-1110093216 None] Creating volume 2ab07374-51f8-47c7-b643-976d8d32b5fa {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:45:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-24636da1-86e9-498d-be82-a16aea822563 req-a22d803d-5131-4d57-9cb0-47c07888f4c4 tempest-VolumesGetTestJSON-1110093216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:45:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-24636da1-86e9-498d-be82-a16aea822563 req-a22d803d-5131-4d57-9cb0-47c07888f4c4 tempest-VolumesGetTestJSON-1110093216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:45:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [req-24636da1-86e9-498d-be82-a16aea822563 req-a22d803d-5131-4d57-9cb0-47c07888f4c4 tempest-VolumesGetTestJSON-1110093216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:45:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [req-24636da1-86e9-498d-be82-a16aea822563 req-a22d803d-5131-4d57-9cb0-47c07888f4c4 tempest-VolumesGetTestJSON-1110093216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:45:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-24636da1-86e9-498d-be82-a16aea822563 req-a22d803d-5131-4d57-9cb0-47c07888f4c4 tempest-VolumesGetTestJSON-1110093216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:45:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [req-24636da1-86e9-498d-be82-a16aea822563 req-a22d803d-5131-4d57-9cb0-47c07888f4c4 tempest-VolumesGetTestJSON-1110093216 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:45:03 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [req-24636da1-86e9-498d-be82-a16aea822563 req-a22d803d-5131-4d57-9cb0-47c07888f4c4 tempest-VolumesGetTestJSON-1110093216 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:45:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-24636da1-86e9-498d-be82-a16aea822563 req-a22d803d-5131-4d57-9cb0-47c07888f4c4 tempest-VolumesGetTestJSON-1110093216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2ab07374-51f8-47c7-b643-976d8d32b5fa 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:45:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4c2e276a-e1fc-40aa-975d-7f0aee5c1f4b tempest-TaggedAttachmentsTest-1813125026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2580023c-1f28-4e16-a6a5-3c2e58bf4037) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6370651a-8721-4d5b-a87b-69cbcf1b1933', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:45:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4c2e276a-e1fc-40aa-975d-7f0aee5c1f4b tempest-TaggedAttachmentsTest-1813125026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cefa7632-1acf-4799-a74a-487c3b2791a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:45:03 devstack sudo[87554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2ab07374-51f8-47c7-b643-976d8d32b5fa 1073741824 Sep 28 11:45:03 devstack sudo[87554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:45:03 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-4c2e276a-e1fc-40aa-975d-7f0aee5c1f4b tempest-TaggedAttachmentsTest-1813125026 None] Volume volume-6370651a-8721-4d5b-a87b-69cbcf1b1933 (6370651a-8721-4d5b-a87b-69cbcf1b1933): created successfully Sep 28 11:45:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4c2e276a-e1fc-40aa-975d-7f0aee5c1f4b tempest-TaggedAttachmentsTest-1813125026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cefa7632-1acf-4799-a74a-487c3b2791a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:45:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4c2e276a-e1fc-40aa-975d-7f0aee5c1f4b tempest-TaggedAttachmentsTest-1813125026 None] Flow 'volume_create_manager' (8289383d-e9ce-4a1d-9889-911c10b3d6f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:45:03 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-4c2e276a-e1fc-40aa-975d-7f0aee5c1f4b tempest-TaggedAttachmentsTest-1813125026 None] Created volume successfully. Sep 28 11:45:03 devstack sudo[87554]: pam_unix(sudo:session): session closed for user root Sep 28 11:45:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-24636da1-86e9-498d-be82-a16aea822563 req-a22d803d-5131-4d57-9cb0-47c07888f4c4 tempest-VolumesGetTestJSON-1110093216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2ab07374-51f8-47c7-b643-976d8d32b5fa 1073741824" returned: 0 in 0.617s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:45:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-24636da1-86e9-498d-be82-a16aea822563 req-a22d803d-5131-4d57-9cb0-47c07888f4c4 tempest-VolumesGetTestJSON-1110093216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2ab07374-51f8-47c7-b643-976d8d32b5fa {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:45:03 devstack sudo[87560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2ab07374-51f8-47c7-b643-976d8d32b5fa Sep 28 11:45:03 devstack sudo[87560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:45:04 devstack sudo[87560]: pam_unix(sudo:session): session closed for user root Sep 28 11:45:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-24636da1-86e9-498d-be82-a16aea822563 req-a22d803d-5131-4d57-9cb0-47c07888f4c4 tempest-VolumesGetTestJSON-1110093216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2ab07374-51f8-47c7-b643-976d8d32b5fa" returned: 0 in 0.450s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:45:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [req-24636da1-86e9-498d-be82-a16aea822563 req-a22d803d-5131-4d57-9cb0-47c07888f4c4 tempest-VolumesGetTestJSON-1110093216 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:45:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-24636da1-86e9-498d-be82-a16aea822563 req-a22d803d-5131-4d57-9cb0-47c07888f4c4 tempest-VolumesGetTestJSON-1110093216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:45:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-24636da1-86e9-498d-be82-a16aea822563 req-a22d803d-5131-4d57-9cb0-47c07888f4c4 tempest-VolumesGetTestJSON-1110093216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ce6d994-fec3-4ab3-a338-9ead06176e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ab07374-51f8-47c7-b643-976d8d32b5fa', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:45:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-24636da1-86e9-498d-be82-a16aea822563 req-a22d803d-5131-4d57-9cb0-47c07888f4c4 tempest-VolumesGetTestJSON-1110093216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5683d5ff-ff15-4805-b8d0-af46aeb93d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:45:04 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [req-24636da1-86e9-498d-be82-a16aea822563 req-a22d803d-5131-4d57-9cb0-47c07888f4c4 tempest-VolumesGetTestJSON-1110093216 None] Volume volume-2ab07374-51f8-47c7-b643-976d8d32b5fa (2ab07374-51f8-47c7-b643-976d8d32b5fa): created successfully Sep 28 11:45:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-24636da1-86e9-498d-be82-a16aea822563 req-a22d803d-5131-4d57-9cb0-47c07888f4c4 tempest-VolumesGetTestJSON-1110093216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5683d5ff-ff15-4805-b8d0-af46aeb93d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:45:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-24636da1-86e9-498d-be82-a16aea822563 req-a22d803d-5131-4d57-9cb0-47c07888f4c4 tempest-VolumesGetTestJSON-1110093216 None] Flow 'volume_create_manager' (e61e6640-f831-4a9b-b3ec-5f5d344dde7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:45:04 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-24636da1-86e9-498d-be82-a16aea822563 req-a22d803d-5131-4d57-9cb0-47c07888f4c4 tempest-VolumesGetTestJSON-1110093216 None] Created volume successfully. Sep 28 11:45:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-a7720230-429d-42d3-87d8-82558808bf5c req-a02bc35e-cbf6-40d7-a788-d8ba318333dd tempest-VolumesGetTestJSON-1110093216 None] Acquiring lock "cinder-2ab07374-51f8-47c7-b643-976d8d32b5fa-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:45:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-a7720230-429d-42d3-87d8-82558808bf5c req-a02bc35e-cbf6-40d7-a788-d8ba318333dd tempest-VolumesGetTestJSON-1110093216 None] Lock "cinder-2ab07374-51f8-47c7-b643-976d8d32b5fa-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:45:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-a7720230-429d-42d3-87d8-82558808bf5c req-a02bc35e-cbf6-40d7-a788-d8ba318333dd tempest-VolumesGetTestJSON-1110093216 None] Acquiring lock "cinder-quobyte-2ab07374-51f8-47c7-b643-976d8d32b5fa" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:45:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-a7720230-429d-42d3-87d8-82558808bf5c req-a02bc35e-cbf6-40d7-a788-d8ba318333dd tempest-VolumesGetTestJSON-1110093216 None] Lock "cinder-quobyte-2ab07374-51f8-47c7-b643-976d8d32b5fa" acquired by "delete_volume" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:45:05 devstack cinder-volume[86916]: INFO oslo.privsep.daemon [req-a7720230-429d-42d3-87d8-82558808bf5c req-a02bc35e-cbf6-40d7-a788-d8ba318333dd tempest-VolumesGetTestJSON-1110093216 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmps75h_k4g/privsep.sock'] Sep 28 11:45:05 devstack sudo[87564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmps75h_k4g/privsep.sock Sep 28 11:45:05 devstack sudo[87564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:45:06 devstack cinder-volume[86916]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 28 11:45:06 devstack cinder-volume[86916]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 11:45:06 devstack cinder-volume[86916]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 28 11:45:06 devstack cinder-volume[86916]: WARNING oslo.privsep.daemon [-] privsep log: Sep 28 11:45:06 devstack cinder-volume[86916]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 28 11:45:06 devstack cinder-volume[86916]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 28 11:45:06 devstack cinder-volume[86916]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 11:45:06 devstack cinder-volume[86916]: WARNING oslo.privsep.daemon [-] privsep log: Sep 28 11:45:06 devstack cinder-volume[86916]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 28 11:45:06 devstack sudo[87564]: pam_unix(sudo:session): session closed for user root Sep 28 11:45:06 devstack cinder-volume[86916]: INFO oslo.privsep.daemon [req-a7720230-429d-42d3-87d8-82558808bf5c req-a02bc35e-cbf6-40d7-a788-d8ba318333dd tempest-VolumesGetTestJSON-1110093216 None] Spawned new privsep daemon via rootwrap Sep 28 11:45:06 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [req-a7720230-429d-42d3-87d8-82558808bf5c req-a02bc35e-cbf6-40d7-a788-d8ba318333dd tempest-VolumesGetTestJSON-1110093216 None] Accepted privsep connection to /tmp/tmps75h_k4g/privsep.sock {{(pid=86916) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 28 11:45:06 devstack cinder-volume[86916]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 28 11:45:06 devstack cinder-volume[86916]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 28 11:45:06 devstack cinder-volume[86916]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 28 11:45:06 devstack cinder-volume[86916]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87567 Sep 28 11:45:06 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9f1965-5e10-4c3d-8953-b61baeb68b18]: (2,) {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:45:06 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bcd4960-4a5a-40c2-8bca-bc70b923eb38]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:45:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-a7720230-429d-42d3-87d8-82558808bf5c req-a02bc35e-cbf6-40d7-a788-d8ba318333dd tempest-VolumesGetTestJSON-1110093216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2ab07374-51f8-47c7-b643-976d8d32b5fa {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:45:07 devstack sudo[87571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2ab07374-51f8-47c7-b643-976d8d32b5fa Sep 28 11:45:07 devstack sudo[87571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:45:07 devstack sudo[87571]: pam_unix(sudo:session): session closed for user root Sep 28 11:45:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-a7720230-429d-42d3-87d8-82558808bf5c req-a02bc35e-cbf6-40d7-a788-d8ba318333dd tempest-VolumesGetTestJSON-1110093216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2ab07374-51f8-47c7-b643-976d8d32b5fa" returned: 0 in 0.498s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:45:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-a7720230-429d-42d3-87d8-82558808bf5c req-a02bc35e-cbf6-40d7-a788-d8ba318333dd tempest-VolumesGetTestJSON-1110093216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2ab07374-51f8-47c7-b643-976d8d32b5fa {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:45:07 devstack sudo[87577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2ab07374-51f8-47c7-b643-976d8d32b5fa Sep 28 11:45:07 devstack sudo[87577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:45:07 devstack sudo[87577]: pam_unix(sudo:session): session closed for user root Sep 28 11:45:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-a7720230-429d-42d3-87d8-82558808bf5c req-a02bc35e-cbf6-40d7-a788-d8ba318333dd tempest-VolumesGetTestJSON-1110093216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2ab07374-51f8-47c7-b643-976d8d32b5fa" returned: 0 in 0.296s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:45:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-a7720230-429d-42d3-87d8-82558808bf5c req-a02bc35e-cbf6-40d7-a788-d8ba318333dd tempest-VolumesGetTestJSON-1110093216 None] Lock "cinder-quobyte-2ab07374-51f8-47c7-b643-976d8d32b5fa" released by "delete_volume" :: held 2.113s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:45:07 devstack cinder-volume[86916]: WARNING cinder.quota [req-a7720230-429d-42d3-87d8-82558808bf5c req-a02bc35e-cbf6-40d7-a788-d8ba318333dd tempest-VolumesGetTestJSON-1110093216 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 11:45:07 devstack cinder-volume[86916]: WARNING cinder.quota [req-a7720230-429d-42d3-87d8-82558808bf5c req-a02bc35e-cbf6-40d7-a788-d8ba318333dd tempest-VolumesGetTestJSON-1110093216 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 11:45:07 devstack cinder-volume[86916]: DEBUG cinder.quota [req-a7720230-429d-42d3-87d8-82558808bf5c req-a02bc35e-cbf6-40d7-a788-d8ba318333dd tempest-VolumesGetTestJSON-1110093216 None] Created reservations ['412ab249-a665-4cb3-a3bc-7702ceddc095', 'e959a549-77a6-4d97-89ef-4712354c858a', '7d4948ba-ad5b-4c94-b649-9e5e185fe2ff', '267dfb3f-c4e1-4e5d-a7cb-e64f72e565dd'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:45:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-a7720230-429d-42d3-87d8-82558808bf5c req-a02bc35e-cbf6-40d7-a788-d8ba318333dd tempest-VolumesGetTestJSON-1110093216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:45:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-a7720230-429d-42d3-87d8-82558808bf5c req-a02bc35e-cbf6-40d7-a788-d8ba318333dd tempest-VolumesGetTestJSON-1110093216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:45:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [req-a7720230-429d-42d3-87d8-82558808bf5c req-a02bc35e-cbf6-40d7-a788-d8ba318333dd tempest-VolumesGetTestJSON-1110093216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:45:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [req-a7720230-429d-42d3-87d8-82558808bf5c req-a02bc35e-cbf6-40d7-a788-d8ba318333dd tempest-VolumesGetTestJSON-1110093216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:45:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-a7720230-429d-42d3-87d8-82558808bf5c req-a02bc35e-cbf6-40d7-a788-d8ba318333dd tempest-VolumesGetTestJSON-1110093216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:45:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-a7720230-429d-42d3-87d8-82558808bf5c req-a02bc35e-cbf6-40d7-a788-d8ba318333dd tempest-VolumesGetTestJSON-1110093216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:45:08 devstack sudo[87582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:45:08 devstack sudo[87582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:45:08 devstack sudo[87582]: pam_unix(sudo:session): session closed for user root Sep 28 11:45:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-a7720230-429d-42d3-87d8-82558808bf5c req-a02bc35e-cbf6-40d7-a788-d8ba318333dd tempest-VolumesGetTestJSON-1110093216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.353s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:45:08 devstack cinder-volume[86916]: DEBUG cinder.manager [req-a7720230-429d-42d3-87d8-82558808bf5c req-a02bc35e-cbf6-40d7-a788-d8ba318333dd tempest-VolumesGetTestJSON-1110093216 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:45:08 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-a7720230-429d-42d3-87d8-82558808bf5c req-a02bc35e-cbf6-40d7-a788-d8ba318333dd tempest-VolumesGetTestJSON-1110093216 None] Deleted volume successfully. Sep 28 11:45:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-a7720230-429d-42d3-87d8-82558808bf5c req-a02bc35e-cbf6-40d7-a788-d8ba318333dd tempest-VolumesGetTestJSON-1110093216 None] Lock "cinder-2ab07374-51f8-47c7-b643-976d8d32b5fa-delete_volume" released by "delete_volume" :: held 2.921s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:45:18 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:UPDATE=14,cinder:SELECT=8,cinder:INSERT=4 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 11:45:18 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=10,cinder:UPDATE=14,cinder:DELETE=3,cinder:INSERT=2 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 11:45:30 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d64268e-97b9-47c8-9f86-6421b62dc2ab tempest-VolumesAdminNegativeTest-119729137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:45:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2d64268e-97b9-47c8-9f86-6421b62dc2ab tempest-VolumesAdminNegativeTest-119729137 None] Flow 'volume_create_manager' (33723883-c8f0-4ff9-9c2d-d908df7ffc07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:45:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2d64268e-97b9-47c8-9f86-6421b62dc2ab tempest-VolumesAdminNegativeTest-119729137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95ee886f-48c8-471f-8beb-d30296978b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:45:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2d64268e-97b9-47c8-9f86-6421b62dc2ab tempest-VolumesAdminNegativeTest-119729137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95ee886f-48c8-471f-8beb-d30296978b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:45:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-46301902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52fdf315-2128-4ecc-b318-86d2c617d456,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ada4053be84f4d18bac217fe32e313c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:45:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:45:31Z,use_quota=True,user_id='5f6059375fdd49f18ecfeb5526d65b2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:45:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2d64268e-97b9-47c8-9f86-6421b62dc2ab tempest-VolumesAdminNegativeTest-119729137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1e8f071-d334-4bc4-bb5e-e213af127803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:45:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2d64268e-97b9-47c8-9f86-6421b62dc2ab tempest-VolumesAdminNegativeTest-119729137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1e8f071-d334-4bc4-bb5e-e213af127803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:45:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2d64268e-97b9-47c8-9f86-6421b62dc2ab tempest-VolumesAdminNegativeTest-119729137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4b30235-9aa0-4e62-993f-899372806e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:45:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2d64268e-97b9-47c8-9f86-6421b62dc2ab tempest-VolumesAdminNegativeTest-119729137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4b30235-9aa0-4e62-993f-899372806e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52fdf315-2128-4ecc-b318-86d2c617d456', 'volume_name': 'volume-52fdf315-2128-4ecc-b318-86d2c617d456', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:45:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2d64268e-97b9-47c8-9f86-6421b62dc2ab tempest-VolumesAdminNegativeTest-119729137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83d93a08-fb51-4832-befb-11559456fdf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:45:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2d64268e-97b9-47c8-9f86-6421b62dc2ab tempest-VolumesAdminNegativeTest-119729137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83d93a08-fb51-4832-befb-11559456fdf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:45:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2d64268e-97b9-47c8-9f86-6421b62dc2ab tempest-VolumesAdminNegativeTest-119729137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5df35420-1ca6-4ea8-92b2-0f8210405ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:45:30 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-2d64268e-97b9-47c8-9f86-6421b62dc2ab tempest-VolumesAdminNegativeTest-119729137 None] Volume 52fdf315-2128-4ecc-b318-86d2c617d456: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52fdf315-2128-4ecc-b318-86d2c617d456', 'volume_size': 1} Sep 28 11:45:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2d64268e-97b9-47c8-9f86-6421b62dc2ab tempest-VolumesAdminNegativeTest-119729137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:45:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2d64268e-97b9-47c8-9f86-6421b62dc2ab tempest-VolumesAdminNegativeTest-119729137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:45:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2d64268e-97b9-47c8-9f86-6421b62dc2ab tempest-VolumesAdminNegativeTest-119729137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:45:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-46301902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52fdf315-2128-4ecc-b318-86d2c617d456,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ada4053be84f4d18bac217fe32e313c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:45:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:45:31Z,use_quota=True,user_id='5f6059375fdd49f18ecfeb5526d65b2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:45:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-2d64268e-97b9-47c8-9f86-6421b62dc2ab tempest-VolumesAdminNegativeTest-119729137 None] Creating volume 52fdf315-2128-4ecc-b318-86d2c617d456 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:45:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2d64268e-97b9-47c8-9f86-6421b62dc2ab tempest-VolumesAdminNegativeTest-119729137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:45:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2d64268e-97b9-47c8-9f86-6421b62dc2ab tempest-VolumesAdminNegativeTest-119729137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:45:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2d64268e-97b9-47c8-9f86-6421b62dc2ab tempest-VolumesAdminNegativeTest-119729137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:45:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2d64268e-97b9-47c8-9f86-6421b62dc2ab tempest-VolumesAdminNegativeTest-119729137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:45:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2d64268e-97b9-47c8-9f86-6421b62dc2ab tempest-VolumesAdminNegativeTest-119729137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:45:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2d64268e-97b9-47c8-9f86-6421b62dc2ab tempest-VolumesAdminNegativeTest-119729137 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:45:30 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-2d64268e-97b9-47c8-9f86-6421b62dc2ab tempest-VolumesAdminNegativeTest-119729137 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:45:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2d64268e-97b9-47c8-9f86-6421b62dc2ab tempest-VolumesAdminNegativeTest-119729137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-52fdf315-2128-4ecc-b318-86d2c617d456 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:45:31 devstack sudo[87961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-52fdf315-2128-4ecc-b318-86d2c617d456 1073741824 Sep 28 11:45:31 devstack sudo[87961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:45:32 devstack sudo[87961]: pam_unix(sudo:session): session closed for user root Sep 28 11:45:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2d64268e-97b9-47c8-9f86-6421b62dc2ab tempest-VolumesAdminNegativeTest-119729137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-52fdf315-2128-4ecc-b318-86d2c617d456 1073741824" returned: 0 in 1.410s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:45:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2d64268e-97b9-47c8-9f86-6421b62dc2ab tempest-VolumesAdminNegativeTest-119729137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-52fdf315-2128-4ecc-b318-86d2c617d456 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:45:32 devstack sudo[87996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-52fdf315-2128-4ecc-b318-86d2c617d456 Sep 28 11:45:32 devstack sudo[87996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:45:33 devstack sudo[87996]: pam_unix(sudo:session): session closed for user root Sep 28 11:45:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2d64268e-97b9-47c8-9f86-6421b62dc2ab tempest-VolumesAdminNegativeTest-119729137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-52fdf315-2128-4ecc-b318-86d2c617d456" returned: 0 in 0.808s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:45:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2d64268e-97b9-47c8-9f86-6421b62dc2ab tempest-VolumesAdminNegativeTest-119729137 None] <== create_volume: return (2348ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:45:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2d64268e-97b9-47c8-9f86-6421b62dc2ab tempest-VolumesAdminNegativeTest-119729137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.351s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:45:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2d64268e-97b9-47c8-9f86-6421b62dc2ab tempest-VolumesAdminNegativeTest-119729137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5df35420-1ca6-4ea8-92b2-0f8210405ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52fdf315-2128-4ecc-b318-86d2c617d456', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:45:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2d64268e-97b9-47c8-9f86-6421b62dc2ab tempest-VolumesAdminNegativeTest-119729137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4b01320-2dbd-4e06-b182-034f3699dd21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:45:33 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-2d64268e-97b9-47c8-9f86-6421b62dc2ab tempest-VolumesAdminNegativeTest-119729137 None] Volume volume-52fdf315-2128-4ecc-b318-86d2c617d456 (52fdf315-2128-4ecc-b318-86d2c617d456): created successfully Sep 28 11:45:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2d64268e-97b9-47c8-9f86-6421b62dc2ab tempest-VolumesAdminNegativeTest-119729137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4b01320-2dbd-4e06-b182-034f3699dd21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:45:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2d64268e-97b9-47c8-9f86-6421b62dc2ab tempest-VolumesAdminNegativeTest-119729137 None] Flow 'volume_create_manager' (33723883-c8f0-4ff9-9c2d-d908df7ffc07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:45:33 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-2d64268e-97b9-47c8-9f86-6421b62dc2ab tempest-VolumesAdminNegativeTest-119729137 None] Created volume successfully. Sep 28 11:45:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-06306217-1a03-4ec4-9352-47d5c6b34369 tempest-VolumesAdminNegativeTest-119729137 None] Acquiring lock "cinder-52fdf315-2128-4ecc-b318-86d2c617d456-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:45:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-06306217-1a03-4ec4-9352-47d5c6b34369 tempest-VolumesAdminNegativeTest-119729137 None] Lock "cinder-52fdf315-2128-4ecc-b318-86d2c617d456-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:45:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-06306217-1a03-4ec4-9352-47d5c6b34369 tempest-VolumesAdminNegativeTest-119729137 None] Acquiring lock "cinder-quobyte-52fdf315-2128-4ecc-b318-86d2c617d456" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:45:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-06306217-1a03-4ec4-9352-47d5c6b34369 tempest-VolumesAdminNegativeTest-119729137 None] Lock "cinder-quobyte-52fdf315-2128-4ecc-b318-86d2c617d456" acquired by "delete_volume" :: waited 0.028s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:45:35 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[31145732-0e85-4339-ac6f-a1da5c1efc22]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:45:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-06306217-1a03-4ec4-9352-47d5c6b34369 tempest-VolumesAdminNegativeTest-119729137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-52fdf315-2128-4ecc-b318-86d2c617d456 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:45:35 devstack sudo[88013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-52fdf315-2128-4ecc-b318-86d2c617d456 Sep 28 11:45:35 devstack sudo[88013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:45:36 devstack sudo[88013]: pam_unix(sudo:session): session closed for user root Sep 28 11:45:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-06306217-1a03-4ec4-9352-47d5c6b34369 tempest-VolumesAdminNegativeTest-119729137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-52fdf315-2128-4ecc-b318-86d2c617d456" returned: 0 in 0.937s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:45:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-06306217-1a03-4ec4-9352-47d5c6b34369 tempest-VolumesAdminNegativeTest-119729137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-52fdf315-2128-4ecc-b318-86d2c617d456 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:45:36 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-34f2b845-fb2e-469c-a043-4b6a773c7805 tempest-GroupsTest-1250607902 None] Group tempest-Group1-327048922: creating Sep 28 11:45:36 devstack sudo[88021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-52fdf315-2128-4ecc-b318-86d2c617d456 Sep 28 11:45:36 devstack sudo[88021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:45:36 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-34f2b845-fb2e-469c-a043-4b6a773c7805 tempest-GroupsTest-1250607902 None] Group tempest-Group1-327048922: created successfully Sep 28 11:45:36 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-34f2b845-fb2e-469c-a043-4b6a773c7805 tempest-GroupsTest-1250607902 None] Create group completed successfully. Sep 28 11:45:36 devstack sudo[88021]: pam_unix(sudo:session): session closed for user root Sep 28 11:45:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-06306217-1a03-4ec4-9352-47d5c6b34369 tempest-VolumesAdminNegativeTest-119729137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-52fdf315-2128-4ecc-b318-86d2c617d456" returned: 0 in 0.422s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:45:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-06306217-1a03-4ec4-9352-47d5c6b34369 tempest-VolumesAdminNegativeTest-119729137 None] Lock "cinder-quobyte-52fdf315-2128-4ecc-b318-86d2c617d456" released by "delete_volume" :: held 1.468s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:45:37 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-06306217-1a03-4ec4-9352-47d5c6b34369 tempest-VolumesAdminNegativeTest-119729137 None] Created reservations ['281d70c9-b982-4d3f-a6e6-2a46a3114f65', '54d47dee-3771-418a-8362-c2b395c8ac1e', '0e3630e4-6bb5-439e-a410-08026e2329e2', '87eb37aa-4423-4d09-b747-ce35c1a0f319'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:45:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-06306217-1a03-4ec4-9352-47d5c6b34369 tempest-VolumesAdminNegativeTest-119729137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:45:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-06306217-1a03-4ec4-9352-47d5c6b34369 tempest-VolumesAdminNegativeTest-119729137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:45:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-06306217-1a03-4ec4-9352-47d5c6b34369 tempest-VolumesAdminNegativeTest-119729137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:45:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-06306217-1a03-4ec4-9352-47d5c6b34369 tempest-VolumesAdminNegativeTest-119729137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:45:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-06306217-1a03-4ec4-9352-47d5c6b34369 tempest-VolumesAdminNegativeTest-119729137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:45:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-06306217-1a03-4ec4-9352-47d5c6b34369 tempest-VolumesAdminNegativeTest-119729137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:45:37 devstack sudo[88024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:45:37 devstack sudo[88024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:45:37 devstack sudo[88024]: pam_unix(sudo:session): session closed for user root Sep 28 11:45:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-06306217-1a03-4ec4-9352-47d5c6b34369 tempest-VolumesAdminNegativeTest-119729137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.426s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:45:37 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-06306217-1a03-4ec4-9352-47d5c6b34369 tempest-VolumesAdminNegativeTest-119729137 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:45:37 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-06306217-1a03-4ec4-9352-47d5c6b34369 tempest-VolumesAdminNegativeTest-119729137 None] Deleted volume successfully. Sep 28 11:45:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-06306217-1a03-4ec4-9352-47d5c6b34369 tempest-VolumesAdminNegativeTest-119729137 None] Lock "cinder-52fdf315-2128-4ecc-b318-86d2c617d456-delete_volume" released by "delete_volume" :: held 2.397s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:45:38 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-715c25f9-4326-44f7-90eb-332a054a6d7d tempest-GroupsTest-1250607902 None] Group tempest-Group2-1380510884: creating Sep 28 11:45:38 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-715c25f9-4326-44f7-90eb-332a054a6d7d tempest-GroupsTest-1250607902 None] Group tempest-Group2-1380510884: created successfully Sep 28 11:45:38 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-715c25f9-4326-44f7-90eb-332a054a6d7d tempest-GroupsTest-1250607902 None] Create group completed successfully. Sep 28 11:45:38 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 11:45:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:45:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:45:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:45:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:45:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:45:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:45:38 devstack sudo[88031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:45:38 devstack sudo[88031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:45:39 devstack sudo[88031]: pam_unix(sudo:session): session closed for user root Sep 28 11:45:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.688s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:45:39 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:45:39 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 11:45:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] thread count: 8 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 11:45:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] thread info: [<_MainThread(MainThread, started 135408582168704)>, , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 11:45:40 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebccd092-a641-40f4-91d9-2a731eafe130 tempest-GroupsTest-1250607902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:45:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ebccd092-a641-40f4-91d9-2a731eafe130 tempest-GroupsTest-1250607902 None] Flow 'volume_create_manager' (db5fa8a3-5420-4bd7-a677-5fd62fd7329d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:45:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ebccd092-a641-40f4-91d9-2a731eafe130 tempest-GroupsTest-1250607902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da239988-0bc9-4236-9775-f80cd9a0ee90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:45:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ebccd092-a641-40f4-91d9-2a731eafe130 tempest-GroupsTest-1250607902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da239988-0bc9-4236-9775-f80cd9a0ee90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1428548234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d5fc2fcc-b8f7-4f07-8f8b-b0e52df16449,host='devstack@QuobyteHD#QuobyteHD',id=5c7dac31-1f37-4f07-a188-f352ed1d9b93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb286e3d53b74d04adc3dea2d62cc81a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:45:40Z,use_quota=True,user_id='42bf1731e62a40b48ee6689a3f87df9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37cac807-9b06-44f0-a988-fb3372b60120),volume_type_id=37cac807-9b06-44f0-a988-fb3372b60120)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:45:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ebccd092-a641-40f4-91d9-2a731eafe130 tempest-GroupsTest-1250607902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2bbf72d-fbbd-46dd-8d38-8ec755068a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:45:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ebccd092-a641-40f4-91d9-2a731eafe130 tempest-GroupsTest-1250607902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2bbf72d-fbbd-46dd-8d38-8ec755068a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:45:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ebccd092-a641-40f4-91d9-2a731eafe130 tempest-GroupsTest-1250607902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0af9bd92-1ac4-4684-a1fa-1a4f586f522a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:45:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ebccd092-a641-40f4-91d9-2a731eafe130 tempest-GroupsTest-1250607902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0af9bd92-1ac4-4684-a1fa-1a4f586f522a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c7dac31-1f37-4f07-a188-f352ed1d9b93', 'volume_name': 'volume-5c7dac31-1f37-4f07-a188-f352ed1d9b93', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:45:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ebccd092-a641-40f4-91d9-2a731eafe130 tempest-GroupsTest-1250607902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6eb40e6-567f-469e-85ae-fa8b435449e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:45:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ebccd092-a641-40f4-91d9-2a731eafe130 tempest-GroupsTest-1250607902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6eb40e6-567f-469e-85ae-fa8b435449e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:45:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ebccd092-a641-40f4-91d9-2a731eafe130 tempest-GroupsTest-1250607902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bea79c0-cdb7-4046-bf36-fb0f4cbeab3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:45:40 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-ebccd092-a641-40f4-91d9-2a731eafe130 tempest-GroupsTest-1250607902 None] Volume 5c7dac31-1f37-4f07-a188-f352ed1d9b93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c7dac31-1f37-4f07-a188-f352ed1d9b93', 'volume_size': 1} Sep 28 11:45:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ebccd092-a641-40f4-91d9-2a731eafe130 tempest-GroupsTest-1250607902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:45:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ebccd092-a641-40f4-91d9-2a731eafe130 tempest-GroupsTest-1250607902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:45:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ebccd092-a641-40f4-91d9-2a731eafe130 tempest-GroupsTest-1250607902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d5fc2fcc-b8f7-4f07-8f8b-b0e52df16449,created_at=2026-09-28T09:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1428548234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d5fc2fcc-b8f7-4f07-8f8b-b0e52df16449,host='devstack@QuobyteHD#QuobyteHD',id=5c7dac31-1f37-4f07-a188-f352ed1d9b93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb286e3d53b74d04adc3dea2d62cc81a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:45:40Z,use_quota=True,user_id='42bf1731e62a40b48ee6689a3f87df9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37cac807-9b06-44f0-a988-fb3372b60120),volume_type_id=37cac807-9b06-44f0-a988-fb3372b60120)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:45:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-ebccd092-a641-40f4-91d9-2a731eafe130 tempest-GroupsTest-1250607902 None] Creating volume 5c7dac31-1f37-4f07-a188-f352ed1d9b93 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:45:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ebccd092-a641-40f4-91d9-2a731eafe130 tempest-GroupsTest-1250607902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:45:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ebccd092-a641-40f4-91d9-2a731eafe130 tempest-GroupsTest-1250607902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:45:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ebccd092-a641-40f4-91d9-2a731eafe130 tempest-GroupsTest-1250607902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:45:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ebccd092-a641-40f4-91d9-2a731eafe130 tempest-GroupsTest-1250607902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:45:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ebccd092-a641-40f4-91d9-2a731eafe130 tempest-GroupsTest-1250607902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:45:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ebccd092-a641-40f4-91d9-2a731eafe130 tempest-GroupsTest-1250607902 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:45:40 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-ebccd092-a641-40f4-91d9-2a731eafe130 tempest-GroupsTest-1250607902 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:45:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ebccd092-a641-40f4-91d9-2a731eafe130 tempest-GroupsTest-1250607902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5c7dac31-1f37-4f07-a188-f352ed1d9b93 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:45:40 devstack sudo[88061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5c7dac31-1f37-4f07-a188-f352ed1d9b93 1073741824 Sep 28 11:45:40 devstack sudo[88061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:45:41 devstack sudo[88061]: pam_unix(sudo:session): session closed for user root Sep 28 11:45:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ebccd092-a641-40f4-91d9-2a731eafe130 tempest-GroupsTest-1250607902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5c7dac31-1f37-4f07-a188-f352ed1d9b93 1073741824" returned: 0 in 0.726s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:45:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ebccd092-a641-40f4-91d9-2a731eafe130 tempest-GroupsTest-1250607902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5c7dac31-1f37-4f07-a188-f352ed1d9b93 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:45:41 devstack sudo[88068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5c7dac31-1f37-4f07-a188-f352ed1d9b93 Sep 28 11:45:41 devstack sudo[88068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:45:41 devstack sudo[88068]: pam_unix(sudo:session): session closed for user root Sep 28 11:45:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ebccd092-a641-40f4-91d9-2a731eafe130 tempest-GroupsTest-1250607902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5c7dac31-1f37-4f07-a188-f352ed1d9b93" returned: 0 in 0.377s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:45:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ebccd092-a641-40f4-91d9-2a731eafe130 tempest-GroupsTest-1250607902 None] <== create_volume: return (1172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:45:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ebccd092-a641-40f4-91d9-2a731eafe130 tempest-GroupsTest-1250607902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:45:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ebccd092-a641-40f4-91d9-2a731eafe130 tempest-GroupsTest-1250607902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bea79c0-cdb7-4046-bf36-fb0f4cbeab3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c7dac31-1f37-4f07-a188-f352ed1d9b93', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:45:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ebccd092-a641-40f4-91d9-2a731eafe130 tempest-GroupsTest-1250607902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c72943f3-bffb-4e51-ac0f-0e29a3d9aec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:45:41 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-ebccd092-a641-40f4-91d9-2a731eafe130 tempest-GroupsTest-1250607902 None] Volume volume-5c7dac31-1f37-4f07-a188-f352ed1d9b93 (5c7dac31-1f37-4f07-a188-f352ed1d9b93): created successfully Sep 28 11:45:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ebccd092-a641-40f4-91d9-2a731eafe130 tempest-GroupsTest-1250607902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c72943f3-bffb-4e51-ac0f-0e29a3d9aec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:45:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ebccd092-a641-40f4-91d9-2a731eafe130 tempest-GroupsTest-1250607902 None] Flow 'volume_create_manager' (db5fa8a3-5420-4bd7-a677-5fd62fd7329d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:45:41 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-ebccd092-a641-40f4-91d9-2a731eafe130 tempest-GroupsTest-1250607902 None] Created volume successfully. Sep 28 11:45:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bbe69ece-c00e-45fc-b8e8-2668e64c2578 tempest-GroupsTest-1250607902 None] Acquiring lock "cinder-quobyte-5c7dac31-1f37-4f07-a188-f352ed1d9b93" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:45:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bbe69ece-c00e-45fc-b8e8-2668e64c2578 tempest-GroupsTest-1250607902 None] Lock "cinder-quobyte-5c7dac31-1f37-4f07-a188-f352ed1d9b93" acquired by "delete_volume" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:45:44 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd19257-1f82-444c-a0f1-d9376f5d470d]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:45:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bbe69ece-c00e-45fc-b8e8-2668e64c2578 tempest-GroupsTest-1250607902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5c7dac31-1f37-4f07-a188-f352ed1d9b93 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:45:44 devstack sudo[88088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5c7dac31-1f37-4f07-a188-f352ed1d9b93 Sep 28 11:45:44 devstack sudo[88088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:45:45 devstack sudo[88088]: pam_unix(sudo:session): session closed for user root Sep 28 11:45:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bbe69ece-c00e-45fc-b8e8-2668e64c2578 tempest-GroupsTest-1250607902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5c7dac31-1f37-4f07-a188-f352ed1d9b93" returned: 0 in 0.514s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:45:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bbe69ece-c00e-45fc-b8e8-2668e64c2578 tempest-GroupsTest-1250607902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5c7dac31-1f37-4f07-a188-f352ed1d9b93 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:45:45 devstack sudo[88093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5c7dac31-1f37-4f07-a188-f352ed1d9b93 Sep 28 11:45:45 devstack sudo[88093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:45:45 devstack sudo[88093]: pam_unix(sudo:session): session closed for user root Sep 28 11:45:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bbe69ece-c00e-45fc-b8e8-2668e64c2578 tempest-GroupsTest-1250607902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5c7dac31-1f37-4f07-a188-f352ed1d9b93" returned: 0 in 0.338s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:45:45 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bbe69ece-c00e-45fc-b8e8-2668e64c2578 tempest-GroupsTest-1250607902 None] Lock "cinder-quobyte-5c7dac31-1f37-4f07-a188-f352ed1d9b93" released by "delete_volume" :: held 0.919s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:45:45 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-bbe69ece-c00e-45fc-b8e8-2668e64c2578 tempest-GroupsTest-1250607902 None] Created reservations ['13b24ba7-dfcf-4f75-bfaf-863cf6607d39'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:45:45 devstack cinder-volume[86916]: WARNING cinder.quota [None req-bbe69ece-c00e-45fc-b8e8-2668e64c2578 tempest-GroupsTest-1250607902 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-481913130 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-481913130, it is now deprecated. Please use the default quota class for default quota. Sep 28 11:45:45 devstack cinder-volume[86916]: WARNING cinder.quota [None req-bbe69ece-c00e-45fc-b8e8-2668e64c2578 tempest-GroupsTest-1250607902 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-481913130 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-481913130, it is now deprecated. Please use the default quota class for default quota. Sep 28 11:45:45 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-bbe69ece-c00e-45fc-b8e8-2668e64c2578 tempest-GroupsTest-1250607902 None] Created reservations ['9af9bf02-fd87-4c81-8edc-399060689afd', 'c7b8553d-9432-46b6-b7e4-edcca6956494', 'dc832d2c-9644-4e95-86d6-e1532ae9a8e4', 'f5704751-0147-4449-b3f6-cd888698076e'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:45:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bbe69ece-c00e-45fc-b8e8-2668e64c2578 tempest-GroupsTest-1250607902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:45:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bbe69ece-c00e-45fc-b8e8-2668e64c2578 tempest-GroupsTest-1250607902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:45:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bbe69ece-c00e-45fc-b8e8-2668e64c2578 tempest-GroupsTest-1250607902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:45:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bbe69ece-c00e-45fc-b8e8-2668e64c2578 tempest-GroupsTest-1250607902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:45:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bbe69ece-c00e-45fc-b8e8-2668e64c2578 tempest-GroupsTest-1250607902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:45:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bbe69ece-c00e-45fc-b8e8-2668e64c2578 tempest-GroupsTest-1250607902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:45:45 devstack sudo[88098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:45:45 devstack sudo[88098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:45:45 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-f2c176f0-e86d-4e6c-8621-296aba96cf20 tempest-GroupsTest-1250607902 None] Created reservations ['225d8263-cbb9-4d05-a3d1-2454204a7a7a'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:45:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f2c176f0-e86d-4e6c-8621-296aba96cf20 tempest-GroupsTest-1250607902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:45:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f2c176f0-e86d-4e6c-8621-296aba96cf20 tempest-GroupsTest-1250607902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:45:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f2c176f0-e86d-4e6c-8621-296aba96cf20 tempest-GroupsTest-1250607902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:45:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f2c176f0-e86d-4e6c-8621-296aba96cf20 tempest-GroupsTest-1250607902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:45:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f2c176f0-e86d-4e6c-8621-296aba96cf20 tempest-GroupsTest-1250607902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:45:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f2c176f0-e86d-4e6c-8621-296aba96cf20 tempest-GroupsTest-1250607902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:45:46 devstack sudo[88101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:45:46 devstack sudo[88101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:45:46 devstack sudo[88098]: pam_unix(sudo:session): session closed for user root Sep 28 11:45:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bbe69ece-c00e-45fc-b8e8-2668e64c2578 tempest-GroupsTest-1250607902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.373s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:45:46 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-bbe69ece-c00e-45fc-b8e8-2668e64c2578 tempest-GroupsTest-1250607902 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:45:46 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-bbe69ece-c00e-45fc-b8e8-2668e64c2578 tempest-GroupsTest-1250607902 None] Delete group completed successfully. Sep 28 11:45:46 devstack sudo[88101]: pam_unix(sudo:session): session closed for user root Sep 28 11:45:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f2c176f0-e86d-4e6c-8621-296aba96cf20 tempest-GroupsTest-1250607902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.326s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:45:46 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-f2c176f0-e86d-4e6c-8621-296aba96cf20 tempest-GroupsTest-1250607902 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:45:46 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-f2c176f0-e86d-4e6c-8621-296aba96cf20 tempest-GroupsTest-1250607902 None] Delete group completed successfully. Sep 28 11:45:47 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-bacac467-60c7-465d-8ce1-956512eed414 tempest-GroupsTest-1250607902 None] Group tempest-GroupsTest-Group-1687222235: creating Sep 28 11:45:47 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-bacac467-60c7-465d-8ce1-956512eed414 tempest-GroupsTest-1250607902 None] Group tempest-GroupsTest-Group-1687222235: created successfully Sep 28 11:45:47 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-bacac467-60c7-465d-8ce1-956512eed414 tempest-GroupsTest-1250607902 None] Create group completed successfully. Sep 28 11:45:49 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-81a796ab-d949-486b-a95b-1d7d325aa9c0 tempest-GroupsTest-1250607902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:45:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-81a796ab-d949-486b-a95b-1d7d325aa9c0 tempest-GroupsTest-1250607902 None] Flow 'volume_create_manager' (cd642fa2-0705-46d4-9031-eb2feacae546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:45:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-81a796ab-d949-486b-a95b-1d7d325aa9c0 tempest-GroupsTest-1250607902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d298b672-351d-4777-a04a-e35c19b266dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:45:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-81a796ab-d949-486b-a95b-1d7d325aa9c0 tempest-GroupsTest-1250607902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d298b672-351d-4777-a04a-e35c19b266dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:45:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1234761962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=467971a3-8f2c-44e3-837a-3a4567fc79a7,host='devstack@QuobyteHD#QuobyteHD',id=967e19a3-ab6b-4206-a29a-d78633ea79b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb286e3d53b74d04adc3dea2d62cc81a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:45:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:45:50Z,use_quota=True,user_id='42bf1731e62a40b48ee6689a3f87df9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8864dba7-4b71-4ee7-b4fb-b7236c8c601c),volume_type_id=8864dba7-4b71-4ee7-b4fb-b7236c8c601c)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:45:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-81a796ab-d949-486b-a95b-1d7d325aa9c0 tempest-GroupsTest-1250607902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b9fa4d0-c127-4256-aed9-a03e92fccc87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:45:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-81a796ab-d949-486b-a95b-1d7d325aa9c0 tempest-GroupsTest-1250607902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b9fa4d0-c127-4256-aed9-a03e92fccc87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:45:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-81a796ab-d949-486b-a95b-1d7d325aa9c0 tempest-GroupsTest-1250607902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f51008b-e477-4760-8edf-de214fc9eced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:45:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-81a796ab-d949-486b-a95b-1d7d325aa9c0 tempest-GroupsTest-1250607902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f51008b-e477-4760-8edf-de214fc9eced) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '967e19a3-ab6b-4206-a29a-d78633ea79b8', 'volume_name': 'volume-967e19a3-ab6b-4206-a29a-d78633ea79b8', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:45:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-81a796ab-d949-486b-a95b-1d7d325aa9c0 tempest-GroupsTest-1250607902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9f3475a-79b2-4344-a7be-ebf7e9002df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:45:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-81a796ab-d949-486b-a95b-1d7d325aa9c0 tempest-GroupsTest-1250607902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9f3475a-79b2-4344-a7be-ebf7e9002df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:45:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-81a796ab-d949-486b-a95b-1d7d325aa9c0 tempest-GroupsTest-1250607902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (490afbc8-c6f1-4862-8ae8-59b12f5d938d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:45:49 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-81a796ab-d949-486b-a95b-1d7d325aa9c0 tempest-GroupsTest-1250607902 None] Volume 967e19a3-ab6b-4206-a29a-d78633ea79b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-967e19a3-ab6b-4206-a29a-d78633ea79b8', 'volume_size': 1} Sep 28 11:45:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-81a796ab-d949-486b-a95b-1d7d325aa9c0 tempest-GroupsTest-1250607902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:45:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-81a796ab-d949-486b-a95b-1d7d325aa9c0 tempest-GroupsTest-1250607902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:45:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-81a796ab-d949-486b-a95b-1d7d325aa9c0 tempest-GroupsTest-1250607902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=467971a3-8f2c-44e3-837a-3a4567fc79a7,created_at=2026-09-28T09:45:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1234761962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=467971a3-8f2c-44e3-837a-3a4567fc79a7,host='devstack@QuobyteHD#QuobyteHD',id=967e19a3-ab6b-4206-a29a-d78633ea79b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb286e3d53b74d04adc3dea2d62cc81a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:45:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:45:50Z,use_quota=True,user_id='42bf1731e62a40b48ee6689a3f87df9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8864dba7-4b71-4ee7-b4fb-b7236c8c601c),volume_type_id=8864dba7-4b71-4ee7-b4fb-b7236c8c601c)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:45:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-81a796ab-d949-486b-a95b-1d7d325aa9c0 tempest-GroupsTest-1250607902 None] Creating volume 967e19a3-ab6b-4206-a29a-d78633ea79b8 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:45:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-81a796ab-d949-486b-a95b-1d7d325aa9c0 tempest-GroupsTest-1250607902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:45:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-81a796ab-d949-486b-a95b-1d7d325aa9c0 tempest-GroupsTest-1250607902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:45:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-81a796ab-d949-486b-a95b-1d7d325aa9c0 tempest-GroupsTest-1250607902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:45:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-81a796ab-d949-486b-a95b-1d7d325aa9c0 tempest-GroupsTest-1250607902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:45:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-81a796ab-d949-486b-a95b-1d7d325aa9c0 tempest-GroupsTest-1250607902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:45:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-81a796ab-d949-486b-a95b-1d7d325aa9c0 tempest-GroupsTest-1250607902 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:45:49 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-81a796ab-d949-486b-a95b-1d7d325aa9c0 tempest-GroupsTest-1250607902 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:45:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-81a796ab-d949-486b-a95b-1d7d325aa9c0 tempest-GroupsTest-1250607902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-967e19a3-ab6b-4206-a29a-d78633ea79b8 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:45:49 devstack sudo[88106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-967e19a3-ab6b-4206-a29a-d78633ea79b8 1073741824 Sep 28 11:45:49 devstack sudo[88106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:45:50 devstack sudo[88106]: pam_unix(sudo:session): session closed for user root Sep 28 11:45:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-81a796ab-d949-486b-a95b-1d7d325aa9c0 tempest-GroupsTest-1250607902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-967e19a3-ab6b-4206-a29a-d78633ea79b8 1073741824" returned: 0 in 0.513s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:45:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-81a796ab-d949-486b-a95b-1d7d325aa9c0 tempest-GroupsTest-1250607902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-967e19a3-ab6b-4206-a29a-d78633ea79b8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:45:50 devstack sudo[88113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-967e19a3-ab6b-4206-a29a-d78633ea79b8 Sep 28 11:45:50 devstack sudo[88113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:45:50 devstack sudo[88113]: pam_unix(sudo:session): session closed for user root Sep 28 11:45:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-81a796ab-d949-486b-a95b-1d7d325aa9c0 tempest-GroupsTest-1250607902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-967e19a3-ab6b-4206-a29a-d78633ea79b8" returned: 0 in 0.298s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:45:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-81a796ab-d949-486b-a95b-1d7d325aa9c0 tempest-GroupsTest-1250607902 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:45:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-81a796ab-d949-486b-a95b-1d7d325aa9c0 tempest-GroupsTest-1250607902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:45:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-81a796ab-d949-486b-a95b-1d7d325aa9c0 tempest-GroupsTest-1250607902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (490afbc8-c6f1-4862-8ae8-59b12f5d938d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-967e19a3-ab6b-4206-a29a-d78633ea79b8', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:45:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-81a796ab-d949-486b-a95b-1d7d325aa9c0 tempest-GroupsTest-1250607902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bf15ea2-dd33-40cb-855f-4fbeb5b59b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:45:50 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-81a796ab-d949-486b-a95b-1d7d325aa9c0 tempest-GroupsTest-1250607902 None] Volume volume-967e19a3-ab6b-4206-a29a-d78633ea79b8 (967e19a3-ab6b-4206-a29a-d78633ea79b8): created successfully Sep 28 11:45:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-81a796ab-d949-486b-a95b-1d7d325aa9c0 tempest-GroupsTest-1250607902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bf15ea2-dd33-40cb-855f-4fbeb5b59b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:45:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-81a796ab-d949-486b-a95b-1d7d325aa9c0 tempest-GroupsTest-1250607902 None] Flow 'volume_create_manager' (cd642fa2-0705-46d4-9031-eb2feacae546) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:45:50 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-81a796ab-d949-486b-a95b-1d7d325aa9c0 tempest-GroupsTest-1250607902 None] Created volume successfully. Sep 28 11:45:51 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-16add407-2df9-4b4f-b0bd-c3725827b4d0 tempest-GroupsTest-1250607902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:45:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-16add407-2df9-4b4f-b0bd-c3725827b4d0 tempest-GroupsTest-1250607902 None] Flow 'volume_create_manager' (89b866f6-e5dc-4cd4-89ff-4216e670220b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:45:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-16add407-2df9-4b4f-b0bd-c3725827b4d0 tempest-GroupsTest-1250607902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffa57861-6368-4a54-96df-c17a7e9cf8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:45:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-16add407-2df9-4b4f-b0bd-c3725827b4d0 tempest-GroupsTest-1250607902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffa57861-6368-4a54-96df-c17a7e9cf8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:45:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1539528833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=467971a3-8f2c-44e3-837a-3a4567fc79a7,host='devstack@QuobyteHD#QuobyteHD',id=eeb9f9e3-d6c5-423d-aaca-ccfe8928615e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb286e3d53b74d04adc3dea2d62cc81a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:45:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:45:51Z,use_quota=True,user_id='42bf1731e62a40b48ee6689a3f87df9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8864dba7-4b71-4ee7-b4fb-b7236c8c601c),volume_type_id=8864dba7-4b71-4ee7-b4fb-b7236c8c601c)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:45:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-16add407-2df9-4b4f-b0bd-c3725827b4d0 tempest-GroupsTest-1250607902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20a7ef4c-4b88-41bd-9ba1-0ca24f0eec15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:45:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-16add407-2df9-4b4f-b0bd-c3725827b4d0 tempest-GroupsTest-1250607902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20a7ef4c-4b88-41bd-9ba1-0ca24f0eec15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:45:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-16add407-2df9-4b4f-b0bd-c3725827b4d0 tempest-GroupsTest-1250607902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dde06760-adcc-4232-86d6-347b510c2075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:45:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-16add407-2df9-4b4f-b0bd-c3725827b4d0 tempest-GroupsTest-1250607902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dde06760-adcc-4232-86d6-347b510c2075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eeb9f9e3-d6c5-423d-aaca-ccfe8928615e', 'volume_name': 'volume-eeb9f9e3-d6c5-423d-aaca-ccfe8928615e', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:45:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-16add407-2df9-4b4f-b0bd-c3725827b4d0 tempest-GroupsTest-1250607902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f35eef3f-3c1a-4561-a015-14030bab0dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:45:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-16add407-2df9-4b4f-b0bd-c3725827b4d0 tempest-GroupsTest-1250607902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f35eef3f-3c1a-4561-a015-14030bab0dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:45:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-16add407-2df9-4b4f-b0bd-c3725827b4d0 tempest-GroupsTest-1250607902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab6dc8dc-78b8-4ace-a3c0-7471516598c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:45:51 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-16add407-2df9-4b4f-b0bd-c3725827b4d0 tempest-GroupsTest-1250607902 None] Volume eeb9f9e3-d6c5-423d-aaca-ccfe8928615e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eeb9f9e3-d6c5-423d-aaca-ccfe8928615e', 'volume_size': 1} Sep 28 11:45:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-16add407-2df9-4b4f-b0bd-c3725827b4d0 tempest-GroupsTest-1250607902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:45:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-16add407-2df9-4b4f-b0bd-c3725827b4d0 tempest-GroupsTest-1250607902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:45:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-16add407-2df9-4b4f-b0bd-c3725827b4d0 tempest-GroupsTest-1250607902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=467971a3-8f2c-44e3-837a-3a4567fc79a7,created_at=2026-09-28T09:45:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1539528833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=467971a3-8f2c-44e3-837a-3a4567fc79a7,host='devstack@QuobyteHD#QuobyteHD',id=eeb9f9e3-d6c5-423d-aaca-ccfe8928615e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb286e3d53b74d04adc3dea2d62cc81a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:45:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:45:51Z,use_quota=True,user_id='42bf1731e62a40b48ee6689a3f87df9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8864dba7-4b71-4ee7-b4fb-b7236c8c601c),volume_type_id=8864dba7-4b71-4ee7-b4fb-b7236c8c601c)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:45:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-16add407-2df9-4b4f-b0bd-c3725827b4d0 tempest-GroupsTest-1250607902 None] Creating volume eeb9f9e3-d6c5-423d-aaca-ccfe8928615e {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:45:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-16add407-2df9-4b4f-b0bd-c3725827b4d0 tempest-GroupsTest-1250607902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:45:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-16add407-2df9-4b4f-b0bd-c3725827b4d0 tempest-GroupsTest-1250607902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:45:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-16add407-2df9-4b4f-b0bd-c3725827b4d0 tempest-GroupsTest-1250607902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:45:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-16add407-2df9-4b4f-b0bd-c3725827b4d0 tempest-GroupsTest-1250607902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:45:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-16add407-2df9-4b4f-b0bd-c3725827b4d0 tempest-GroupsTest-1250607902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:45:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-16add407-2df9-4b4f-b0bd-c3725827b4d0 tempest-GroupsTest-1250607902 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:45:51 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-16add407-2df9-4b4f-b0bd-c3725827b4d0 tempest-GroupsTest-1250607902 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:45:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-16add407-2df9-4b4f-b0bd-c3725827b4d0 tempest-GroupsTest-1250607902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-eeb9f9e3-d6c5-423d-aaca-ccfe8928615e 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:45:51 devstack sudo[88116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-eeb9f9e3-d6c5-423d-aaca-ccfe8928615e 1073741824 Sep 28 11:45:51 devstack sudo[88116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:45:52 devstack sudo[88116]: pam_unix(sudo:session): session closed for user root Sep 28 11:45:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-16add407-2df9-4b4f-b0bd-c3725827b4d0 tempest-GroupsTest-1250607902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-eeb9f9e3-d6c5-423d-aaca-ccfe8928615e 1073741824" returned: 0 in 0.513s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:45:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-16add407-2df9-4b4f-b0bd-c3725827b4d0 tempest-GroupsTest-1250607902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-eeb9f9e3-d6c5-423d-aaca-ccfe8928615e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:45:52 devstack sudo[88122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-eeb9f9e3-d6c5-423d-aaca-ccfe8928615e Sep 28 11:45:52 devstack sudo[88122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:45:52 devstack sudo[88122]: pam_unix(sudo:session): session closed for user root Sep 28 11:45:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-16add407-2df9-4b4f-b0bd-c3725827b4d0 tempest-GroupsTest-1250607902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-eeb9f9e3-d6c5-423d-aaca-ccfe8928615e" returned: 0 in 0.288s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:45:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-16add407-2df9-4b4f-b0bd-c3725827b4d0 tempest-GroupsTest-1250607902 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:45:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-16add407-2df9-4b4f-b0bd-c3725827b4d0 tempest-GroupsTest-1250607902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:45:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-16add407-2df9-4b4f-b0bd-c3725827b4d0 tempest-GroupsTest-1250607902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab6dc8dc-78b8-4ace-a3c0-7471516598c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eeb9f9e3-d6c5-423d-aaca-ccfe8928615e', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:45:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-16add407-2df9-4b4f-b0bd-c3725827b4d0 tempest-GroupsTest-1250607902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c8c8a1a-9f02-47a1-ba8e-15970a4bcef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:45:52 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-16add407-2df9-4b4f-b0bd-c3725827b4d0 tempest-GroupsTest-1250607902 None] Volume volume-eeb9f9e3-d6c5-423d-aaca-ccfe8928615e (eeb9f9e3-d6c5-423d-aaca-ccfe8928615e): created successfully Sep 28 11:45:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-16add407-2df9-4b4f-b0bd-c3725827b4d0 tempest-GroupsTest-1250607902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c8c8a1a-9f02-47a1-ba8e-15970a4bcef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:45:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-16add407-2df9-4b4f-b0bd-c3725827b4d0 tempest-GroupsTest-1250607902 None] Flow 'volume_create_manager' (89b866f6-e5dc-4cd4-89ff-4216e670220b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:45:52 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-16add407-2df9-4b4f-b0bd-c3725827b4d0 tempest-GroupsTest-1250607902 None] Created volume successfully. Sep 28 11:45:53 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-2ccc03e3-70de-4ffc-a427-6a39c0a72f8a tempest-GroupsTest-1250607902 None] Update group completed successfully. Sep 28 11:45:54 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-45c5c849-44cd-4be9-a744-5236cbe85d7f tempest-GroupsTest-1250607902 None] Update group completed successfully. Sep 28 11:45:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2821c02b-de24-451a-8b11-7f153ff525f3 tempest-GroupsTest-1250607902 None] Acquiring lock "cinder-quobyte-967e19a3-ab6b-4206-a29a-d78633ea79b8" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:45:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2821c02b-de24-451a-8b11-7f153ff525f3 tempest-GroupsTest-1250607902 None] Lock "cinder-quobyte-967e19a3-ab6b-4206-a29a-d78633ea79b8" acquired by "delete_volume" :: waited 0.023s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:45:56 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7909e5-fd19-46ca-9226-01fc1c78686d]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:45:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2821c02b-de24-451a-8b11-7f153ff525f3 tempest-GroupsTest-1250607902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-967e19a3-ab6b-4206-a29a-d78633ea79b8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:45:56 devstack sudo[88133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-967e19a3-ab6b-4206-a29a-d78633ea79b8 Sep 28 11:45:56 devstack sudo[88133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:45:56 devstack sudo[88133]: pam_unix(sudo:session): session closed for user root Sep 28 11:45:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2821c02b-de24-451a-8b11-7f153ff525f3 tempest-GroupsTest-1250607902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-967e19a3-ab6b-4206-a29a-d78633ea79b8" returned: 0 in 0.471s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:45:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2821c02b-de24-451a-8b11-7f153ff525f3 tempest-GroupsTest-1250607902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-967e19a3-ab6b-4206-a29a-d78633ea79b8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:45:56 devstack sudo[88145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-967e19a3-ab6b-4206-a29a-d78633ea79b8 Sep 28 11:45:56 devstack sudo[88145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:45:57 devstack sudo[88145]: pam_unix(sudo:session): session closed for user root Sep 28 11:45:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2821c02b-de24-451a-8b11-7f153ff525f3 tempest-GroupsTest-1250607902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-967e19a3-ab6b-4206-a29a-d78633ea79b8" returned: 0 in 0.368s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:45:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2821c02b-de24-451a-8b11-7f153ff525f3 tempest-GroupsTest-1250607902 None] Lock "cinder-quobyte-967e19a3-ab6b-4206-a29a-d78633ea79b8" released by "delete_volume" :: held 0.897s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:45:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2821c02b-de24-451a-8b11-7f153ff525f3 tempest-GroupsTest-1250607902 None] Acquiring lock "cinder-quobyte-eeb9f9e3-d6c5-423d-aaca-ccfe8928615e" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:45:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2821c02b-de24-451a-8b11-7f153ff525f3 tempest-GroupsTest-1250607902 None] Lock "cinder-quobyte-eeb9f9e3-d6c5-423d-aaca-ccfe8928615e" acquired by "delete_volume" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:45:57 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42f89ba-914f-4d67-92a9-5974854717a3]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:45:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2821c02b-de24-451a-8b11-7f153ff525f3 tempest-GroupsTest-1250607902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-eeb9f9e3-d6c5-423d-aaca-ccfe8928615e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:45:57 devstack sudo[88148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-eeb9f9e3-d6c5-423d-aaca-ccfe8928615e Sep 28 11:45:57 devstack sudo[88148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:45:57 devstack sudo[88148]: pam_unix(sudo:session): session closed for user root Sep 28 11:45:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2821c02b-de24-451a-8b11-7f153ff525f3 tempest-GroupsTest-1250607902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-eeb9f9e3-d6c5-423d-aaca-ccfe8928615e" returned: 0 in 0.458s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:45:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2821c02b-de24-451a-8b11-7f153ff525f3 tempest-GroupsTest-1250607902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-eeb9f9e3-d6c5-423d-aaca-ccfe8928615e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:45:57 devstack sudo[88156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-eeb9f9e3-d6c5-423d-aaca-ccfe8928615e Sep 28 11:45:57 devstack sudo[88156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:45:58 devstack sudo[88156]: pam_unix(sudo:session): session closed for user root Sep 28 11:45:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2821c02b-de24-451a-8b11-7f153ff525f3 tempest-GroupsTest-1250607902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-eeb9f9e3-d6c5-423d-aaca-ccfe8928615e" returned: 0 in 0.314s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:45:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2821c02b-de24-451a-8b11-7f153ff525f3 tempest-GroupsTest-1250607902 None] Lock "cinder-quobyte-eeb9f9e3-d6c5-423d-aaca-ccfe8928615e" released by "delete_volume" :: held 0.824s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:45:58 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-2821c02b-de24-451a-8b11-7f153ff525f3 tempest-GroupsTest-1250607902 None] Created reservations ['2646e7aa-9238-4fe8-a746-3b55f0198dd1'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:45:58 devstack cinder-volume[86916]: WARNING cinder.quota [None req-2821c02b-de24-451a-8b11-7f153ff525f3 tempest-GroupsTest-1250607902 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1646240548 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1646240548, it is now deprecated. Please use the default quota class for default quota. Sep 28 11:45:58 devstack cinder-volume[86916]: WARNING cinder.quota [None req-2821c02b-de24-451a-8b11-7f153ff525f3 tempest-GroupsTest-1250607902 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1646240548 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1646240548, it is now deprecated. Please use the default quota class for default quota. Sep 28 11:45:58 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-2821c02b-de24-451a-8b11-7f153ff525f3 tempest-GroupsTest-1250607902 None] Created reservations ['ccdd890e-c0cf-4476-a5f6-e2d9daae763f', '93595693-e977-4708-b934-2a28bd77914e', '18d2744a-56e8-4e61-b7aa-25e53941e31f', '2a04e19c-cd1d-4c5a-8914-e220b1ec4090'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:45:58 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-2821c02b-de24-451a-8b11-7f153ff525f3 tempest-GroupsTest-1250607902 None] Created reservations ['b978e545-7142-4ed4-a846-4c85ac3453a2', 'acc3b435-cae4-4aca-ac56-2b584317b863', '6f4d6173-f7ac-4d85-a2f1-bb4bd3112879', '57d6308b-f0bf-4863-b45a-9307557f899c'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:45:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2821c02b-de24-451a-8b11-7f153ff525f3 tempest-GroupsTest-1250607902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:45:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2821c02b-de24-451a-8b11-7f153ff525f3 tempest-GroupsTest-1250607902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:45:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2821c02b-de24-451a-8b11-7f153ff525f3 tempest-GroupsTest-1250607902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:45:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2821c02b-de24-451a-8b11-7f153ff525f3 tempest-GroupsTest-1250607902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:45:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2821c02b-de24-451a-8b11-7f153ff525f3 tempest-GroupsTest-1250607902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:45:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2821c02b-de24-451a-8b11-7f153ff525f3 tempest-GroupsTest-1250607902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:45:58 devstack sudo[88160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:45:58 devstack sudo[88160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:45:59 devstack sudo[88160]: pam_unix(sudo:session): session closed for user root Sep 28 11:45:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2821c02b-de24-451a-8b11-7f153ff525f3 tempest-GroupsTest-1250607902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.437s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:45:59 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-2821c02b-de24-451a-8b11-7f153ff525f3 tempest-GroupsTest-1250607902 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:45:59 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-2821c02b-de24-451a-8b11-7f153ff525f3 tempest-GroupsTest-1250607902 None] Delete group completed successfully. Sep 28 11:46:08 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=50,cinder:INSERT=12,cinder:UPDATE=60,cinder:DELETE=2 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 11:46:10 devstack cinder-volume[86916]: WARNING py.warnings [req-c76fde52-3146-449c-8715-d65c877419b3 req-76e9ea84-700b-42ee-8b69-ced555269f70 tempest-TaggedAttachmentsTest-1813125026 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Sep 28 11:46:10 devstack cinder-volume[86916]: .first() Sep 28 11:46:10 devstack cinder-volume[86916]: Sep 28 11:46:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-c76fde52-3146-449c-8715-d65c877419b3 req-76e9ea84-700b-42ee-8b69-ced555269f70 tempest-TaggedAttachmentsTest-1813125026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:46:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-c76fde52-3146-449c-8715-d65c877419b3 req-76e9ea84-700b-42ee-8b69-ced555269f70 tempest-TaggedAttachmentsTest-1813125026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:46:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-c76fde52-3146-449c-8715-d65c877419b3 req-76e9ea84-700b-42ee-8b69-ced555269f70 tempest-TaggedAttachmentsTest-1813125026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:46:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-c76fde52-3146-449c-8715-d65c877419b3 req-76e9ea84-700b-42ee-8b69-ced555269f70 tempest-TaggedAttachmentsTest-1813125026 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0', 'name': 'volume-6370651a-8721-4d5b-a87b-69cbcf1b1933', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4d278e32-db6f-4d71-8b86-e7f4572fea34', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 11:46:10 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-c76fde52-3146-449c-8715-d65c877419b3 req-76e9ea84-700b-42ee-8b69-ced555269f70 tempest-TaggedAttachmentsTest-1813125026 None] attachment_update completed successfully. Sep 28 11:46:17 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-8a9b2ab8-a98c-4b3d-9e10-27552bc7a981 req-79736c41-8eab-4d0b-b0c4-c9ce5edead33 tempest-TaggedAttachmentsTest-1813125026 None] Terminate volume connection completed successfully. Sep 28 11:46:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-8a9b2ab8-a98c-4b3d-9e10-27552bc7a981 req-79736c41-8eab-4d0b-b0c4-c9ce5edead33 tempest-TaggedAttachmentsTest-1813125026 None] Deleting attachment 4d278e32-db6f-4d71-8b86-e7f4572fea34. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 11:46:27 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 11:46:27 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=55,cinder:UPDATE=56,cinder:DELETE=3,cinder:INSERT=11 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 11:46:30 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a442613-f094-4c45-92cd-4438949003d6 tempest-ServersNegativeTestJSON-1552264741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:46:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8a442613-f094-4c45-92cd-4438949003d6 tempest-ServersNegativeTestJSON-1552264741 None] Flow 'volume_create_manager' (b15cda1e-d90d-44be-b6c9-67b76499ead2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:46:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8a442613-f094-4c45-92cd-4438949003d6 tempest-ServersNegativeTestJSON-1552264741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78c2e2df-a364-4102-8154-50b6c09ea7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:46:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8a442613-f094-4c45-92cd-4438949003d6 tempest-ServersNegativeTestJSON-1552264741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78c2e2df-a364-4102-8154-50b6c09ea7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:46:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2011640229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16531558-948e-4358-8fed-fc91a652a97e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c197c262a21d46be891d29df459b8038',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:46:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:46:30Z,use_quota=True,user_id='26e50e64fe994613b3fc2b2cb98958bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:46:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8a442613-f094-4c45-92cd-4438949003d6 tempest-ServersNegativeTestJSON-1552264741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01af3206-b91b-446e-9965-bc885bea61f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:46:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8a442613-f094-4c45-92cd-4438949003d6 tempest-ServersNegativeTestJSON-1552264741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01af3206-b91b-446e-9965-bc885bea61f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:46:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8a442613-f094-4c45-92cd-4438949003d6 tempest-ServersNegativeTestJSON-1552264741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7a6892e-f0a4-49e4-9deb-618bedf1c233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:46:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8a442613-f094-4c45-92cd-4438949003d6 tempest-ServersNegativeTestJSON-1552264741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7a6892e-f0a4-49e4-9deb-618bedf1c233) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16531558-948e-4358-8fed-fc91a652a97e', 'volume_name': 'volume-16531558-948e-4358-8fed-fc91a652a97e', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:46:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8a442613-f094-4c45-92cd-4438949003d6 tempest-ServersNegativeTestJSON-1552264741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1e890e3-6500-43c1-b752-18277a4020df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:46:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8a442613-f094-4c45-92cd-4438949003d6 tempest-ServersNegativeTestJSON-1552264741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1e890e3-6500-43c1-b752-18277a4020df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:46:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8a442613-f094-4c45-92cd-4438949003d6 tempest-ServersNegativeTestJSON-1552264741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8af9ca52-8900-4477-b33b-56ec6710d1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:46:30 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-8a442613-f094-4c45-92cd-4438949003d6 tempest-ServersNegativeTestJSON-1552264741 None] Volume 16531558-948e-4358-8fed-fc91a652a97e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16531558-948e-4358-8fed-fc91a652a97e', 'volume_size': 1} Sep 28 11:46:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8a442613-f094-4c45-92cd-4438949003d6 tempest-ServersNegativeTestJSON-1552264741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:46:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8a442613-f094-4c45-92cd-4438949003d6 tempest-ServersNegativeTestJSON-1552264741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:46:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8a442613-f094-4c45-92cd-4438949003d6 tempest-ServersNegativeTestJSON-1552264741 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:46:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2011640229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16531558-948e-4358-8fed-fc91a652a97e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c197c262a21d46be891d29df459b8038',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:46:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:46:30Z,use_quota=True,user_id='26e50e64fe994613b3fc2b2cb98958bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:46:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-8a442613-f094-4c45-92cd-4438949003d6 tempest-ServersNegativeTestJSON-1552264741 None] Creating volume 16531558-948e-4358-8fed-fc91a652a97e {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:46:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8a442613-f094-4c45-92cd-4438949003d6 tempest-ServersNegativeTestJSON-1552264741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:46:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8a442613-f094-4c45-92cd-4438949003d6 tempest-ServersNegativeTestJSON-1552264741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:46:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8a442613-f094-4c45-92cd-4438949003d6 tempest-ServersNegativeTestJSON-1552264741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:46:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8a442613-f094-4c45-92cd-4438949003d6 tempest-ServersNegativeTestJSON-1552264741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:46:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8a442613-f094-4c45-92cd-4438949003d6 tempest-ServersNegativeTestJSON-1552264741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:46:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8a442613-f094-4c45-92cd-4438949003d6 tempest-ServersNegativeTestJSON-1552264741 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:46:30 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-8a442613-f094-4c45-92cd-4438949003d6 tempest-ServersNegativeTestJSON-1552264741 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:46:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8a442613-f094-4c45-92cd-4438949003d6 tempest-ServersNegativeTestJSON-1552264741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-16531558-948e-4358-8fed-fc91a652a97e 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:46:30 devstack sudo[89048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-16531558-948e-4358-8fed-fc91a652a97e 1073741824 Sep 28 11:46:30 devstack sudo[89048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:46:31 devstack sudo[89048]: pam_unix(sudo:session): session closed for user root Sep 28 11:46:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8a442613-f094-4c45-92cd-4438949003d6 tempest-ServersNegativeTestJSON-1552264741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-16531558-948e-4358-8fed-fc91a652a97e 1073741824" returned: 0 in 0.765s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:46:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8a442613-f094-4c45-92cd-4438949003d6 tempest-ServersNegativeTestJSON-1552264741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-16531558-948e-4358-8fed-fc91a652a97e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:46:31 devstack sudo[89057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-16531558-948e-4358-8fed-fc91a652a97e Sep 28 11:46:31 devstack sudo[89057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:46:31 devstack sudo[89057]: pam_unix(sudo:session): session closed for user root Sep 28 11:46:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8a442613-f094-4c45-92cd-4438949003d6 tempest-ServersNegativeTestJSON-1552264741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-16531558-948e-4358-8fed-fc91a652a97e" returned: 0 in 0.515s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:46:31 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8a442613-f094-4c45-92cd-4438949003d6 tempest-ServersNegativeTestJSON-1552264741 None] <== create_volume: return (1374ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:46:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8a442613-f094-4c45-92cd-4438949003d6 tempest-ServersNegativeTestJSON-1552264741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.380s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:46:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8a442613-f094-4c45-92cd-4438949003d6 tempest-ServersNegativeTestJSON-1552264741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8af9ca52-8900-4477-b33b-56ec6710d1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16531558-948e-4358-8fed-fc91a652a97e', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:46:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8a442613-f094-4c45-92cd-4438949003d6 tempest-ServersNegativeTestJSON-1552264741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (752ebf8f-abe4-4ed4-8d1b-a852d441d41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:46:31 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-8a442613-f094-4c45-92cd-4438949003d6 tempest-ServersNegativeTestJSON-1552264741 None] Volume volume-16531558-948e-4358-8fed-fc91a652a97e (16531558-948e-4358-8fed-fc91a652a97e): created successfully Sep 28 11:46:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8a442613-f094-4c45-92cd-4438949003d6 tempest-ServersNegativeTestJSON-1552264741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (752ebf8f-abe4-4ed4-8d1b-a852d441d41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:46:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8a442613-f094-4c45-92cd-4438949003d6 tempest-ServersNegativeTestJSON-1552264741 None] Flow 'volume_create_manager' (b15cda1e-d90d-44be-b6c9-67b76499ead2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:46:31 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-8a442613-f094-4c45-92cd-4438949003d6 tempest-ServersNegativeTestJSON-1552264741 None] Created volume successfully. Sep 28 11:46:34 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4a21f64-742e-4cd7-b7b2-dd073f6ef841 tempest-ServersNegativeTestJSON-1552264741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:46:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d4a21f64-742e-4cd7-b7b2-dd073f6ef841 tempest-ServersNegativeTestJSON-1552264741 None] Flow 'volume_create_manager' (e03b90a2-334b-4e50-a843-3f8c07266864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:46:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d4a21f64-742e-4cd7-b7b2-dd073f6ef841 tempest-ServersNegativeTestJSON-1552264741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87908892-2c58-4a20-b87c-85753b98a4c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:46:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d4a21f64-742e-4cd7-b7b2-dd073f6ef841 tempest-ServersNegativeTestJSON-1552264741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87908892-2c58-4a20-b87c-85753b98a4c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:46:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2015197158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=320cb365-95ac-44fb-9e88-a5379bec1dcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c197c262a21d46be891d29df459b8038',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:46:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:46:35Z,use_quota=True,user_id='26e50e64fe994613b3fc2b2cb98958bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:46:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d4a21f64-742e-4cd7-b7b2-dd073f6ef841 tempest-ServersNegativeTestJSON-1552264741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1dfb4fe-7019-4bf2-bb7d-8df3dd3fd020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:46:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d4a21f64-742e-4cd7-b7b2-dd073f6ef841 tempest-ServersNegativeTestJSON-1552264741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1dfb4fe-7019-4bf2-bb7d-8df3dd3fd020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:46:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d4a21f64-742e-4cd7-b7b2-dd073f6ef841 tempest-ServersNegativeTestJSON-1552264741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (928424b1-460f-4da9-9f62-0b7063680965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:46:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d4a21f64-742e-4cd7-b7b2-dd073f6ef841 tempest-ServersNegativeTestJSON-1552264741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (928424b1-460f-4da9-9f62-0b7063680965) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '320cb365-95ac-44fb-9e88-a5379bec1dcc', 'volume_name': 'volume-320cb365-95ac-44fb-9e88-a5379bec1dcc', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:46:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d4a21f64-742e-4cd7-b7b2-dd073f6ef841 tempest-ServersNegativeTestJSON-1552264741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (813a10bd-578b-4941-83aa-aa3f620b0685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:46:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d4a21f64-742e-4cd7-b7b2-dd073f6ef841 tempest-ServersNegativeTestJSON-1552264741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (813a10bd-578b-4941-83aa-aa3f620b0685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:46:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d4a21f64-742e-4cd7-b7b2-dd073f6ef841 tempest-ServersNegativeTestJSON-1552264741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de695867-d52d-4209-afed-a0ab9d7cfc3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:46:35 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-d4a21f64-742e-4cd7-b7b2-dd073f6ef841 tempest-ServersNegativeTestJSON-1552264741 None] Volume 320cb365-95ac-44fb-9e88-a5379bec1dcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-320cb365-95ac-44fb-9e88-a5379bec1dcc', 'volume_size': 1} Sep 28 11:46:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d4a21f64-742e-4cd7-b7b2-dd073f6ef841 tempest-ServersNegativeTestJSON-1552264741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:46:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d4a21f64-742e-4cd7-b7b2-dd073f6ef841 tempest-ServersNegativeTestJSON-1552264741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:46:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d4a21f64-742e-4cd7-b7b2-dd073f6ef841 tempest-ServersNegativeTestJSON-1552264741 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:46:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2015197158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=320cb365-95ac-44fb-9e88-a5379bec1dcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c197c262a21d46be891d29df459b8038',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:46:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:46:35Z,use_quota=True,user_id='26e50e64fe994613b3fc2b2cb98958bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:46:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-d4a21f64-742e-4cd7-b7b2-dd073f6ef841 tempest-ServersNegativeTestJSON-1552264741 None] Creating volume 320cb365-95ac-44fb-9e88-a5379bec1dcc {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:46:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d4a21f64-742e-4cd7-b7b2-dd073f6ef841 tempest-ServersNegativeTestJSON-1552264741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:46:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d4a21f64-742e-4cd7-b7b2-dd073f6ef841 tempest-ServersNegativeTestJSON-1552264741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:46:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d4a21f64-742e-4cd7-b7b2-dd073f6ef841 tempest-ServersNegativeTestJSON-1552264741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:46:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d4a21f64-742e-4cd7-b7b2-dd073f6ef841 tempest-ServersNegativeTestJSON-1552264741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:46:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d4a21f64-742e-4cd7-b7b2-dd073f6ef841 tempest-ServersNegativeTestJSON-1552264741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:46:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d4a21f64-742e-4cd7-b7b2-dd073f6ef841 tempest-ServersNegativeTestJSON-1552264741 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:46:35 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-d4a21f64-742e-4cd7-b7b2-dd073f6ef841 tempest-ServersNegativeTestJSON-1552264741 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:46:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d4a21f64-742e-4cd7-b7b2-dd073f6ef841 tempest-ServersNegativeTestJSON-1552264741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-320cb365-95ac-44fb-9e88-a5379bec1dcc 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:46:35 devstack sudo[89093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-320cb365-95ac-44fb-9e88-a5379bec1dcc 1073741824 Sep 28 11:46:35 devstack sudo[89093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:46:35 devstack sudo[89093]: pam_unix(sudo:session): session closed for user root Sep 28 11:46:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d4a21f64-742e-4cd7-b7b2-dd073f6ef841 tempest-ServersNegativeTestJSON-1552264741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-320cb365-95ac-44fb-9e88-a5379bec1dcc 1073741824" returned: 0 in 0.871s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:46:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d4a21f64-742e-4cd7-b7b2-dd073f6ef841 tempest-ServersNegativeTestJSON-1552264741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-320cb365-95ac-44fb-9e88-a5379bec1dcc {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:46:36 devstack sudo[89143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-320cb365-95ac-44fb-9e88-a5379bec1dcc Sep 28 11:46:36 devstack sudo[89143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:46:36 devstack sudo[89143]: pam_unix(sudo:session): session closed for user root Sep 28 11:46:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d4a21f64-742e-4cd7-b7b2-dd073f6ef841 tempest-ServersNegativeTestJSON-1552264741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-320cb365-95ac-44fb-9e88-a5379bec1dcc" returned: 0 in 0.494s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:46:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d4a21f64-742e-4cd7-b7b2-dd073f6ef841 tempest-ServersNegativeTestJSON-1552264741 None] <== create_volume: return (1452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:46:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d4a21f64-742e-4cd7-b7b2-dd073f6ef841 tempest-ServersNegativeTestJSON-1552264741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.455s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:46:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d4a21f64-742e-4cd7-b7b2-dd073f6ef841 tempest-ServersNegativeTestJSON-1552264741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de695867-d52d-4209-afed-a0ab9d7cfc3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-320cb365-95ac-44fb-9e88-a5379bec1dcc', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:46:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d4a21f64-742e-4cd7-b7b2-dd073f6ef841 tempest-ServersNegativeTestJSON-1552264741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95f41ab9-0276-4c2b-b869-51784b8b0e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:46:36 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-d4a21f64-742e-4cd7-b7b2-dd073f6ef841 tempest-ServersNegativeTestJSON-1552264741 None] Volume volume-320cb365-95ac-44fb-9e88-a5379bec1dcc (320cb365-95ac-44fb-9e88-a5379bec1dcc): created successfully Sep 28 11:46:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d4a21f64-742e-4cd7-b7b2-dd073f6ef841 tempest-ServersNegativeTestJSON-1552264741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95f41ab9-0276-4c2b-b869-51784b8b0e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:46:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d4a21f64-742e-4cd7-b7b2-dd073f6ef841 tempest-ServersNegativeTestJSON-1552264741 None] Flow 'volume_create_manager' (e03b90a2-334b-4e50-a843-3f8c07266864) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:46:36 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-d4a21f64-742e-4cd7-b7b2-dd073f6ef841 tempest-ServersNegativeTestJSON-1552264741 None] Created volume successfully. Sep 28 11:46:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-dde453d0-90fb-444a-a73e-fa13ce2fbd66 tempest-TaggedAttachmentsTest-1813125026 None] Acquiring lock "cinder-6370651a-8721-4d5b-a87b-69cbcf1b1933-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:46:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-dde453d0-90fb-444a-a73e-fa13ce2fbd66 tempest-TaggedAttachmentsTest-1813125026 None] Lock "cinder-6370651a-8721-4d5b-a87b-69cbcf1b1933-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:46:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-dde453d0-90fb-444a-a73e-fa13ce2fbd66 tempest-TaggedAttachmentsTest-1813125026 None] Acquiring lock "cinder-quobyte-6370651a-8721-4d5b-a87b-69cbcf1b1933" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:46:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-dde453d0-90fb-444a-a73e-fa13ce2fbd66 tempest-TaggedAttachmentsTest-1813125026 None] Lock "cinder-quobyte-6370651a-8721-4d5b-a87b-69cbcf1b1933" acquired by "delete_volume" :: waited 0.029s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:46:37 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7bec14d-fc14-4553-9f92-73c90b72f39d]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:46:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-dde453d0-90fb-444a-a73e-fa13ce2fbd66 tempest-TaggedAttachmentsTest-1813125026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-6370651a-8721-4d5b-a87b-69cbcf1b1933 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:46:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-513bd65b-273b-401c-86af-b5250abd4052 tempest-ServersNegativeTestJSON-1552264741 None] Acquiring lock "cinder-320cb365-95ac-44fb-9e88-a5379bec1dcc-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:46:37 devstack sudo[89172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-6370651a-8721-4d5b-a87b-69cbcf1b1933 Sep 28 11:46:37 devstack sudo[89172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:46:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-513bd65b-273b-401c-86af-b5250abd4052 tempest-ServersNegativeTestJSON-1552264741 None] Lock "cinder-320cb365-95ac-44fb-9e88-a5379bec1dcc-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:46:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-513bd65b-273b-401c-86af-b5250abd4052 tempest-ServersNegativeTestJSON-1552264741 None] Acquiring lock "cinder-quobyte-320cb365-95ac-44fb-9e88-a5379bec1dcc" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:46:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-513bd65b-273b-401c-86af-b5250abd4052 tempest-ServersNegativeTestJSON-1552264741 None] Lock "cinder-quobyte-320cb365-95ac-44fb-9e88-a5379bec1dcc" acquired by "delete_volume" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:46:37 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c8fee4-8a9c-494f-baac-b968a8392916]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:46:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-513bd65b-273b-401c-86af-b5250abd4052 tempest-ServersNegativeTestJSON-1552264741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-320cb365-95ac-44fb-9e88-a5379bec1dcc {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:46:38 devstack sudo[89176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-320cb365-95ac-44fb-9e88-a5379bec1dcc Sep 28 11:46:38 devstack sudo[89176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:46:38 devstack sudo[89172]: pam_unix(sudo:session): session closed for user root Sep 28 11:46:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-dde453d0-90fb-444a-a73e-fa13ce2fbd66 tempest-TaggedAttachmentsTest-1813125026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-6370651a-8721-4d5b-a87b-69cbcf1b1933" returned: 0 in 0.583s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:46:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-dde453d0-90fb-444a-a73e-fa13ce2fbd66 tempest-TaggedAttachmentsTest-1813125026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-6370651a-8721-4d5b-a87b-69cbcf1b1933 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:46:38 devstack sudo[89181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-6370651a-8721-4d5b-a87b-69cbcf1b1933 Sep 28 11:46:38 devstack sudo[89181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:46:38 devstack sudo[89181]: pam_unix(sudo:session): session closed for user root Sep 28 11:46:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-dde453d0-90fb-444a-a73e-fa13ce2fbd66 tempest-TaggedAttachmentsTest-1813125026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-6370651a-8721-4d5b-a87b-69cbcf1b1933" returned: 0 in 0.336s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:46:38 devstack sudo[89176]: pam_unix(sudo:session): session closed for user root Sep 28 11:46:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-dde453d0-90fb-444a-a73e-fa13ce2fbd66 tempest-TaggedAttachmentsTest-1813125026 None] Lock "cinder-quobyte-6370651a-8721-4d5b-a87b-69cbcf1b1933" released by "delete_volume" :: held 1.019s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:46:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-513bd65b-273b-401c-86af-b5250abd4052 tempest-ServersNegativeTestJSON-1552264741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-320cb365-95ac-44fb-9e88-a5379bec1dcc" returned: 0 in 0.613s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:46:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-513bd65b-273b-401c-86af-b5250abd4052 tempest-ServersNegativeTestJSON-1552264741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-320cb365-95ac-44fb-9e88-a5379bec1dcc {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:46:38 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 11:46:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:46:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:46:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:46:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:46:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:46:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:46:38 devstack sudo[89188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-320cb365-95ac-44fb-9e88-a5379bec1dcc Sep 28 11:46:38 devstack sudo[89188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:46:38 devstack sudo[89189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:46:38 devstack sudo[89189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:46:38 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-dde453d0-90fb-444a-a73e-fa13ce2fbd66 tempest-TaggedAttachmentsTest-1813125026 None] Created reservations ['3f228afe-65af-40ca-bf32-714b89604cc9', '66c7bd05-6a82-46cd-8cf3-2857a0a8a724', '6b49e731-c96f-404c-a3d8-1013ecfc1107', '4128bf8c-0e0b-4adb-a148-4252655386a7'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:46:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-dde453d0-90fb-444a-a73e-fa13ce2fbd66 tempest-TaggedAttachmentsTest-1813125026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:46:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-dde453d0-90fb-444a-a73e-fa13ce2fbd66 tempest-TaggedAttachmentsTest-1813125026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:46:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-dde453d0-90fb-444a-a73e-fa13ce2fbd66 tempest-TaggedAttachmentsTest-1813125026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:46:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-dde453d0-90fb-444a-a73e-fa13ce2fbd66 tempest-TaggedAttachmentsTest-1813125026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:46:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-dde453d0-90fb-444a-a73e-fa13ce2fbd66 tempest-TaggedAttachmentsTest-1813125026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:46:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-dde453d0-90fb-444a-a73e-fa13ce2fbd66 tempest-TaggedAttachmentsTest-1813125026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:46:39 devstack sudo[89192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:46:39 devstack sudo[89192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:46:39 devstack sudo[89188]: pam_unix(sudo:session): session closed for user root Sep 28 11:46:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-513bd65b-273b-401c-86af-b5250abd4052 tempest-ServersNegativeTestJSON-1552264741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-320cb365-95ac-44fb-9e88-a5379bec1dcc" returned: 0 in 0.574s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:46:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-513bd65b-273b-401c-86af-b5250abd4052 tempest-ServersNegativeTestJSON-1552264741 None] Lock "cinder-quobyte-320cb365-95ac-44fb-9e88-a5379bec1dcc" released by "delete_volume" :: held 1.304s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:46:39 devstack sudo[89189]: pam_unix(sudo:session): session closed for user root Sep 28 11:46:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.598s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:46:39 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:46:39 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-513bd65b-273b-401c-86af-b5250abd4052 tempest-ServersNegativeTestJSON-1552264741 None] Created reservations ['dafdc923-52d4-45f8-8bca-2f27da56383e', '579cc0c9-249a-4639-8919-ad64518cc791', '343c68f8-8c09-4911-839c-7132e3e6402d', '8f7c2f1a-049e-4a25-80bc-d6d70fde114e'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:46:39 devstack sudo[89192]: pam_unix(sudo:session): session closed for user root Sep 28 11:46:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-dde453d0-90fb-444a-a73e-fa13ce2fbd66 tempest-TaggedAttachmentsTest-1813125026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.374s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:46:39 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-dde453d0-90fb-444a-a73e-fa13ce2fbd66 tempest-TaggedAttachmentsTest-1813125026 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:46:39 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-dde453d0-90fb-444a-a73e-fa13ce2fbd66 tempest-TaggedAttachmentsTest-1813125026 None] Deleted volume successfully. Sep 28 11:46:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-dde453d0-90fb-444a-a73e-fa13ce2fbd66 tempest-TaggedAttachmentsTest-1813125026 None] Lock "cinder-6370651a-8721-4d5b-a87b-69cbcf1b1933-delete_volume" released by "delete_volume" :: held 2.040s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:46:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-513bd65b-273b-401c-86af-b5250abd4052 tempest-ServersNegativeTestJSON-1552264741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:46:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-513bd65b-273b-401c-86af-b5250abd4052 tempest-ServersNegativeTestJSON-1552264741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:46:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-513bd65b-273b-401c-86af-b5250abd4052 tempest-ServersNegativeTestJSON-1552264741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:46:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-513bd65b-273b-401c-86af-b5250abd4052 tempest-ServersNegativeTestJSON-1552264741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:46:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-513bd65b-273b-401c-86af-b5250abd4052 tempest-ServersNegativeTestJSON-1552264741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:46:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-513bd65b-273b-401c-86af-b5250abd4052 tempest-ServersNegativeTestJSON-1552264741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:46:39 devstack sudo[89200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:46:39 devstack sudo[89200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:46:39 devstack sudo[89200]: pam_unix(sudo:session): session closed for user root Sep 28 11:46:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-513bd65b-273b-401c-86af-b5250abd4052 tempest-ServersNegativeTestJSON-1552264741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.415s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:46:39 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-513bd65b-273b-401c-86af-b5250abd4052 tempest-ServersNegativeTestJSON-1552264741 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:46:39 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-513bd65b-273b-401c-86af-b5250abd4052 tempest-ServersNegativeTestJSON-1552264741 None] Deleted volume successfully. Sep 28 11:46:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-513bd65b-273b-401c-86af-b5250abd4052 tempest-ServersNegativeTestJSON-1552264741 None] Lock "cinder-320cb365-95ac-44fb-9e88-a5379bec1dcc-delete_volume" released by "delete_volume" :: held 2.192s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:46:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e618478f-f940-41a6-a40b-73e148743b0f tempest-ServersNegativeTestJSON-1552264741 None] Acquiring lock "cinder-16531558-948e-4358-8fed-fc91a652a97e-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:46:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e618478f-f940-41a6-a40b-73e148743b0f tempest-ServersNegativeTestJSON-1552264741 None] Lock "cinder-16531558-948e-4358-8fed-fc91a652a97e-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:46:40 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-96402b9b-02b0-49e2-9521-f59236124d45 tempest-DeleteServersTestJSON-788801543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:46:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-96402b9b-02b0-49e2-9521-f59236124d45 tempest-DeleteServersTestJSON-788801543 None] Flow 'volume_create_manager' (e867db7a-b281-40b8-97d1-6ba2149c1a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:46:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-96402b9b-02b0-49e2-9521-f59236124d45 tempest-DeleteServersTestJSON-788801543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4905231b-e699-4ed3-ae7f-5a86255835d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:46:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-96402b9b-02b0-49e2-9521-f59236124d45 tempest-DeleteServersTestJSON-788801543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4905231b-e699-4ed3-ae7f-5a86255835d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:46:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-905174384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14cc14eb-8571-4d87-ba93-8566cfdbd4bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4854c9b6209942029386eb94407e651a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:46:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:46:40Z,use_quota=True,user_id='00bcfe6a199a4e9591263a99965557c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:46:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-96402b9b-02b0-49e2-9521-f59236124d45 tempest-DeleteServersTestJSON-788801543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaaf7e4f-76d8-4657-a454-fb33f570498e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:46:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-96402b9b-02b0-49e2-9521-f59236124d45 tempest-DeleteServersTestJSON-788801543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaaf7e4f-76d8-4657-a454-fb33f570498e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:46:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-96402b9b-02b0-49e2-9521-f59236124d45 tempest-DeleteServersTestJSON-788801543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fdc2d88-8d17-42cf-a20b-1426b1033b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:46:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-96402b9b-02b0-49e2-9521-f59236124d45 tempest-DeleteServersTestJSON-788801543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fdc2d88-8d17-42cf-a20b-1426b1033b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14cc14eb-8571-4d87-ba93-8566cfdbd4bd', 'volume_name': 'volume-14cc14eb-8571-4d87-ba93-8566cfdbd4bd', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:46:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-96402b9b-02b0-49e2-9521-f59236124d45 tempest-DeleteServersTestJSON-788801543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50db3c87-04b4-4f00-9153-3699dd3c2094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:46:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-96402b9b-02b0-49e2-9521-f59236124d45 tempest-DeleteServersTestJSON-788801543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50db3c87-04b4-4f00-9153-3699dd3c2094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:46:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-96402b9b-02b0-49e2-9521-f59236124d45 tempest-DeleteServersTestJSON-788801543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6efca4f2-4bb1-4f67-9545-013a0169cd38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:46:40 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-96402b9b-02b0-49e2-9521-f59236124d45 tempest-DeleteServersTestJSON-788801543 None] Volume 14cc14eb-8571-4d87-ba93-8566cfdbd4bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14cc14eb-8571-4d87-ba93-8566cfdbd4bd', 'volume_size': 1} Sep 28 11:46:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-96402b9b-02b0-49e2-9521-f59236124d45 tempest-DeleteServersTestJSON-788801543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:46:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-96402b9b-02b0-49e2-9521-f59236124d45 tempest-DeleteServersTestJSON-788801543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:46:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-96402b9b-02b0-49e2-9521-f59236124d45 tempest-DeleteServersTestJSON-788801543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:46:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-905174384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14cc14eb-8571-4d87-ba93-8566cfdbd4bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4854c9b6209942029386eb94407e651a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:46:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:46:40Z,use_quota=True,user_id='00bcfe6a199a4e9591263a99965557c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:46:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-96402b9b-02b0-49e2-9521-f59236124d45 tempest-DeleteServersTestJSON-788801543 None] Creating volume 14cc14eb-8571-4d87-ba93-8566cfdbd4bd {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:46:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-96402b9b-02b0-49e2-9521-f59236124d45 tempest-DeleteServersTestJSON-788801543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:46:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-96402b9b-02b0-49e2-9521-f59236124d45 tempest-DeleteServersTestJSON-788801543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:46:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-96402b9b-02b0-49e2-9521-f59236124d45 tempest-DeleteServersTestJSON-788801543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:46:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-96402b9b-02b0-49e2-9521-f59236124d45 tempest-DeleteServersTestJSON-788801543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:46:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-96402b9b-02b0-49e2-9521-f59236124d45 tempest-DeleteServersTestJSON-788801543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:46:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-96402b9b-02b0-49e2-9521-f59236124d45 tempest-DeleteServersTestJSON-788801543 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:46:40 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-96402b9b-02b0-49e2-9521-f59236124d45 tempest-DeleteServersTestJSON-788801543 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:46:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-96402b9b-02b0-49e2-9521-f59236124d45 tempest-DeleteServersTestJSON-788801543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-14cc14eb-8571-4d87-ba93-8566cfdbd4bd 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:46:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e618478f-f940-41a6-a40b-73e148743b0f tempest-ServersNegativeTestJSON-1552264741 None] Acquiring lock "cinder-quobyte-16531558-948e-4358-8fed-fc91a652a97e" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:46:40 devstack sudo[89203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-14cc14eb-8571-4d87-ba93-8566cfdbd4bd 1073741824 Sep 28 11:46:40 devstack sudo[89203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:46:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e618478f-f940-41a6-a40b-73e148743b0f tempest-ServersNegativeTestJSON-1552264741 None] Lock "cinder-quobyte-16531558-948e-4358-8fed-fc91a652a97e" acquired by "delete_volume" :: waited 0.047s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:46:40 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3365daf-5044-4887-82a1-c0112c7c7564]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:46:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e618478f-f940-41a6-a40b-73e148743b0f tempest-ServersNegativeTestJSON-1552264741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-16531558-948e-4358-8fed-fc91a652a97e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:46:40 devstack sudo[89205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-16531558-948e-4358-8fed-fc91a652a97e Sep 28 11:46:40 devstack sudo[89205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:46:41 devstack sudo[89205]: pam_unix(sudo:session): session closed for user root Sep 28 11:46:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e618478f-f940-41a6-a40b-73e148743b0f tempest-ServersNegativeTestJSON-1552264741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-16531558-948e-4358-8fed-fc91a652a97e" returned: 0 in 0.601s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:46:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e618478f-f940-41a6-a40b-73e148743b0f tempest-ServersNegativeTestJSON-1552264741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-16531558-948e-4358-8fed-fc91a652a97e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:46:41 devstack sudo[89214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-16531558-948e-4358-8fed-fc91a652a97e Sep 28 11:46:41 devstack sudo[89214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:46:41 devstack sudo[89203]: pam_unix(sudo:session): session closed for user root Sep 28 11:46:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-96402b9b-02b0-49e2-9521-f59236124d45 tempest-DeleteServersTestJSON-788801543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-14cc14eb-8571-4d87-ba93-8566cfdbd4bd 1073741824" returned: 0 in 0.902s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:46:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-96402b9b-02b0-49e2-9521-f59236124d45 tempest-DeleteServersTestJSON-788801543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-14cc14eb-8571-4d87-ba93-8566cfdbd4bd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:46:41 devstack sudo[89216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-14cc14eb-8571-4d87-ba93-8566cfdbd4bd Sep 28 11:46:41 devstack sudo[89216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:46:41 devstack sudo[89214]: pam_unix(sudo:session): session closed for user root Sep 28 11:46:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e618478f-f940-41a6-a40b-73e148743b0f tempest-ServersNegativeTestJSON-1552264741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-16531558-948e-4358-8fed-fc91a652a97e" returned: 0 in 0.394s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:46:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e618478f-f940-41a6-a40b-73e148743b0f tempest-ServersNegativeTestJSON-1552264741 None] Lock "cinder-quobyte-16531558-948e-4358-8fed-fc91a652a97e" released by "delete_volume" :: held 1.063s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:46:41 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-e618478f-f940-41a6-a40b-73e148743b0f tempest-ServersNegativeTestJSON-1552264741 None] Created reservations ['8007ed63-2d94-4f71-8e51-a8a7e6802db8', '2af1ab76-284e-4572-8b1a-aa7144506b6f', '36213832-ef85-4fdc-8481-a8283eae50fc', 'd8494d1b-f272-40d3-add0-3635909a2ab1'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:46:41 devstack sudo[89216]: pam_unix(sudo:session): session closed for user root Sep 28 11:46:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-96402b9b-02b0-49e2-9521-f59236124d45 tempest-DeleteServersTestJSON-788801543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-14cc14eb-8571-4d87-ba93-8566cfdbd4bd" returned: 0 in 0.339s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:46:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-96402b9b-02b0-49e2-9521-f59236124d45 tempest-DeleteServersTestJSON-788801543 None] <== create_volume: return (1315ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:46:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-96402b9b-02b0-49e2-9521-f59236124d45 tempest-DeleteServersTestJSON-788801543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.320s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:46:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-96402b9b-02b0-49e2-9521-f59236124d45 tempest-DeleteServersTestJSON-788801543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6efca4f2-4bb1-4f67-9545-013a0169cd38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14cc14eb-8571-4d87-ba93-8566cfdbd4bd', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:46:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-96402b9b-02b0-49e2-9521-f59236124d45 tempest-DeleteServersTestJSON-788801543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bfab38f-436b-4e74-905c-3396d3ea3534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:46:41 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-96402b9b-02b0-49e2-9521-f59236124d45 tempest-DeleteServersTestJSON-788801543 None] Volume volume-14cc14eb-8571-4d87-ba93-8566cfdbd4bd (14cc14eb-8571-4d87-ba93-8566cfdbd4bd): created successfully Sep 28 11:46:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-96402b9b-02b0-49e2-9521-f59236124d45 tempest-DeleteServersTestJSON-788801543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bfab38f-436b-4e74-905c-3396d3ea3534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:46:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-96402b9b-02b0-49e2-9521-f59236124d45 tempest-DeleteServersTestJSON-788801543 None] Flow 'volume_create_manager' (e867db7a-b281-40b8-97d1-6ba2149c1a77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:46:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e618478f-f940-41a6-a40b-73e148743b0f tempest-ServersNegativeTestJSON-1552264741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:46:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e618478f-f940-41a6-a40b-73e148743b0f tempest-ServersNegativeTestJSON-1552264741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:46:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e618478f-f940-41a6-a40b-73e148743b0f tempest-ServersNegativeTestJSON-1552264741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:46:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e618478f-f940-41a6-a40b-73e148743b0f tempest-ServersNegativeTestJSON-1552264741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:46:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e618478f-f940-41a6-a40b-73e148743b0f tempest-ServersNegativeTestJSON-1552264741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:46:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e618478f-f940-41a6-a40b-73e148743b0f tempest-ServersNegativeTestJSON-1552264741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:46:41 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-96402b9b-02b0-49e2-9521-f59236124d45 tempest-DeleteServersTestJSON-788801543 None] Created volume successfully. Sep 28 11:46:41 devstack sudo[89220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:46:41 devstack sudo[89220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:46:42 devstack sudo[89220]: pam_unix(sudo:session): session closed for user root Sep 28 11:46:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e618478f-f940-41a6-a40b-73e148743b0f tempest-ServersNegativeTestJSON-1552264741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.429s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:46:42 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-e618478f-f940-41a6-a40b-73e148743b0f tempest-ServersNegativeTestJSON-1552264741 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:46:42 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e618478f-f940-41a6-a40b-73e148743b0f tempest-ServersNegativeTestJSON-1552264741 None] Deleted volume successfully. Sep 28 11:46:42 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e618478f-f940-41a6-a40b-73e148743b0f tempest-ServersNegativeTestJSON-1552264741 None] Lock "cinder-16531558-948e-4358-8fed-fc91a652a97e-delete_volume" released by "delete_volume" :: held 2.045s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:46:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-20e13698-003a-42be-a3f0-ee583dae5fe9 req-6aff679e-a399-4066-b020-a232d3a86f5a tempest-DeleteServersTestJSON-788801543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:46:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-20e13698-003a-42be-a3f0-ee583dae5fe9 req-6aff679e-a399-4066-b020-a232d3a86f5a tempest-DeleteServersTestJSON-788801543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:46:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-20e13698-003a-42be-a3f0-ee583dae5fe9 req-6aff679e-a399-4066-b020-a232d3a86f5a tempest-DeleteServersTestJSON-788801543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:46:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-20e13698-003a-42be-a3f0-ee583dae5fe9 req-6aff679e-a399-4066-b020-a232d3a86f5a tempest-DeleteServersTestJSON-788801543 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0', 'name': 'volume-14cc14eb-8571-4d87-ba93-8566cfdbd4bd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2d70d86c-14e6-473d-8fde-b8d18a034c34', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 11:46:44 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-20e13698-003a-42be-a3f0-ee583dae5fe9 req-6aff679e-a399-4066-b020-a232d3a86f5a tempest-DeleteServersTestJSON-788801543 None] attachment_update completed successfully. Sep 28 11:46:53 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-3dd6dd99-b15b-4f63-b2da-e8671f8531b6 req-65236872-c675-47a4-a864-eece3c16badd tempest-DeleteServersTestJSON-788801543 None] Terminate volume connection completed successfully. Sep 28 11:46:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-3dd6dd99-b15b-4f63-b2da-e8671f8531b6 req-65236872-c675-47a4-a864-eece3c16badd tempest-DeleteServersTestJSON-788801543 None] Deleting attachment 2d70d86c-14e6-473d-8fde-b8d18a034c34. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 11:46:54 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbee4afe-dfd7-4f0d-bde7-e496652d691d tempest-VolumesServicesTestJSON-1752949224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:46:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fbee4afe-dfd7-4f0d-bde7-e496652d691d tempest-VolumesServicesTestJSON-1752949224 None] Flow 'volume_create_manager' (36ea65b3-fd11-4faa-a20a-7bd2822bd9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:46:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fbee4afe-dfd7-4f0d-bde7-e496652d691d tempest-VolumesServicesTestJSON-1752949224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f61de583-80d3-4e6f-970e-812578f5caef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:46:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fbee4afe-dfd7-4f0d-bde7-e496652d691d tempest-VolumesServicesTestJSON-1752949224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f61de583-80d3-4e6f-970e-812578f5caef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-539235290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e17ce7d1-96cc-4ee8-99ce-ef483d0641e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bacf9ee80174509a9db745f10bd69ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:46:54Z,use_quota=True,user_id='c4556aad463c47898c27370355338ca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:46:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fbee4afe-dfd7-4f0d-bde7-e496652d691d tempest-VolumesServicesTestJSON-1752949224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6f9a6da-97d6-45be-97e6-feb315d57643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:46:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fbee4afe-dfd7-4f0d-bde7-e496652d691d tempest-VolumesServicesTestJSON-1752949224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6f9a6da-97d6-45be-97e6-feb315d57643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:46:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fbee4afe-dfd7-4f0d-bde7-e496652d691d tempest-VolumesServicesTestJSON-1752949224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b03d83b-b6e0-4422-bd2f-ea0f87c6f0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:46:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fbee4afe-dfd7-4f0d-bde7-e496652d691d tempest-VolumesServicesTestJSON-1752949224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b03d83b-b6e0-4422-bd2f-ea0f87c6f0b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e17ce7d1-96cc-4ee8-99ce-ef483d0641e8', 'volume_name': 'volume-e17ce7d1-96cc-4ee8-99ce-ef483d0641e8', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:46:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fbee4afe-dfd7-4f0d-bde7-e496652d691d tempest-VolumesServicesTestJSON-1752949224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (421113bc-6ea5-4b65-82a3-f2738d7211f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:46:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fbee4afe-dfd7-4f0d-bde7-e496652d691d tempest-VolumesServicesTestJSON-1752949224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (421113bc-6ea5-4b65-82a3-f2738d7211f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:46:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fbee4afe-dfd7-4f0d-bde7-e496652d691d tempest-VolumesServicesTestJSON-1752949224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13e6555e-2739-492d-95cd-2551db8aeb86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:46:54 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-fbee4afe-dfd7-4f0d-bde7-e496652d691d tempest-VolumesServicesTestJSON-1752949224 None] Volume e17ce7d1-96cc-4ee8-99ce-ef483d0641e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e17ce7d1-96cc-4ee8-99ce-ef483d0641e8', 'volume_size': 1} Sep 28 11:46:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fbee4afe-dfd7-4f0d-bde7-e496652d691d tempest-VolumesServicesTestJSON-1752949224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:46:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fbee4afe-dfd7-4f0d-bde7-e496652d691d tempest-VolumesServicesTestJSON-1752949224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:46:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-fbee4afe-dfd7-4f0d-bde7-e496652d691d tempest-VolumesServicesTestJSON-1752949224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-539235290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e17ce7d1-96cc-4ee8-99ce-ef483d0641e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bacf9ee80174509a9db745f10bd69ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:46:54Z,use_quota=True,user_id='c4556aad463c47898c27370355338ca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:46:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-fbee4afe-dfd7-4f0d-bde7-e496652d691d tempest-VolumesServicesTestJSON-1752949224 None] Creating volume e17ce7d1-96cc-4ee8-99ce-ef483d0641e8 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:46:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fbee4afe-dfd7-4f0d-bde7-e496652d691d tempest-VolumesServicesTestJSON-1752949224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:46:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fbee4afe-dfd7-4f0d-bde7-e496652d691d tempest-VolumesServicesTestJSON-1752949224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:46:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-fbee4afe-dfd7-4f0d-bde7-e496652d691d tempest-VolumesServicesTestJSON-1752949224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:46:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-fbee4afe-dfd7-4f0d-bde7-e496652d691d tempest-VolumesServicesTestJSON-1752949224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:46:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fbee4afe-dfd7-4f0d-bde7-e496652d691d tempest-VolumesServicesTestJSON-1752949224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:46:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-fbee4afe-dfd7-4f0d-bde7-e496652d691d tempest-VolumesServicesTestJSON-1752949224 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:46:54 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-fbee4afe-dfd7-4f0d-bde7-e496652d691d tempest-VolumesServicesTestJSON-1752949224 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:46:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fbee4afe-dfd7-4f0d-bde7-e496652d691d tempest-VolumesServicesTestJSON-1752949224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e17ce7d1-96cc-4ee8-99ce-ef483d0641e8 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:46:54 devstack sudo[89745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e17ce7d1-96cc-4ee8-99ce-ef483d0641e8 1073741824 Sep 28 11:46:54 devstack sudo[89745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:46:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-aaa38007-a7c8-4084-853c-6922f0ac762e tempest-DeleteServersTestJSON-788801543 None] Acquiring lock "cinder-14cc14eb-8571-4d87-ba93-8566cfdbd4bd-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:46:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-aaa38007-a7c8-4084-853c-6922f0ac762e tempest-DeleteServersTestJSON-788801543 None] Lock "cinder-14cc14eb-8571-4d87-ba93-8566cfdbd4bd-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:46:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-aaa38007-a7c8-4084-853c-6922f0ac762e tempest-DeleteServersTestJSON-788801543 None] Acquiring lock "cinder-quobyte-14cc14eb-8571-4d87-ba93-8566cfdbd4bd" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:46:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-aaa38007-a7c8-4084-853c-6922f0ac762e tempest-DeleteServersTestJSON-788801543 None] Lock "cinder-quobyte-14cc14eb-8571-4d87-ba93-8566cfdbd4bd" acquired by "delete_volume" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:46:54 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f090ae2-b6e7-4300-abaf-3dd8f4d18b75]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:46:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-aaa38007-a7c8-4084-853c-6922f0ac762e tempest-DeleteServersTestJSON-788801543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-14cc14eb-8571-4d87-ba93-8566cfdbd4bd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:46:54 devstack sudo[89745]: pam_unix(sudo:session): session closed for user root Sep 28 11:46:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fbee4afe-dfd7-4f0d-bde7-e496652d691d tempest-VolumesServicesTestJSON-1752949224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e17ce7d1-96cc-4ee8-99ce-ef483d0641e8 1073741824" returned: 0 in 0.666s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:46:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fbee4afe-dfd7-4f0d-bde7-e496652d691d tempest-VolumesServicesTestJSON-1752949224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e17ce7d1-96cc-4ee8-99ce-ef483d0641e8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:46:54 devstack sudo[89752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e17ce7d1-96cc-4ee8-99ce-ef483d0641e8 Sep 28 11:46:54 devstack sudo[89752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:46:55 devstack sudo[89751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-14cc14eb-8571-4d87-ba93-8566cfdbd4bd Sep 28 11:46:55 devstack sudo[89751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:46:55 devstack sudo[89752]: pam_unix(sudo:session): session closed for user root Sep 28 11:46:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fbee4afe-dfd7-4f0d-bde7-e496652d691d tempest-VolumesServicesTestJSON-1752949224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e17ce7d1-96cc-4ee8-99ce-ef483d0641e8" returned: 0 in 0.273s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:46:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-fbee4afe-dfd7-4f0d-bde7-e496652d691d tempest-VolumesServicesTestJSON-1752949224 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:46:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fbee4afe-dfd7-4f0d-bde7-e496652d691d tempest-VolumesServicesTestJSON-1752949224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:46:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fbee4afe-dfd7-4f0d-bde7-e496652d691d tempest-VolumesServicesTestJSON-1752949224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13e6555e-2739-492d-95cd-2551db8aeb86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e17ce7d1-96cc-4ee8-99ce-ef483d0641e8', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:46:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fbee4afe-dfd7-4f0d-bde7-e496652d691d tempest-VolumesServicesTestJSON-1752949224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d2051d1-f01b-482c-9a52-dc8246b4dcb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:46:55 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-fbee4afe-dfd7-4f0d-bde7-e496652d691d tempest-VolumesServicesTestJSON-1752949224 None] Volume volume-e17ce7d1-96cc-4ee8-99ce-ef483d0641e8 (e17ce7d1-96cc-4ee8-99ce-ef483d0641e8): created successfully Sep 28 11:46:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fbee4afe-dfd7-4f0d-bde7-e496652d691d tempest-VolumesServicesTestJSON-1752949224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d2051d1-f01b-482c-9a52-dc8246b4dcb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:46:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fbee4afe-dfd7-4f0d-bde7-e496652d691d tempest-VolumesServicesTestJSON-1752949224 None] Flow 'volume_create_manager' (36ea65b3-fd11-4faa-a20a-7bd2822bd9e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:46:55 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-fbee4afe-dfd7-4f0d-bde7-e496652d691d tempest-VolumesServicesTestJSON-1752949224 None] Created volume successfully. Sep 28 11:46:55 devstack sudo[89751]: pam_unix(sudo:session): session closed for user root Sep 28 11:46:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-aaa38007-a7c8-4084-853c-6922f0ac762e tempest-DeleteServersTestJSON-788801543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-14cc14eb-8571-4d87-ba93-8566cfdbd4bd" returned: 0 in 0.514s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:46:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-aaa38007-a7c8-4084-853c-6922f0ac762e tempest-DeleteServersTestJSON-788801543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-14cc14eb-8571-4d87-ba93-8566cfdbd4bd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:46:55 devstack sudo[89759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-14cc14eb-8571-4d87-ba93-8566cfdbd4bd Sep 28 11:46:55 devstack sudo[89759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:46:55 devstack sudo[89759]: pam_unix(sudo:session): session closed for user root Sep 28 11:46:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-aaa38007-a7c8-4084-853c-6922f0ac762e tempest-DeleteServersTestJSON-788801543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-14cc14eb-8571-4d87-ba93-8566cfdbd4bd" returned: 0 in 0.270s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:46:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-aaa38007-a7c8-4084-853c-6922f0ac762e tempest-DeleteServersTestJSON-788801543 None] Lock "cinder-quobyte-14cc14eb-8571-4d87-ba93-8566cfdbd4bd" released by "delete_volume" :: held 0.841s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:46:55 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-aaa38007-a7c8-4084-853c-6922f0ac762e tempest-DeleteServersTestJSON-788801543 None] Created reservations ['1fc4aa3f-4693-4f13-93f1-ac5cf3695c6c', 'b8747155-437f-4679-9d73-8119b6c4cd16', '92278051-0338-4933-b511-4e2aa8dcf6a3', '323df52d-2d74-4cbe-ae7e-d6ca621d7fab'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:46:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-aaa38007-a7c8-4084-853c-6922f0ac762e tempest-DeleteServersTestJSON-788801543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:46:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-aaa38007-a7c8-4084-853c-6922f0ac762e tempest-DeleteServersTestJSON-788801543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:46:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-aaa38007-a7c8-4084-853c-6922f0ac762e tempest-DeleteServersTestJSON-788801543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:46:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-aaa38007-a7c8-4084-853c-6922f0ac762e tempest-DeleteServersTestJSON-788801543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:46:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-aaa38007-a7c8-4084-853c-6922f0ac762e tempest-DeleteServersTestJSON-788801543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:46:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-aaa38007-a7c8-4084-853c-6922f0ac762e tempest-DeleteServersTestJSON-788801543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:46:55 devstack sudo[89762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:46:55 devstack sudo[89762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:46:56 devstack sudo[89762]: pam_unix(sudo:session): session closed for user root Sep 28 11:46:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-aaa38007-a7c8-4084-853c-6922f0ac762e tempest-DeleteServersTestJSON-788801543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.364s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:46:56 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-aaa38007-a7c8-4084-853c-6922f0ac762e tempest-DeleteServersTestJSON-788801543 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:46:56 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-aaa38007-a7c8-4084-853c-6922f0ac762e tempest-DeleteServersTestJSON-788801543 None] Deleted volume successfully. Sep 28 11:46:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-aaa38007-a7c8-4084-853c-6922f0ac762e tempest-DeleteServersTestJSON-788801543 None] Lock "cinder-14cc14eb-8571-4d87-ba93-8566cfdbd4bd-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:46:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ce19ed3f-0fbb-4367-87b4-673fd6a1ff80 tempest-VolumesServicesTestJSON-1752949224 None] Acquiring lock "cinder-e17ce7d1-96cc-4ee8-99ce-ef483d0641e8-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:46:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ce19ed3f-0fbb-4367-87b4-673fd6a1ff80 tempest-VolumesServicesTestJSON-1752949224 None] Lock "cinder-e17ce7d1-96cc-4ee8-99ce-ef483d0641e8-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:46:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ce19ed3f-0fbb-4367-87b4-673fd6a1ff80 tempest-VolumesServicesTestJSON-1752949224 None] Acquiring lock "cinder-quobyte-e17ce7d1-96cc-4ee8-99ce-ef483d0641e8" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:46:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ce19ed3f-0fbb-4367-87b4-673fd6a1ff80 tempest-VolumesServicesTestJSON-1752949224 None] Lock "cinder-quobyte-e17ce7d1-96cc-4ee8-99ce-ef483d0641e8" acquired by "delete_volume" :: waited 0.035s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:46:56 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[30176ea8-ba83-47a7-a599-0c1bf8e05f60]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:46:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ce19ed3f-0fbb-4367-87b4-673fd6a1ff80 tempest-VolumesServicesTestJSON-1752949224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e17ce7d1-96cc-4ee8-99ce-ef483d0641e8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:46:56 devstack sudo[89767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e17ce7d1-96cc-4ee8-99ce-ef483d0641e8 Sep 28 11:46:56 devstack sudo[89767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:46:57 devstack sudo[89767]: pam_unix(sudo:session): session closed for user root Sep 28 11:46:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ce19ed3f-0fbb-4367-87b4-673fd6a1ff80 tempest-VolumesServicesTestJSON-1752949224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e17ce7d1-96cc-4ee8-99ce-ef483d0641e8" returned: 0 in 0.479s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:46:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ce19ed3f-0fbb-4367-87b4-673fd6a1ff80 tempest-VolumesServicesTestJSON-1752949224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e17ce7d1-96cc-4ee8-99ce-ef483d0641e8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:46:57 devstack sudo[89772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e17ce7d1-96cc-4ee8-99ce-ef483d0641e8 Sep 28 11:46:57 devstack sudo[89772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:46:57 devstack sudo[89772]: pam_unix(sudo:session): session closed for user root Sep 28 11:46:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ce19ed3f-0fbb-4367-87b4-673fd6a1ff80 tempest-VolumesServicesTestJSON-1752949224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e17ce7d1-96cc-4ee8-99ce-ef483d0641e8" returned: 0 in 0.317s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:46:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ce19ed3f-0fbb-4367-87b4-673fd6a1ff80 tempest-VolumesServicesTestJSON-1752949224 None] Lock "cinder-quobyte-e17ce7d1-96cc-4ee8-99ce-ef483d0641e8" released by "delete_volume" :: held 0.849s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:46:57 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-ce19ed3f-0fbb-4367-87b4-673fd6a1ff80 tempest-VolumesServicesTestJSON-1752949224 None] Created reservations ['4d09d5b6-beef-429e-b91a-73e13a9a5639', '366eabb8-dc32-4b17-9fb9-14ebae0271e7', 'f9c19de1-ac8c-4ffd-88f4-630db65cd1bb', '8c065f6e-2d57-400e-afa2-07790115f5c3'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:46:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ce19ed3f-0fbb-4367-87b4-673fd6a1ff80 tempest-VolumesServicesTestJSON-1752949224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:46:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ce19ed3f-0fbb-4367-87b4-673fd6a1ff80 tempest-VolumesServicesTestJSON-1752949224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:46:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ce19ed3f-0fbb-4367-87b4-673fd6a1ff80 tempest-VolumesServicesTestJSON-1752949224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:46:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ce19ed3f-0fbb-4367-87b4-673fd6a1ff80 tempest-VolumesServicesTestJSON-1752949224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:46:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ce19ed3f-0fbb-4367-87b4-673fd6a1ff80 tempest-VolumesServicesTestJSON-1752949224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:46:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ce19ed3f-0fbb-4367-87b4-673fd6a1ff80 tempest-VolumesServicesTestJSON-1752949224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:46:57 devstack sudo[89775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:46:57 devstack sudo[89775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:46:58 devstack sudo[89775]: pam_unix(sudo:session): session closed for user root Sep 28 11:46:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ce19ed3f-0fbb-4367-87b4-673fd6a1ff80 tempest-VolumesServicesTestJSON-1752949224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.350s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:46:58 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-ce19ed3f-0fbb-4367-87b4-673fd6a1ff80 tempest-VolumesServicesTestJSON-1752949224 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:46:58 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-ce19ed3f-0fbb-4367-87b4-673fd6a1ff80 tempest-VolumesServicesTestJSON-1752949224 None] Deleted volume successfully. Sep 28 11:46:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ce19ed3f-0fbb-4367-87b4-673fd6a1ff80 tempest-VolumesServicesTestJSON-1752949224 None] Lock "cinder-e17ce7d1-96cc-4ee8-99ce-ef483d0641e8-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:47:07 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=41,cinder:UPDATE=48,cinder:DELETE=5,cinder:INSERT=11 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 11:47:08 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:UPDATE=59,cinder:SELECT=40,cinder:INSERT=13,cinder:DELETE=4 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 11:47:11 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-73bec8e6-18bf-4fd4-b3ff-2180e0f9e44f tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:47:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-73bec8e6-18bf-4fd4-b3ff-2180e0f9e44f tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Flow 'volume_create_manager' (2d5d9eff-7ad3-4a09-ada5-3134f7315076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:47:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-73bec8e6-18bf-4fd4-b3ff-2180e0f9e44f tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (465b3453-29aa-48d4-8f3c-7931318e3faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:47:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-73bec8e6-18bf-4fd4-b3ff-2180e0f9e44f tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (465b3453-29aa-48d4-8f3c-7931318e3faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:47:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-72699939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c56c185-e968-44f2-950d-b04c0af6cb13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b16c641b4d0b486db55caecec0ec77b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:47:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:47:11Z,use_quota=True,user_id='7c7b7364ffe54afc9ed10be852229e61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:47:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-73bec8e6-18bf-4fd4-b3ff-2180e0f9e44f tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f52ab084-26b6-400a-a633-b9d2802b8c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:47:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-73bec8e6-18bf-4fd4-b3ff-2180e0f9e44f tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f52ab084-26b6-400a-a633-b9d2802b8c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:47:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-73bec8e6-18bf-4fd4-b3ff-2180e0f9e44f tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42f0e53d-e8a1-45b5-8461-ef969ce4dde4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:47:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-73bec8e6-18bf-4fd4-b3ff-2180e0f9e44f tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42f0e53d-e8a1-45b5-8461-ef969ce4dde4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c56c185-e968-44f2-950d-b04c0af6cb13', 'volume_name': 'volume-9c56c185-e968-44f2-950d-b04c0af6cb13', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:47:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-73bec8e6-18bf-4fd4-b3ff-2180e0f9e44f tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dabe371-dac9-48a2-a491-2d6742922be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:47:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-73bec8e6-18bf-4fd4-b3ff-2180e0f9e44f tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dabe371-dac9-48a2-a491-2d6742922be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:47:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-73bec8e6-18bf-4fd4-b3ff-2180e0f9e44f tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49b5c199-afaf-4bca-b167-f66ad0dde9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:47:11 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-73bec8e6-18bf-4fd4-b3ff-2180e0f9e44f tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Volume 9c56c185-e968-44f2-950d-b04c0af6cb13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c56c185-e968-44f2-950d-b04c0af6cb13', 'volume_size': 1} Sep 28 11:47:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-73bec8e6-18bf-4fd4-b3ff-2180e0f9e44f tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:47:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-73bec8e6-18bf-4fd4-b3ff-2180e0f9e44f tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:47:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-73bec8e6-18bf-4fd4-b3ff-2180e0f9e44f tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:47:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-72699939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c56c185-e968-44f2-950d-b04c0af6cb13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b16c641b4d0b486db55caecec0ec77b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:47:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:47:11Z,use_quota=True,user_id='7c7b7364ffe54afc9ed10be852229e61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:47:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-73bec8e6-18bf-4fd4-b3ff-2180e0f9e44f tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Creating volume 9c56c185-e968-44f2-950d-b04c0af6cb13 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:47:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-73bec8e6-18bf-4fd4-b3ff-2180e0f9e44f tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:47:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-73bec8e6-18bf-4fd4-b3ff-2180e0f9e44f tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:47:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-73bec8e6-18bf-4fd4-b3ff-2180e0f9e44f tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:47:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-73bec8e6-18bf-4fd4-b3ff-2180e0f9e44f tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:47:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-73bec8e6-18bf-4fd4-b3ff-2180e0f9e44f tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:47:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-73bec8e6-18bf-4fd4-b3ff-2180e0f9e44f tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:47:11 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-73bec8e6-18bf-4fd4-b3ff-2180e0f9e44f tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:47:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-73bec8e6-18bf-4fd4-b3ff-2180e0f9e44f tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9c56c185-e968-44f2-950d-b04c0af6cb13 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:47:11 devstack sudo[89821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9c56c185-e968-44f2-950d-b04c0af6cb13 1073741824 Sep 28 11:47:11 devstack sudo[89821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:47:11 devstack sudo[89821]: pam_unix(sudo:session): session closed for user root Sep 28 11:47:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-73bec8e6-18bf-4fd4-b3ff-2180e0f9e44f tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9c56c185-e968-44f2-950d-b04c0af6cb13 1073741824" returned: 0 in 0.598s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:47:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-73bec8e6-18bf-4fd4-b3ff-2180e0f9e44f tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9c56c185-e968-44f2-950d-b04c0af6cb13 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:47:11 devstack sudo[89827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9c56c185-e968-44f2-950d-b04c0af6cb13 Sep 28 11:47:11 devstack sudo[89827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:47:12 devstack sudo[89827]: pam_unix(sudo:session): session closed for user root Sep 28 11:47:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-73bec8e6-18bf-4fd4-b3ff-2180e0f9e44f tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9c56c185-e968-44f2-950d-b04c0af6cb13" returned: 0 in 0.310s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:47:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-73bec8e6-18bf-4fd4-b3ff-2180e0f9e44f tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:47:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-73bec8e6-18bf-4fd4-b3ff-2180e0f9e44f tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:47:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-73bec8e6-18bf-4fd4-b3ff-2180e0f9e44f tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49b5c199-afaf-4bca-b167-f66ad0dde9ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c56c185-e968-44f2-950d-b04c0af6cb13', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:47:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-73bec8e6-18bf-4fd4-b3ff-2180e0f9e44f tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ee692b1-2ea3-43ac-88db-994c5888b5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:47:12 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-73bec8e6-18bf-4fd4-b3ff-2180e0f9e44f tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Volume volume-9c56c185-e968-44f2-950d-b04c0af6cb13 (9c56c185-e968-44f2-950d-b04c0af6cb13): created successfully Sep 28 11:47:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-73bec8e6-18bf-4fd4-b3ff-2180e0f9e44f tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ee692b1-2ea3-43ac-88db-994c5888b5dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:47:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-73bec8e6-18bf-4fd4-b3ff-2180e0f9e44f tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Flow 'volume_create_manager' (2d5d9eff-7ad3-4a09-ada5-3134f7315076) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:47:12 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-73bec8e6-18bf-4fd4-b3ff-2180e0f9e44f tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Created volume successfully. Sep 28 11:47:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5fcd05bc-2729-4189-8a05-b0d726e31970 tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:47:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5fcd05bc-2729-4189-8a05-b0d726e31970 tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:47:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-5fcd05bc-2729-4189-8a05-b0d726e31970 tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Creating offline snapshot 2f06a3d2-21b9-44ec-b382-c6ac1e1f683a of volume 9c56c185-e968-44f2-950d-b04c0af6cb13 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 11:47:13 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[36bd51bb-3b09-4c0d-bc77-6b3e181d2361]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:47:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5fcd05bc-2729-4189-8a05-b0d726e31970 tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9c56c185-e968-44f2-950d-b04c0af6cb13 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:47:13 devstack sudo[89830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9c56c185-e968-44f2-950d-b04c0af6cb13 Sep 28 11:47:13 devstack sudo[89830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:47:14 devstack sudo[89830]: pam_unix(sudo:session): session closed for user root Sep 28 11:47:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5fcd05bc-2729-4189-8a05-b0d726e31970 tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9c56c185-e968-44f2-950d-b04c0af6cb13" returned: 0 in 0.566s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:47:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5fcd05bc-2729-4189-8a05-b0d726e31970 tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9c56c185-e968-44f2-950d-b04c0af6cb13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9c56c185-e968-44f2-950d-b04c0af6cb13.2f06a3d2-21b9-44ec-b382-c6ac1e1f683a 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:47:14 devstack sudo[89836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9c56c185-e968-44f2-950d-b04c0af6cb13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9c56c185-e968-44f2-950d-b04c0af6cb13.2f06a3d2-21b9-44ec-b382-c6ac1e1f683a 1G Sep 28 11:47:14 devstack sudo[89836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:47:14 devstack sudo[89836]: pam_unix(sudo:session): session closed for user root Sep 28 11:47:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5fcd05bc-2729-4189-8a05-b0d726e31970 tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9c56c185-e968-44f2-950d-b04c0af6cb13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9c56c185-e968-44f2-950d-b04c0af6cb13.2f06a3d2-21b9-44ec-b382-c6ac1e1f683a 1G" returned: 0 in 0.578s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:47:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5fcd05bc-2729-4189-8a05-b0d726e31970 tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c56c185-e968-44f2-950d-b04c0af6cb13 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9c56c185-e968-44f2-950d-b04c0af6cb13.2f06a3d2-21b9-44ec-b382-c6ac1e1f683a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:47:14 devstack sudo[89848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c56c185-e968-44f2-950d-b04c0af6cb13 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9c56c185-e968-44f2-950d-b04c0af6cb13.2f06a3d2-21b9-44ec-b382-c6ac1e1f683a Sep 28 11:47:14 devstack sudo[89848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:47:15 devstack sudo[89848]: pam_unix(sudo:session): session closed for user root Sep 28 11:47:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5fcd05bc-2729-4189-8a05-b0d726e31970 tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c56c185-e968-44f2-950d-b04c0af6cb13 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9c56c185-e968-44f2-950d-b04c0af6cb13.2f06a3d2-21b9-44ec-b382-c6ac1e1f683a" returned: 0 in 0.396s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:47:15 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-5fcd05bc-2729-4189-8a05-b0d726e31970 tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9c56c185-e968-44f2-950d-b04c0af6cb13.2f06a3d2-21b9-44ec-b382-c6ac1e1f683a is being set with open permissions: ugo+rw Sep 28 11:47:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5fcd05bc-2729-4189-8a05-b0d726e31970 tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9c56c185-e968-44f2-950d-b04c0af6cb13.2f06a3d2-21b9-44ec-b382-c6ac1e1f683a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:47:15 devstack sudo[89854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9c56c185-e968-44f2-950d-b04c0af6cb13.2f06a3d2-21b9-44ec-b382-c6ac1e1f683a Sep 28 11:47:15 devstack sudo[89854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:47:15 devstack sudo[89854]: pam_unix(sudo:session): session closed for user root Sep 28 11:47:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5fcd05bc-2729-4189-8a05-b0d726e31970 tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9c56c185-e968-44f2-950d-b04c0af6cb13.2f06a3d2-21b9-44ec-b382-c6ac1e1f683a" returned: 0 in 0.323s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:47:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5fcd05bc-2729-4189-8a05-b0d726e31970 tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9c56c185-e968-44f2-950d-b04c0af6cb13.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:47:15 devstack sudo[89857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9c56c185-e968-44f2-950d-b04c0af6cb13.info Sep 28 11:47:15 devstack sudo[89857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:47:15 devstack sudo[89857]: pam_unix(sudo:session): session closed for user root Sep 28 11:47:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5fcd05bc-2729-4189-8a05-b0d726e31970 tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9c56c185-e968-44f2-950d-b04c0af6cb13.info" returned: 0 in 0.366s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:47:15 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-5fcd05bc-2729-4189-8a05-b0d726e31970 tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9c56c185-e968-44f2-950d-b04c0af6cb13.info is being set with open permissions: ugo+rw Sep 28 11:47:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5fcd05bc-2729-4189-8a05-b0d726e31970 tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9c56c185-e968-44f2-950d-b04c0af6cb13.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:47:15 devstack sudo[89860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9c56c185-e968-44f2-950d-b04c0af6cb13.info Sep 28 11:47:15 devstack sudo[89860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:47:16 devstack sudo[89860]: pam_unix(sudo:session): session closed for user root Sep 28 11:47:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5fcd05bc-2729-4189-8a05-b0d726e31970 tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9c56c185-e968-44f2-950d-b04c0af6cb13.info" returned: 0 in 0.585s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:47:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5fcd05bc-2729-4189-8a05-b0d726e31970 tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.961s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:47:16 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-5fcd05bc-2729-4189-8a05-b0d726e31970 tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Create snapshot completed successfully Sep 28 11:47:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8191110c-29f3-4fed-8ebb-cc16137bec74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Acquiring lock "cinder-2f06a3d2-21b9-44ec-b382-c6ac1e1f683a-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:47:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8191110c-29f3-4fed-8ebb-cc16137bec74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Lock "cinder-2f06a3d2-21b9-44ec-b382-c6ac1e1f683a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:47:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8191110c-29f3-4fed-8ebb-cc16137bec74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Acquiring lock "cinder-quobyte-9c56c185-e968-44f2-950d-b04c0af6cb13" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:47:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8191110c-29f3-4fed-8ebb-cc16137bec74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Lock "cinder-quobyte-9c56c185-e968-44f2-950d-b04c0af6cb13" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:47:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8191110c-29f3-4fed-8ebb-cc16137bec74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Acquiring lock "cinder-quobyte-2f06a3d2-21b9-44ec-b382-c6ac1e1f683a" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:47:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8191110c-29f3-4fed-8ebb-cc16137bec74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Lock "cinder-quobyte-2f06a3d2-21b9-44ec-b382-c6ac1e1f683a" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:47:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-8191110c-29f3-4fed-8ebb-cc16137bec74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Deleting offline snapshot 2f06a3d2-21b9-44ec-b382-c6ac1e1f683a of volume 9c56c185-e968-44f2-950d-b04c0af6cb13 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 11:47:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-8191110c-29f3-4fed-8ebb-cc16137bec74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] snapshot_file for this snap is: volume-9c56c185-e968-44f2-950d-b04c0af6cb13.2f06a3d2-21b9-44ec-b382-c6ac1e1f683a {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 11:47:17 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea31869-f55c-4049-842d-6c893b0b17d0]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:47:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8191110c-29f3-4fed-8ebb-cc16137bec74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9c56c185-e968-44f2-950d-b04c0af6cb13.2f06a3d2-21b9-44ec-b382-c6ac1e1f683a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:47:17 devstack sudo[89868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9c56c185-e968-44f2-950d-b04c0af6cb13.2f06a3d2-21b9-44ec-b382-c6ac1e1f683a Sep 28 11:47:17 devstack sudo[89868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:47:18 devstack sudo[89868]: pam_unix(sudo:session): session closed for user root Sep 28 11:47:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8191110c-29f3-4fed-8ebb-cc16137bec74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9c56c185-e968-44f2-950d-b04c0af6cb13.2f06a3d2-21b9-44ec-b382-c6ac1e1f683a" returned: 0 in 0.493s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:47:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-8191110c-29f3-4fed-8ebb-cc16137bec74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c56c185-e968-44f2-950d-b04c0af6cb13(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 11:47:18 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ce51e3-c757-4df9-8648-ad0224083a61]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:47:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8191110c-29f3-4fed-8ebb-cc16137bec74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9c56c185-e968-44f2-950d-b04c0af6cb13 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:47:18 devstack sudo[89875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9c56c185-e968-44f2-950d-b04c0af6cb13 Sep 28 11:47:18 devstack sudo[89875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:47:18 devstack sudo[89875]: pam_unix(sudo:session): session closed for user root Sep 28 11:47:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8191110c-29f3-4fed-8ebb-cc16137bec74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9c56c185-e968-44f2-950d-b04c0af6cb13" returned: 0 in 0.456s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:47:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8191110c-29f3-4fed-8ebb-cc16137bec74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9c56c185-e968-44f2-950d-b04c0af6cb13.2f06a3d2-21b9-44ec-b382-c6ac1e1f683a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:47:18 devstack sudo[89895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9c56c185-e968-44f2-950d-b04c0af6cb13.2f06a3d2-21b9-44ec-b382-c6ac1e1f683a Sep 28 11:47:18 devstack sudo[89895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:47:18 devstack sudo[89895]: pam_unix(sudo:session): session closed for user root Sep 28 11:47:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8191110c-29f3-4fed-8ebb-cc16137bec74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9c56c185-e968-44f2-950d-b04c0af6cb13.2f06a3d2-21b9-44ec-b382-c6ac1e1f683a" returned: 0 in 0.405s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:47:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8191110c-29f3-4fed-8ebb-cc16137bec74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9c56c185-e968-44f2-950d-b04c0af6cb13.2f06a3d2-21b9-44ec-b382-c6ac1e1f683a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:47:19 devstack sudo[89903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9c56c185-e968-44f2-950d-b04c0af6cb13.2f06a3d2-21b9-44ec-b382-c6ac1e1f683a Sep 28 11:47:19 devstack sudo[89903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:47:19 devstack sudo[89903]: pam_unix(sudo:session): session closed for user root Sep 28 11:47:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8191110c-29f3-4fed-8ebb-cc16137bec74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9c56c185-e968-44f2-950d-b04c0af6cb13.2f06a3d2-21b9-44ec-b382-c6ac1e1f683a" returned: 0 in 0.396s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:47:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8191110c-29f3-4fed-8ebb-cc16137bec74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Lock "cinder-quobyte-2f06a3d2-21b9-44ec-b382-c6ac1e1f683a" released by "_delete_snapshot" :: held 1.914s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:47:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8191110c-29f3-4fed-8ebb-cc16137bec74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Lock "cinder-quobyte-9c56c185-e968-44f2-950d-b04c0af6cb13" released by "delete_snapshot" :: held 1.956s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:47:19 devstack cinder-volume[86916]: WARNING cinder.quota [None req-8191110c-29f3-4fed-8ebb-cc16137bec74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 11:47:19 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-8191110c-29f3-4fed-8ebb-cc16137bec74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Created reservations ['78abd10c-b46e-413f-9481-5ea2b527269b', '8a4ad0be-7488-4325-bd82-067e14cb25df', '32f78290-45a9-475b-a86e-6982618183fa', '9d184cfb-02d2-4b6e-9cce-cd4c95589f00'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:47:19 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-8191110c-29f3-4fed-8ebb-cc16137bec74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Delete snapshot completed successfully. Sep 28 11:47:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8191110c-29f3-4fed-8ebb-cc16137bec74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Lock "cinder-2f06a3d2-21b9-44ec-b382-c6ac1e1f683a-delete_snapshot" released by "delete_snapshot" :: held 2.157s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:47:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f5d8ed4b-88d8-4bdd-a0a3-ca4ee7fff27c tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Acquiring lock "cinder-9c56c185-e968-44f2-950d-b04c0af6cb13-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:47:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f5d8ed4b-88d8-4bdd-a0a3-ca4ee7fff27c tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Lock "cinder-9c56c185-e968-44f2-950d-b04c0af6cb13-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:47:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f5d8ed4b-88d8-4bdd-a0a3-ca4ee7fff27c tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Acquiring lock "cinder-quobyte-9c56c185-e968-44f2-950d-b04c0af6cb13" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:47:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f5d8ed4b-88d8-4bdd-a0a3-ca4ee7fff27c tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Lock "cinder-quobyte-9c56c185-e968-44f2-950d-b04c0af6cb13" acquired by "delete_volume" :: waited 0.029s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:47:19 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad2b1af-328b-44bf-b069-37a7839ab602]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:47:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f5d8ed4b-88d8-4bdd-a0a3-ca4ee7fff27c tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9c56c185-e968-44f2-950d-b04c0af6cb13 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:47:20 devstack sudo[89907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9c56c185-e968-44f2-950d-b04c0af6cb13 Sep 28 11:47:20 devstack sudo[89907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:47:20 devstack sudo[89907]: pam_unix(sudo:session): session closed for user root Sep 28 11:47:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f5d8ed4b-88d8-4bdd-a0a3-ca4ee7fff27c tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9c56c185-e968-44f2-950d-b04c0af6cb13" returned: 0 in 0.484s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:47:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f5d8ed4b-88d8-4bdd-a0a3-ca4ee7fff27c tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9c56c185-e968-44f2-950d-b04c0af6cb13 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:47:20 devstack sudo[89912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9c56c185-e968-44f2-950d-b04c0af6cb13 Sep 28 11:47:20 devstack sudo[89912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:47:20 devstack sudo[89912]: pam_unix(sudo:session): session closed for user root Sep 28 11:47:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f5d8ed4b-88d8-4bdd-a0a3-ca4ee7fff27c tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9c56c185-e968-44f2-950d-b04c0af6cb13" returned: 0 in 0.280s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:47:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f5d8ed4b-88d8-4bdd-a0a3-ca4ee7fff27c tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Lock "cinder-quobyte-9c56c185-e968-44f2-950d-b04c0af6cb13" released by "delete_volume" :: held 0.851s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:47:20 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-f5d8ed4b-88d8-4bdd-a0a3-ca4ee7fff27c tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Created reservations ['b5ab40b4-3936-45b4-ae04-ac456ac2b873', '2f4332ce-1729-4d6a-8522-17877f2e510f', '29390929-b595-413b-9167-3ec562ade8d5', 'ca31fe39-b67b-4e6e-8ec1-92e1d27603d4'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:47:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f5d8ed4b-88d8-4bdd-a0a3-ca4ee7fff27c tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:47:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f5d8ed4b-88d8-4bdd-a0a3-ca4ee7fff27c tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:47:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f5d8ed4b-88d8-4bdd-a0a3-ca4ee7fff27c tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:47:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f5d8ed4b-88d8-4bdd-a0a3-ca4ee7fff27c tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:47:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f5d8ed4b-88d8-4bdd-a0a3-ca4ee7fff27c tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:47:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f5d8ed4b-88d8-4bdd-a0a3-ca4ee7fff27c tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:47:20 devstack sudo[89918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:47:20 devstack sudo[89918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:47:21 devstack sudo[89918]: pam_unix(sudo:session): session closed for user root Sep 28 11:47:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f5d8ed4b-88d8-4bdd-a0a3-ca4ee7fff27c tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.556s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:47:21 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-f5d8ed4b-88d8-4bdd-a0a3-ca4ee7fff27c tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:47:21 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-f5d8ed4b-88d8-4bdd-a0a3-ca4ee7fff27c tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Deleted volume successfully. Sep 28 11:47:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f5d8ed4b-88d8-4bdd-a0a3-ca4ee7fff27c tempest-VolumeSnapshotQuotasNegativeTestJSON-1579344797 None] Lock "cinder-9c56c185-e968-44f2-950d-b04c0af6cb13-delete_volume" released by "delete_volume" :: held 1.759s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:47:30 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:UPDATE=16,cinder:SELECT=19,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 11:47:31 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=13,cinder:UPDATE=20,cinder:INSERT=5,cinder:DELETE=2 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 11:47:38 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 11:47:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:47:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:47:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:47:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:47:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:47:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:47:38 devstack sudo[90185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:47:38 devstack sudo[90185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:47:39 devstack sudo[90185]: pam_unix(sudo:session): session closed for user root Sep 28 11:47:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.745s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:47:39 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:47:39 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 11:47:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] thread count: 8 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 11:47:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] thread info: [<_MainThread(MainThread, started 135408582168704)>, , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 11:47:40 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-66b9aec0-723c-42c1-8cac-9f0767ff643c tempest-VolumesMetadataTest-1317617113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:47:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-66b9aec0-723c-42c1-8cac-9f0767ff643c tempest-VolumesMetadataTest-1317617113 None] Flow 'volume_create_manager' (7c3eac73-f522-4e17-af95-cf0b7a7a9779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:47:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-66b9aec0-723c-42c1-8cac-9f0767ff643c tempest-VolumesMetadataTest-1317617113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (092dc72b-d70f-40bc-8268-fc9ec0137657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:47:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-66b9aec0-723c-42c1-8cac-9f0767ff643c tempest-VolumesMetadataTest-1317617113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (092dc72b-d70f-40bc-8268-fc9ec0137657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:47:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1318033254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5de7e832-dcd6-43db-bf7d-44703fd0eb8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e12836460c74abaa6aa789793d1eabe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:47:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:47:41Z,use_quota=True,user_id='ec520e374f8f4d71b2a3ada54bafc0d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:47:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-66b9aec0-723c-42c1-8cac-9f0767ff643c tempest-VolumesMetadataTest-1317617113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7c1847a-2f1a-46fa-8b30-bfd8ee5b92d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:47:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-66b9aec0-723c-42c1-8cac-9f0767ff643c tempest-VolumesMetadataTest-1317617113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7c1847a-2f1a-46fa-8b30-bfd8ee5b92d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:47:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-66b9aec0-723c-42c1-8cac-9f0767ff643c tempest-VolumesMetadataTest-1317617113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fee3885-7d86-4957-a664-efad19712c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:47:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-66b9aec0-723c-42c1-8cac-9f0767ff643c tempest-VolumesMetadataTest-1317617113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fee3885-7d86-4957-a664-efad19712c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5de7e832-dcd6-43db-bf7d-44703fd0eb8c', 'volume_name': 'volume-5de7e832-dcd6-43db-bf7d-44703fd0eb8c', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:47:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-66b9aec0-723c-42c1-8cac-9f0767ff643c tempest-VolumesMetadataTest-1317617113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dc7cb43-9240-4bc1-98a0-f2676587428a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:47:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-66b9aec0-723c-42c1-8cac-9f0767ff643c tempest-VolumesMetadataTest-1317617113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dc7cb43-9240-4bc1-98a0-f2676587428a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:47:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-66b9aec0-723c-42c1-8cac-9f0767ff643c tempest-VolumesMetadataTest-1317617113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baf25c92-3c88-431d-8695-54d686be3595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:47:41 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-66b9aec0-723c-42c1-8cac-9f0767ff643c tempest-VolumesMetadataTest-1317617113 None] Volume 5de7e832-dcd6-43db-bf7d-44703fd0eb8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5de7e832-dcd6-43db-bf7d-44703fd0eb8c', 'volume_size': 1} Sep 28 11:47:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-66b9aec0-723c-42c1-8cac-9f0767ff643c tempest-VolumesMetadataTest-1317617113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:47:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-66b9aec0-723c-42c1-8cac-9f0767ff643c tempest-VolumesMetadataTest-1317617113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:47:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-66b9aec0-723c-42c1-8cac-9f0767ff643c tempest-VolumesMetadataTest-1317617113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:47:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1318033254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5de7e832-dcd6-43db-bf7d-44703fd0eb8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e12836460c74abaa6aa789793d1eabe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:47:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:47:41Z,use_quota=True,user_id='ec520e374f8f4d71b2a3ada54bafc0d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:47:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-66b9aec0-723c-42c1-8cac-9f0767ff643c tempest-VolumesMetadataTest-1317617113 None] Creating volume 5de7e832-dcd6-43db-bf7d-44703fd0eb8c {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:47:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-66b9aec0-723c-42c1-8cac-9f0767ff643c tempest-VolumesMetadataTest-1317617113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:47:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-66b9aec0-723c-42c1-8cac-9f0767ff643c tempest-VolumesMetadataTest-1317617113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:47:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-66b9aec0-723c-42c1-8cac-9f0767ff643c tempest-VolumesMetadataTest-1317617113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:47:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-66b9aec0-723c-42c1-8cac-9f0767ff643c tempest-VolumesMetadataTest-1317617113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:47:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-66b9aec0-723c-42c1-8cac-9f0767ff643c tempest-VolumesMetadataTest-1317617113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:47:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-66b9aec0-723c-42c1-8cac-9f0767ff643c tempest-VolumesMetadataTest-1317617113 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:47:41 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-66b9aec0-723c-42c1-8cac-9f0767ff643c tempest-VolumesMetadataTest-1317617113 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:47:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-66b9aec0-723c-42c1-8cac-9f0767ff643c tempest-VolumesMetadataTest-1317617113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5de7e832-dcd6-43db-bf7d-44703fd0eb8c 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:47:41 devstack sudo[90211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5de7e832-dcd6-43db-bf7d-44703fd0eb8c 1073741824 Sep 28 11:47:41 devstack sudo[90211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:47:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-66b9aec0-723c-42c1-8cac-9f0767ff643c tempest-VolumesMetadataTest-1317617113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5de7e832-dcd6-43db-bf7d-44703fd0eb8c 1073741824" returned: 0 in 1.420s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:47:42 devstack sudo[90211]: pam_unix(sudo:session): session closed for user root Sep 28 11:47:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-66b9aec0-723c-42c1-8cac-9f0767ff643c tempest-VolumesMetadataTest-1317617113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5de7e832-dcd6-43db-bf7d-44703fd0eb8c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:47:42 devstack sudo[90233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5de7e832-dcd6-43db-bf7d-44703fd0eb8c Sep 28 11:47:42 devstack sudo[90233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:47:43 devstack sudo[90233]: pam_unix(sudo:session): session closed for user root Sep 28 11:47:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-66b9aec0-723c-42c1-8cac-9f0767ff643c tempest-VolumesMetadataTest-1317617113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5de7e832-dcd6-43db-bf7d-44703fd0eb8c" returned: 0 in 0.566s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:47:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-66b9aec0-723c-42c1-8cac-9f0767ff643c tempest-VolumesMetadataTest-1317617113 None] <== create_volume: return (2080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:47:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-66b9aec0-723c-42c1-8cac-9f0767ff643c tempest-VolumesMetadataTest-1317617113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.088s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:47:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-66b9aec0-723c-42c1-8cac-9f0767ff643c tempest-VolumesMetadataTest-1317617113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baf25c92-3c88-431d-8695-54d686be3595) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5de7e832-dcd6-43db-bf7d-44703fd0eb8c', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:47:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-66b9aec0-723c-42c1-8cac-9f0767ff643c tempest-VolumesMetadataTest-1317617113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3888bbe-99eb-4f43-a15f-2b3fe18a50eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:47:43 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-66b9aec0-723c-42c1-8cac-9f0767ff643c tempest-VolumesMetadataTest-1317617113 None] Volume volume-5de7e832-dcd6-43db-bf7d-44703fd0eb8c (5de7e832-dcd6-43db-bf7d-44703fd0eb8c): created successfully Sep 28 11:47:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-66b9aec0-723c-42c1-8cac-9f0767ff643c tempest-VolumesMetadataTest-1317617113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3888bbe-99eb-4f43-a15f-2b3fe18a50eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:47:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-66b9aec0-723c-42c1-8cac-9f0767ff643c tempest-VolumesMetadataTest-1317617113 None] Flow 'volume_create_manager' (7c3eac73-f522-4e17-af95-cf0b7a7a9779) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:47:43 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-66b9aec0-723c-42c1-8cac-9f0767ff643c tempest-VolumesMetadataTest-1317617113 None] Created volume successfully. Sep 28 11:47:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-68533951-ea15-4b29-a89b-52f99195941d tempest-VolumesMetadataTest-1317617113 None] Acquiring lock "cinder-5de7e832-dcd6-43db-bf7d-44703fd0eb8c-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:47:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-68533951-ea15-4b29-a89b-52f99195941d tempest-VolumesMetadataTest-1317617113 None] Lock "cinder-5de7e832-dcd6-43db-bf7d-44703fd0eb8c-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:47:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-68533951-ea15-4b29-a89b-52f99195941d tempest-VolumesMetadataTest-1317617113 None] Acquiring lock "cinder-quobyte-5de7e832-dcd6-43db-bf7d-44703fd0eb8c" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:47:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-68533951-ea15-4b29-a89b-52f99195941d tempest-VolumesMetadataTest-1317617113 None] Lock "cinder-quobyte-5de7e832-dcd6-43db-bf7d-44703fd0eb8c" acquired by "delete_volume" :: waited 0.028s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:47:46 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[329ad9e2-be55-4f5d-b8cf-589a81461093]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:47:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-68533951-ea15-4b29-a89b-52f99195941d tempest-VolumesMetadataTest-1317617113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5de7e832-dcd6-43db-bf7d-44703fd0eb8c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:47:46 devstack sudo[90301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5de7e832-dcd6-43db-bf7d-44703fd0eb8c Sep 28 11:47:46 devstack sudo[90301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:47:46 devstack sudo[90301]: pam_unix(sudo:session): session closed for user root Sep 28 11:47:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-68533951-ea15-4b29-a89b-52f99195941d tempest-VolumesMetadataTest-1317617113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5de7e832-dcd6-43db-bf7d-44703fd0eb8c" returned: 0 in 0.675s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:47:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-68533951-ea15-4b29-a89b-52f99195941d tempest-VolumesMetadataTest-1317617113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5de7e832-dcd6-43db-bf7d-44703fd0eb8c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:47:47 devstack sudo[90308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5de7e832-dcd6-43db-bf7d-44703fd0eb8c Sep 28 11:47:47 devstack sudo[90308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:47:47 devstack sudo[90308]: pam_unix(sudo:session): session closed for user root Sep 28 11:47:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-68533951-ea15-4b29-a89b-52f99195941d tempest-VolumesMetadataTest-1317617113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5de7e832-dcd6-43db-bf7d-44703fd0eb8c" returned: 0 in 0.433s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:47:47 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-68533951-ea15-4b29-a89b-52f99195941d tempest-VolumesMetadataTest-1317617113 None] Lock "cinder-quobyte-5de7e832-dcd6-43db-bf7d-44703fd0eb8c" released by "delete_volume" :: held 1.206s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:47:47 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-68533951-ea15-4b29-a89b-52f99195941d tempest-VolumesMetadataTest-1317617113 None] Created reservations ['b753be54-027e-4f26-a573-37046ed1d062', '54034c6f-c3bd-4574-a257-98ed395c877e', '1a184ddd-5313-4f5a-b378-f338bccd7bea', '623ab2cf-24e1-47c2-b6b5-adb2c7c9e114'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:47:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-68533951-ea15-4b29-a89b-52f99195941d tempest-VolumesMetadataTest-1317617113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:47:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-68533951-ea15-4b29-a89b-52f99195941d tempest-VolumesMetadataTest-1317617113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:47:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-68533951-ea15-4b29-a89b-52f99195941d tempest-VolumesMetadataTest-1317617113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:47:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-68533951-ea15-4b29-a89b-52f99195941d tempest-VolumesMetadataTest-1317617113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:47:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-68533951-ea15-4b29-a89b-52f99195941d tempest-VolumesMetadataTest-1317617113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:47:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-68533951-ea15-4b29-a89b-52f99195941d tempest-VolumesMetadataTest-1317617113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:47:47 devstack sudo[90312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:47:47 devstack sudo[90312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:47:48 devstack sudo[90312]: pam_unix(sudo:session): session closed for user root Sep 28 11:47:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-68533951-ea15-4b29-a89b-52f99195941d tempest-VolumesMetadataTest-1317617113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.589s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:47:48 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-68533951-ea15-4b29-a89b-52f99195941d tempest-VolumesMetadataTest-1317617113 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:47:48 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-68533951-ea15-4b29-a89b-52f99195941d tempest-VolumesMetadataTest-1317617113 None] Deleted volume successfully. Sep 28 11:47:48 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-68533951-ea15-4b29-a89b-52f99195941d tempest-VolumesMetadataTest-1317617113 None] Lock "cinder-5de7e832-dcd6-43db-bf7d-44703fd0eb8c-delete_volume" released by "delete_volume" :: held 2.148s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:47:51 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-a66ef1be-b6b8-4117-828f-8969672dfb46 tempest-ServerRescueNegativeTestJSON-1103361569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:47:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a66ef1be-b6b8-4117-828f-8969672dfb46 tempest-ServerRescueNegativeTestJSON-1103361569 None] Flow 'volume_create_manager' (197179e0-3801-4917-98e5-ca17b1f82d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:47:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a66ef1be-b6b8-4117-828f-8969672dfb46 tempest-ServerRescueNegativeTestJSON-1103361569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9595cbc9-9bec-4453-b415-ca35bac3363f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:47:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a66ef1be-b6b8-4117-828f-8969672dfb46 tempest-ServerRescueNegativeTestJSON-1103361569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9595cbc9-9bec-4453-b415-ca35bac3363f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:47:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-772363778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc52ec82-5def-4b02-a595-2d56e6b3a0fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8badf0fc4624469fa406fa63f2e3e645',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:47:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:47:52Z,use_quota=True,user_id='23e793bec752499cb1a9f5b79818ee8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:47:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a66ef1be-b6b8-4117-828f-8969672dfb46 tempest-ServerRescueNegativeTestJSON-1103361569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb7ea169-27f9-4dfe-8916-416517a38557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:47:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a66ef1be-b6b8-4117-828f-8969672dfb46 tempest-ServerRescueNegativeTestJSON-1103361569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb7ea169-27f9-4dfe-8916-416517a38557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:47:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a66ef1be-b6b8-4117-828f-8969672dfb46 tempest-ServerRescueNegativeTestJSON-1103361569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (856de500-44c3-4ea7-9dd6-8f687963e99c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:47:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a66ef1be-b6b8-4117-828f-8969672dfb46 tempest-ServerRescueNegativeTestJSON-1103361569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (856de500-44c3-4ea7-9dd6-8f687963e99c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc52ec82-5def-4b02-a595-2d56e6b3a0fc', 'volume_name': 'volume-cc52ec82-5def-4b02-a595-2d56e6b3a0fc', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:47:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a66ef1be-b6b8-4117-828f-8969672dfb46 tempest-ServerRescueNegativeTestJSON-1103361569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30f9d823-6d4d-466e-b7af-acf7647494c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:47:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a66ef1be-b6b8-4117-828f-8969672dfb46 tempest-ServerRescueNegativeTestJSON-1103361569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30f9d823-6d4d-466e-b7af-acf7647494c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:47:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a66ef1be-b6b8-4117-828f-8969672dfb46 tempest-ServerRescueNegativeTestJSON-1103361569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8213ce0-9f34-4dc3-ada9-2bc9abbc424b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:47:51 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-a66ef1be-b6b8-4117-828f-8969672dfb46 tempest-ServerRescueNegativeTestJSON-1103361569 None] Volume cc52ec82-5def-4b02-a595-2d56e6b3a0fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc52ec82-5def-4b02-a595-2d56e6b3a0fc', 'volume_size': 1} Sep 28 11:47:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a66ef1be-b6b8-4117-828f-8969672dfb46 tempest-ServerRescueNegativeTestJSON-1103361569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:47:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a66ef1be-b6b8-4117-828f-8969672dfb46 tempest-ServerRescueNegativeTestJSON-1103361569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:47:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a66ef1be-b6b8-4117-828f-8969672dfb46 tempest-ServerRescueNegativeTestJSON-1103361569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:47:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-772363778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc52ec82-5def-4b02-a595-2d56e6b3a0fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8badf0fc4624469fa406fa63f2e3e645',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:47:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:47:52Z,use_quota=True,user_id='23e793bec752499cb1a9f5b79818ee8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:47:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-a66ef1be-b6b8-4117-828f-8969672dfb46 tempest-ServerRescueNegativeTestJSON-1103361569 None] Creating volume cc52ec82-5def-4b02-a595-2d56e6b3a0fc {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:47:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a66ef1be-b6b8-4117-828f-8969672dfb46 tempest-ServerRescueNegativeTestJSON-1103361569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:47:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a66ef1be-b6b8-4117-828f-8969672dfb46 tempest-ServerRescueNegativeTestJSON-1103361569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:47:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a66ef1be-b6b8-4117-828f-8969672dfb46 tempest-ServerRescueNegativeTestJSON-1103361569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:47:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a66ef1be-b6b8-4117-828f-8969672dfb46 tempest-ServerRescueNegativeTestJSON-1103361569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:47:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a66ef1be-b6b8-4117-828f-8969672dfb46 tempest-ServerRescueNegativeTestJSON-1103361569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:47:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a66ef1be-b6b8-4117-828f-8969672dfb46 tempest-ServerRescueNegativeTestJSON-1103361569 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:47:51 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-a66ef1be-b6b8-4117-828f-8969672dfb46 tempest-ServerRescueNegativeTestJSON-1103361569 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:47:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a66ef1be-b6b8-4117-828f-8969672dfb46 tempest-ServerRescueNegativeTestJSON-1103361569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cc52ec82-5def-4b02-a595-2d56e6b3a0fc 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:47:51 devstack sudo[90368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cc52ec82-5def-4b02-a595-2d56e6b3a0fc 1073741824 Sep 28 11:47:51 devstack sudo[90368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:47:53 devstack sudo[90368]: pam_unix(sudo:session): session closed for user root Sep 28 11:47:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a66ef1be-b6b8-4117-828f-8969672dfb46 tempest-ServerRescueNegativeTestJSON-1103361569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cc52ec82-5def-4b02-a595-2d56e6b3a0fc 1073741824" returned: 0 in 1.583s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:47:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a66ef1be-b6b8-4117-828f-8969672dfb46 tempest-ServerRescueNegativeTestJSON-1103361569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cc52ec82-5def-4b02-a595-2d56e6b3a0fc {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:47:53 devstack sudo[90407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cc52ec82-5def-4b02-a595-2d56e6b3a0fc Sep 28 11:47:53 devstack sudo[90407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:47:54 devstack sudo[90407]: pam_unix(sudo:session): session closed for user root Sep 28 11:47:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a66ef1be-b6b8-4117-828f-8969672dfb46 tempest-ServerRescueNegativeTestJSON-1103361569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cc52ec82-5def-4b02-a595-2d56e6b3a0fc" returned: 0 in 0.611s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:47:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a66ef1be-b6b8-4117-828f-8969672dfb46 tempest-ServerRescueNegativeTestJSON-1103361569 None] <== create_volume: return (2358ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:47:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a66ef1be-b6b8-4117-828f-8969672dfb46 tempest-ServerRescueNegativeTestJSON-1103361569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.361s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:47:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a66ef1be-b6b8-4117-828f-8969672dfb46 tempest-ServerRescueNegativeTestJSON-1103361569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8213ce0-9f34-4dc3-ada9-2bc9abbc424b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc52ec82-5def-4b02-a595-2d56e6b3a0fc', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:47:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a66ef1be-b6b8-4117-828f-8969672dfb46 tempest-ServerRescueNegativeTestJSON-1103361569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50a2cde6-4da5-439e-82ae-bc86ad8f5dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:47:54 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-a66ef1be-b6b8-4117-828f-8969672dfb46 tempest-ServerRescueNegativeTestJSON-1103361569 None] Volume volume-cc52ec82-5def-4b02-a595-2d56e6b3a0fc (cc52ec82-5def-4b02-a595-2d56e6b3a0fc): created successfully Sep 28 11:47:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a66ef1be-b6b8-4117-828f-8969672dfb46 tempest-ServerRescueNegativeTestJSON-1103361569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50a2cde6-4da5-439e-82ae-bc86ad8f5dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:47:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a66ef1be-b6b8-4117-828f-8969672dfb46 tempest-ServerRescueNegativeTestJSON-1103361569 None] Flow 'volume_create_manager' (197179e0-3801-4917-98e5-ca17b1f82d62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:47:54 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-a66ef1be-b6b8-4117-828f-8969672dfb46 tempest-ServerRescueNegativeTestJSON-1103361569 None] Created volume successfully. Sep 28 11:48:01 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-8708d670-b965-402b-a8e9-837800ca3a78 tempest-VolumesTransfersV357Test-1095447592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:48:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8708d670-b965-402b-a8e9-837800ca3a78 tempest-VolumesTransfersV357Test-1095447592 None] Flow 'volume_create_manager' (6565565d-4e6c-4e7c-8111-1578c942ae2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:48:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8708d670-b965-402b-a8e9-837800ca3a78 tempest-VolumesTransfersV357Test-1095447592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (679603f3-b735-4260-9dca-33ed3c54d416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:48:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8708d670-b965-402b-a8e9-837800ca3a78 tempest-VolumesTransfersV357Test-1095447592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (679603f3-b735-4260-9dca-33ed3c54d416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:48:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-568536305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=176941b5-963c-4de4-aaa7-2e7b41391cf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1667d19f68f749aaa51145ccbc1fea58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:48:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:48:01Z,use_quota=True,user_id='e3346b8a86b94cf497ae76197e330dfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:48:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8708d670-b965-402b-a8e9-837800ca3a78 tempest-VolumesTransfersV357Test-1095447592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2fbc5f4-a046-4247-b836-16db02f9afe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:48:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8708d670-b965-402b-a8e9-837800ca3a78 tempest-VolumesTransfersV357Test-1095447592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2fbc5f4-a046-4247-b836-16db02f9afe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:48:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8708d670-b965-402b-a8e9-837800ca3a78 tempest-VolumesTransfersV357Test-1095447592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c3b2fbd-3164-4e2b-af5e-f9c931702788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:48:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8708d670-b965-402b-a8e9-837800ca3a78 tempest-VolumesTransfersV357Test-1095447592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c3b2fbd-3164-4e2b-af5e-f9c931702788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '176941b5-963c-4de4-aaa7-2e7b41391cf2', 'volume_name': 'volume-176941b5-963c-4de4-aaa7-2e7b41391cf2', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:48:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8708d670-b965-402b-a8e9-837800ca3a78 tempest-VolumesTransfersV357Test-1095447592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fb2d012-d51f-4a1e-939a-f006cd6661ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:48:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8708d670-b965-402b-a8e9-837800ca3a78 tempest-VolumesTransfersV357Test-1095447592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fb2d012-d51f-4a1e-939a-f006cd6661ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:48:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8708d670-b965-402b-a8e9-837800ca3a78 tempest-VolumesTransfersV357Test-1095447592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d59178d-2533-44e7-9f77-621b79f10bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:48:01 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-8708d670-b965-402b-a8e9-837800ca3a78 tempest-VolumesTransfersV357Test-1095447592 None] Volume 176941b5-963c-4de4-aaa7-2e7b41391cf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-176941b5-963c-4de4-aaa7-2e7b41391cf2', 'volume_size': 1} Sep 28 11:48:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8708d670-b965-402b-a8e9-837800ca3a78 tempest-VolumesTransfersV357Test-1095447592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:48:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8708d670-b965-402b-a8e9-837800ca3a78 tempest-VolumesTransfersV357Test-1095447592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:48:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8708d670-b965-402b-a8e9-837800ca3a78 tempest-VolumesTransfersV357Test-1095447592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:48:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-568536305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=176941b5-963c-4de4-aaa7-2e7b41391cf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1667d19f68f749aaa51145ccbc1fea58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:48:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:48:01Z,use_quota=True,user_id='e3346b8a86b94cf497ae76197e330dfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:48:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-8708d670-b965-402b-a8e9-837800ca3a78 tempest-VolumesTransfersV357Test-1095447592 None] Creating volume 176941b5-963c-4de4-aaa7-2e7b41391cf2 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:48:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8708d670-b965-402b-a8e9-837800ca3a78 tempest-VolumesTransfersV357Test-1095447592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:48:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8708d670-b965-402b-a8e9-837800ca3a78 tempest-VolumesTransfersV357Test-1095447592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:48:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8708d670-b965-402b-a8e9-837800ca3a78 tempest-VolumesTransfersV357Test-1095447592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:48:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8708d670-b965-402b-a8e9-837800ca3a78 tempest-VolumesTransfersV357Test-1095447592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:48:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8708d670-b965-402b-a8e9-837800ca3a78 tempest-VolumesTransfersV357Test-1095447592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:48:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8708d670-b965-402b-a8e9-837800ca3a78 tempest-VolumesTransfersV357Test-1095447592 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:48:01 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-8708d670-b965-402b-a8e9-837800ca3a78 tempest-VolumesTransfersV357Test-1095447592 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:48:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8708d670-b965-402b-a8e9-837800ca3a78 tempest-VolumesTransfersV357Test-1095447592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-176941b5-963c-4de4-aaa7-2e7b41391cf2 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:48:01 devstack sudo[90543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-176941b5-963c-4de4-aaa7-2e7b41391cf2 1073741824 Sep 28 11:48:01 devstack sudo[90543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:48:02 devstack sudo[90543]: pam_unix(sudo:session): session closed for user root Sep 28 11:48:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8708d670-b965-402b-a8e9-837800ca3a78 tempest-VolumesTransfersV357Test-1095447592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-176941b5-963c-4de4-aaa7-2e7b41391cf2 1073741824" returned: 0 in 0.767s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:48:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8708d670-b965-402b-a8e9-837800ca3a78 tempest-VolumesTransfersV357Test-1095447592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-176941b5-963c-4de4-aaa7-2e7b41391cf2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:48:02 devstack sudo[90551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-176941b5-963c-4de4-aaa7-2e7b41391cf2 Sep 28 11:48:02 devstack sudo[90551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:48:02 devstack sudo[90551]: pam_unix(sudo:session): session closed for user root Sep 28 11:48:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8708d670-b965-402b-a8e9-837800ca3a78 tempest-VolumesTransfersV357Test-1095447592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-176941b5-963c-4de4-aaa7-2e7b41391cf2" returned: 0 in 0.512s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:48:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8708d670-b965-402b-a8e9-837800ca3a78 tempest-VolumesTransfersV357Test-1095447592 None] <== create_volume: return (1374ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:48:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8708d670-b965-402b-a8e9-837800ca3a78 tempest-VolumesTransfersV357Test-1095447592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.377s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:48:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8708d670-b965-402b-a8e9-837800ca3a78 tempest-VolumesTransfersV357Test-1095447592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d59178d-2533-44e7-9f77-621b79f10bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-176941b5-963c-4de4-aaa7-2e7b41391cf2', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:48:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8708d670-b965-402b-a8e9-837800ca3a78 tempest-VolumesTransfersV357Test-1095447592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50d4569f-eb42-44f0-9eba-1d340ae95677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:48:03 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-8708d670-b965-402b-a8e9-837800ca3a78 tempest-VolumesTransfersV357Test-1095447592 None] Volume volume-176941b5-963c-4de4-aaa7-2e7b41391cf2 (176941b5-963c-4de4-aaa7-2e7b41391cf2): created successfully Sep 28 11:48:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8708d670-b965-402b-a8e9-837800ca3a78 tempest-VolumesTransfersV357Test-1095447592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50d4569f-eb42-44f0-9eba-1d340ae95677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:48:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8708d670-b965-402b-a8e9-837800ca3a78 tempest-VolumesTransfersV357Test-1095447592 None] Flow 'volume_create_manager' (6565565d-4e6c-4e7c-8111-1578c942ae2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:48:03 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-8708d670-b965-402b-a8e9-837800ca3a78 tempest-VolumesTransfersV357Test-1095447592 None] Created volume successfully. Sep 28 11:48:05 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b3d7ab19-c31d-4049-a9ee-8a6c6bdfdfb6 tempest-VolumesTransfersV357Test-421869261 None] Transfer volume completed successfully. Sep 28 11:48:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-634c2a72-0e2e-4011-b54f-9945a63bb129 tempest-VolumesTransfersV357Test-433397778 None] Acquiring lock "cinder-176941b5-963c-4de4-aaa7-2e7b41391cf2-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:48:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-634c2a72-0e2e-4011-b54f-9945a63bb129 tempest-VolumesTransfersV357Test-433397778 None] Lock "cinder-176941b5-963c-4de4-aaa7-2e7b41391cf2-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:48:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-634c2a72-0e2e-4011-b54f-9945a63bb129 tempest-VolumesTransfersV357Test-433397778 None] Acquiring lock "cinder-quobyte-176941b5-963c-4de4-aaa7-2e7b41391cf2" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:48:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-634c2a72-0e2e-4011-b54f-9945a63bb129 tempest-VolumesTransfersV357Test-433397778 None] Lock "cinder-quobyte-176941b5-963c-4de4-aaa7-2e7b41391cf2" acquired by "delete_volume" :: waited 0.026s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:48:06 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba8f324-8811-4d7c-841a-9fca8c914a9c]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:48:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-634c2a72-0e2e-4011-b54f-9945a63bb129 tempest-VolumesTransfersV357Test-433397778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-176941b5-963c-4de4-aaa7-2e7b41391cf2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:48:06 devstack sudo[90655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-176941b5-963c-4de4-aaa7-2e7b41391cf2 Sep 28 11:48:06 devstack sudo[90655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:48:07 devstack sudo[90655]: pam_unix(sudo:session): session closed for user root Sep 28 11:48:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-634c2a72-0e2e-4011-b54f-9945a63bb129 tempest-VolumesTransfersV357Test-433397778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-176941b5-963c-4de4-aaa7-2e7b41391cf2" returned: 0 in 0.524s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:48:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-634c2a72-0e2e-4011-b54f-9945a63bb129 tempest-VolumesTransfersV357Test-433397778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-176941b5-963c-4de4-aaa7-2e7b41391cf2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:48:07 devstack sudo[90678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-176941b5-963c-4de4-aaa7-2e7b41391cf2 Sep 28 11:48:07 devstack sudo[90678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:48:07 devstack sudo[90678]: pam_unix(sudo:session): session closed for user root Sep 28 11:48:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-634c2a72-0e2e-4011-b54f-9945a63bb129 tempest-VolumesTransfersV357Test-433397778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-176941b5-963c-4de4-aaa7-2e7b41391cf2" returned: 0 in 0.548s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:48:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-634c2a72-0e2e-4011-b54f-9945a63bb129 tempest-VolumesTransfersV357Test-433397778 None] Lock "cinder-quobyte-176941b5-963c-4de4-aaa7-2e7b41391cf2" released by "delete_volume" :: held 1.126s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:48:08 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-634c2a72-0e2e-4011-b54f-9945a63bb129 tempest-VolumesTransfersV357Test-433397778 None] Created reservations ['af68fcfc-9e72-4b19-9a16-39999733e6a0', '9b13d076-5cbb-4ef1-8ac3-d8aeaba54c33', '8fb474f9-c11d-43e6-9f32-708f2f4cfaf1', '93b20742-186b-40fe-b2dd-3b2315c81b2b'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:48:08 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e67594a-d0e3-442b-87cf-c1dd4b475389 tempest-AttachVolumeShelveTestJSON-777856843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:48:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2e67594a-d0e3-442b-87cf-c1dd4b475389 tempest-AttachVolumeShelveTestJSON-777856843 None] Flow 'volume_create_manager' (d888fff6-7658-4923-9188-8752708a348b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:48:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2e67594a-d0e3-442b-87cf-c1dd4b475389 tempest-AttachVolumeShelveTestJSON-777856843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ab4121d-1342-47cf-9cda-ceb2c892bd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:48:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2e67594a-d0e3-442b-87cf-c1dd4b475389 tempest-AttachVolumeShelveTestJSON-777856843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ab4121d-1342-47cf-9cda-ceb2c892bd6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:48:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-522808374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5077fdc9-b0b6-48c8-98f5-050b7b6e1a8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae5cf14a3f0f45cbaf0b598eea131cdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:48:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:48:08Z,use_quota=True,user_id='d6f594807c2d483986f4da5d35e6f5f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:48:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2e67594a-d0e3-442b-87cf-c1dd4b475389 tempest-AttachVolumeShelveTestJSON-777856843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (606e3a04-e7c0-4682-b45b-ec440b17a834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:48:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2e67594a-d0e3-442b-87cf-c1dd4b475389 tempest-AttachVolumeShelveTestJSON-777856843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (606e3a04-e7c0-4682-b45b-ec440b17a834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:48:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2e67594a-d0e3-442b-87cf-c1dd4b475389 tempest-AttachVolumeShelveTestJSON-777856843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7265f694-382d-4303-832a-c6191e55257d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:48:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2e67594a-d0e3-442b-87cf-c1dd4b475389 tempest-AttachVolumeShelveTestJSON-777856843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7265f694-382d-4303-832a-c6191e55257d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5077fdc9-b0b6-48c8-98f5-050b7b6e1a8a', 'volume_name': 'volume-5077fdc9-b0b6-48c8-98f5-050b7b6e1a8a', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:48:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2e67594a-d0e3-442b-87cf-c1dd4b475389 tempest-AttachVolumeShelveTestJSON-777856843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c694602a-1cfa-42cc-992c-1b39a1f5578e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:48:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2e67594a-d0e3-442b-87cf-c1dd4b475389 tempest-AttachVolumeShelveTestJSON-777856843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c694602a-1cfa-42cc-992c-1b39a1f5578e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:48:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2e67594a-d0e3-442b-87cf-c1dd4b475389 tempest-AttachVolumeShelveTestJSON-777856843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d5fff74-8c2c-4178-845f-66976d3589eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:48:08 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-2e67594a-d0e3-442b-87cf-c1dd4b475389 tempest-AttachVolumeShelveTestJSON-777856843 None] Volume 5077fdc9-b0b6-48c8-98f5-050b7b6e1a8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5077fdc9-b0b6-48c8-98f5-050b7b6e1a8a', 'volume_size': 1} Sep 28 11:48:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2e67594a-d0e3-442b-87cf-c1dd4b475389 tempest-AttachVolumeShelveTestJSON-777856843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:48:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2e67594a-d0e3-442b-87cf-c1dd4b475389 tempest-AttachVolumeShelveTestJSON-777856843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:48:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2e67594a-d0e3-442b-87cf-c1dd4b475389 tempest-AttachVolumeShelveTestJSON-777856843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:48:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-522808374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5077fdc9-b0b6-48c8-98f5-050b7b6e1a8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae5cf14a3f0f45cbaf0b598eea131cdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:48:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:48:08Z,use_quota=True,user_id='d6f594807c2d483986f4da5d35e6f5f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:48:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-2e67594a-d0e3-442b-87cf-c1dd4b475389 tempest-AttachVolumeShelveTestJSON-777856843 None] Creating volume 5077fdc9-b0b6-48c8-98f5-050b7b6e1a8a {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:48:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2e67594a-d0e3-442b-87cf-c1dd4b475389 tempest-AttachVolumeShelveTestJSON-777856843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:48:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2e67594a-d0e3-442b-87cf-c1dd4b475389 tempest-AttachVolumeShelveTestJSON-777856843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:48:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2e67594a-d0e3-442b-87cf-c1dd4b475389 tempest-AttachVolumeShelveTestJSON-777856843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:48:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2e67594a-d0e3-442b-87cf-c1dd4b475389 tempest-AttachVolumeShelveTestJSON-777856843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:48:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2e67594a-d0e3-442b-87cf-c1dd4b475389 tempest-AttachVolumeShelveTestJSON-777856843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:48:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2e67594a-d0e3-442b-87cf-c1dd4b475389 tempest-AttachVolumeShelveTestJSON-777856843 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:48:08 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-2e67594a-d0e3-442b-87cf-c1dd4b475389 tempest-AttachVolumeShelveTestJSON-777856843 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:48:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2e67594a-d0e3-442b-87cf-c1dd4b475389 tempest-AttachVolumeShelveTestJSON-777856843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5077fdc9-b0b6-48c8-98f5-050b7b6e1a8a 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:48:08 devstack sudo[90682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5077fdc9-b0b6-48c8-98f5-050b7b6e1a8a 1073741824 Sep 28 11:48:08 devstack sudo[90682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:48:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-634c2a72-0e2e-4011-b54f-9945a63bb129 tempest-VolumesTransfersV357Test-433397778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:48:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-634c2a72-0e2e-4011-b54f-9945a63bb129 tempest-VolumesTransfersV357Test-433397778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:48:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-634c2a72-0e2e-4011-b54f-9945a63bb129 tempest-VolumesTransfersV357Test-433397778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:48:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-634c2a72-0e2e-4011-b54f-9945a63bb129 tempest-VolumesTransfersV357Test-433397778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:48:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-634c2a72-0e2e-4011-b54f-9945a63bb129 tempest-VolumesTransfersV357Test-433397778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:48:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-634c2a72-0e2e-4011-b54f-9945a63bb129 tempest-VolumesTransfersV357Test-433397778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:48:08 devstack sudo[90684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:48:08 devstack sudo[90684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:48:08 devstack sudo[90684]: pam_unix(sudo:session): session closed for user root Sep 28 11:48:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-634c2a72-0e2e-4011-b54f-9945a63bb129 tempest-VolumesTransfersV357Test-433397778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.371s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:48:08 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-634c2a72-0e2e-4011-b54f-9945a63bb129 tempest-VolumesTransfersV357Test-433397778 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:48:08 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-634c2a72-0e2e-4011-b54f-9945a63bb129 tempest-VolumesTransfersV357Test-433397778 None] Deleted volume successfully. Sep 28 11:48:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-634c2a72-0e2e-4011-b54f-9945a63bb129 tempest-VolumesTransfersV357Test-433397778 None] Lock "cinder-176941b5-963c-4de4-aaa7-2e7b41391cf2-delete_volume" released by "delete_volume" :: held 2.151s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:48:08 devstack sudo[90682]: pam_unix(sudo:session): session closed for user root Sep 28 11:48:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2e67594a-d0e3-442b-87cf-c1dd4b475389 tempest-AttachVolumeShelveTestJSON-777856843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5077fdc9-b0b6-48c8-98f5-050b7b6e1a8a 1073741824" returned: 0 in 0.643s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:48:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2e67594a-d0e3-442b-87cf-c1dd4b475389 tempest-AttachVolumeShelveTestJSON-777856843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5077fdc9-b0b6-48c8-98f5-050b7b6e1a8a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:48:09 devstack sudo[90692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5077fdc9-b0b6-48c8-98f5-050b7b6e1a8a Sep 28 11:48:09 devstack sudo[90692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:48:09 devstack sudo[90692]: pam_unix(sudo:session): session closed for user root Sep 28 11:48:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2e67594a-d0e3-442b-87cf-c1dd4b475389 tempest-AttachVolumeShelveTestJSON-777856843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5077fdc9-b0b6-48c8-98f5-050b7b6e1a8a" returned: 0 in 0.299s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:48:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2e67594a-d0e3-442b-87cf-c1dd4b475389 tempest-AttachVolumeShelveTestJSON-777856843 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:48:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2e67594a-d0e3-442b-87cf-c1dd4b475389 tempest-AttachVolumeShelveTestJSON-777856843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:48:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2e67594a-d0e3-442b-87cf-c1dd4b475389 tempest-AttachVolumeShelveTestJSON-777856843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d5fff74-8c2c-4178-845f-66976d3589eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5077fdc9-b0b6-48c8-98f5-050b7b6e1a8a', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:48:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2e67594a-d0e3-442b-87cf-c1dd4b475389 tempest-AttachVolumeShelveTestJSON-777856843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a73080c-a46c-437e-9140-2d2ef64676e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:48:09 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-2e67594a-d0e3-442b-87cf-c1dd4b475389 tempest-AttachVolumeShelveTestJSON-777856843 None] Volume volume-5077fdc9-b0b6-48c8-98f5-050b7b6e1a8a (5077fdc9-b0b6-48c8-98f5-050b7b6e1a8a): created successfully Sep 28 11:48:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2e67594a-d0e3-442b-87cf-c1dd4b475389 tempest-AttachVolumeShelveTestJSON-777856843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a73080c-a46c-437e-9140-2d2ef64676e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:48:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2e67594a-d0e3-442b-87cf-c1dd4b475389 tempest-AttachVolumeShelveTestJSON-777856843 None] Flow 'volume_create_manager' (d888fff6-7658-4923-9188-8752708a348b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:48:09 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-2e67594a-d0e3-442b-87cf-c1dd4b475389 tempest-AttachVolumeShelveTestJSON-777856843 None] Created volume successfully. Sep 28 11:48:09 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fade3fa-d0e1-459f-931d-10e8b8b97f9f tempest-VolumesTransfersV357Test-1095447592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:48:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9fade3fa-d0e1-459f-931d-10e8b8b97f9f tempest-VolumesTransfersV357Test-1095447592 None] Flow 'volume_create_manager' (9392fd48-4daa-43bb-8dfc-133312df7267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:48:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9fade3fa-d0e1-459f-931d-10e8b8b97f9f tempest-VolumesTransfersV357Test-1095447592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d29bf593-b58e-46f4-a6e0-c226000f5069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:48:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9fade3fa-d0e1-459f-931d-10e8b8b97f9f tempest-VolumesTransfersV357Test-1095447592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d29bf593-b58e-46f4-a6e0-c226000f5069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:48:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1108741626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=390a60dd-753e-4d67-b99c-84cf35229c7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1667d19f68f749aaa51145ccbc1fea58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:48:10Z,use_quota=True,user_id='e3346b8a86b94cf497ae76197e330dfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:48:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9fade3fa-d0e1-459f-931d-10e8b8b97f9f tempest-VolumesTransfersV357Test-1095447592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aaadc7f-8191-4f3d-b200-4f11c4facf30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:48:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9fade3fa-d0e1-459f-931d-10e8b8b97f9f tempest-VolumesTransfersV357Test-1095447592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aaadc7f-8191-4f3d-b200-4f11c4facf30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:48:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9fade3fa-d0e1-459f-931d-10e8b8b97f9f tempest-VolumesTransfersV357Test-1095447592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dc153af-ac0f-4fe5-9ea3-786ed3091044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:48:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9fade3fa-d0e1-459f-931d-10e8b8b97f9f tempest-VolumesTransfersV357Test-1095447592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dc153af-ac0f-4fe5-9ea3-786ed3091044) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '390a60dd-753e-4d67-b99c-84cf35229c7a', 'volume_name': 'volume-390a60dd-753e-4d67-b99c-84cf35229c7a', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:48:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9fade3fa-d0e1-459f-931d-10e8b8b97f9f tempest-VolumesTransfersV357Test-1095447592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (662d58d6-a3f1-4bb0-a7fc-141d765aaf22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:48:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9fade3fa-d0e1-459f-931d-10e8b8b97f9f tempest-VolumesTransfersV357Test-1095447592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (662d58d6-a3f1-4bb0-a7fc-141d765aaf22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:48:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9fade3fa-d0e1-459f-931d-10e8b8b97f9f tempest-VolumesTransfersV357Test-1095447592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f887271f-31c6-4671-95b3-abf9ed32620f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:48:09 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-9fade3fa-d0e1-459f-931d-10e8b8b97f9f tempest-VolumesTransfersV357Test-1095447592 None] Volume 390a60dd-753e-4d67-b99c-84cf35229c7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-390a60dd-753e-4d67-b99c-84cf35229c7a', 'volume_size': 1} Sep 28 11:48:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9fade3fa-d0e1-459f-931d-10e8b8b97f9f tempest-VolumesTransfersV357Test-1095447592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:48:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9fade3fa-d0e1-459f-931d-10e8b8b97f9f tempest-VolumesTransfersV357Test-1095447592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:48:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9fade3fa-d0e1-459f-931d-10e8b8b97f9f tempest-VolumesTransfersV357Test-1095447592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:48:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1108741626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=390a60dd-753e-4d67-b99c-84cf35229c7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1667d19f68f749aaa51145ccbc1fea58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:48:10Z,use_quota=True,user_id='e3346b8a86b94cf497ae76197e330dfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:48:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-9fade3fa-d0e1-459f-931d-10e8b8b97f9f tempest-VolumesTransfersV357Test-1095447592 None] Creating volume 390a60dd-753e-4d67-b99c-84cf35229c7a {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:48:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9fade3fa-d0e1-459f-931d-10e8b8b97f9f tempest-VolumesTransfersV357Test-1095447592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:48:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9fade3fa-d0e1-459f-931d-10e8b8b97f9f tempest-VolumesTransfersV357Test-1095447592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:48:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9fade3fa-d0e1-459f-931d-10e8b8b97f9f tempest-VolumesTransfersV357Test-1095447592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:48:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9fade3fa-d0e1-459f-931d-10e8b8b97f9f tempest-VolumesTransfersV357Test-1095447592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:48:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9fade3fa-d0e1-459f-931d-10e8b8b97f9f tempest-VolumesTransfersV357Test-1095447592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:48:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9fade3fa-d0e1-459f-931d-10e8b8b97f9f tempest-VolumesTransfersV357Test-1095447592 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:48:09 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-9fade3fa-d0e1-459f-931d-10e8b8b97f9f tempest-VolumesTransfersV357Test-1095447592 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:48:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9fade3fa-d0e1-459f-931d-10e8b8b97f9f tempest-VolumesTransfersV357Test-1095447592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-390a60dd-753e-4d67-b99c-84cf35229c7a 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:48:09 devstack sudo[90696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-390a60dd-753e-4d67-b99c-84cf35229c7a 1073741824 Sep 28 11:48:09 devstack sudo[90696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:48:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-de6dc123-a963-4f1d-95de-adbc8635661f tempest-ServerRescueNegativeTestJSON-1103361569 None] Acquiring lock "cinder-cc52ec82-5def-4b02-a595-2d56e6b3a0fc-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:48:10 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-de6dc123-a963-4f1d-95de-adbc8635661f tempest-ServerRescueNegativeTestJSON-1103361569 None] Lock "cinder-cc52ec82-5def-4b02-a595-2d56e6b3a0fc-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:48:10 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-de6dc123-a963-4f1d-95de-adbc8635661f tempest-ServerRescueNegativeTestJSON-1103361569 None] Acquiring lock "cinder-quobyte-cc52ec82-5def-4b02-a595-2d56e6b3a0fc" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:48:10 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-de6dc123-a963-4f1d-95de-adbc8635661f tempest-ServerRescueNegativeTestJSON-1103361569 None] Lock "cinder-quobyte-cc52ec82-5def-4b02-a595-2d56e6b3a0fc" acquired by "delete_volume" :: waited 0.031s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:48:10 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8a7437-1b23-4452-9c08-bcd3b439dfa2]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:48:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-de6dc123-a963-4f1d-95de-adbc8635661f tempest-ServerRescueNegativeTestJSON-1103361569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cc52ec82-5def-4b02-a595-2d56e6b3a0fc {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:48:10 devstack sudo[90703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cc52ec82-5def-4b02-a595-2d56e6b3a0fc Sep 28 11:48:10 devstack sudo[90703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:48:10 devstack sudo[90696]: pam_unix(sudo:session): session closed for user root Sep 28 11:48:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9fade3fa-d0e1-459f-931d-10e8b8b97f9f tempest-VolumesTransfersV357Test-1095447592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-390a60dd-753e-4d67-b99c-84cf35229c7a 1073741824" returned: 0 in 0.619s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:48:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9fade3fa-d0e1-459f-931d-10e8b8b97f9f tempest-VolumesTransfersV357Test-1095447592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-390a60dd-753e-4d67-b99c-84cf35229c7a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:48:10 devstack sudo[90708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-390a60dd-753e-4d67-b99c-84cf35229c7a Sep 28 11:48:10 devstack sudo[90708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:48:10 devstack sudo[90703]: pam_unix(sudo:session): session closed for user root Sep 28 11:48:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-de6dc123-a963-4f1d-95de-adbc8635661f tempest-ServerRescueNegativeTestJSON-1103361569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cc52ec82-5def-4b02-a595-2d56e6b3a0fc" returned: 0 in 0.649s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:48:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-de6dc123-a963-4f1d-95de-adbc8635661f tempest-ServerRescueNegativeTestJSON-1103361569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cc52ec82-5def-4b02-a595-2d56e6b3a0fc {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:48:10 devstack sudo[90713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cc52ec82-5def-4b02-a595-2d56e6b3a0fc Sep 28 11:48:10 devstack sudo[90713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:48:10 devstack sudo[90708]: pam_unix(sudo:session): session closed for user root Sep 28 11:48:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9fade3fa-d0e1-459f-931d-10e8b8b97f9f tempest-VolumesTransfersV357Test-1095447592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-390a60dd-753e-4d67-b99c-84cf35229c7a" returned: 0 in 0.502s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:48:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9fade3fa-d0e1-459f-931d-10e8b8b97f9f tempest-VolumesTransfersV357Test-1095447592 None] <== create_volume: return (1199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:48:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9fade3fa-d0e1-459f-931d-10e8b8b97f9f tempest-VolumesTransfersV357Test-1095447592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.202s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:48:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9fade3fa-d0e1-459f-931d-10e8b8b97f9f tempest-VolumesTransfersV357Test-1095447592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f887271f-31c6-4671-95b3-abf9ed32620f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-390a60dd-753e-4d67-b99c-84cf35229c7a', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:48:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9fade3fa-d0e1-459f-931d-10e8b8b97f9f tempest-VolumesTransfersV357Test-1095447592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4403e355-b835-4efc-9066-ea789577236f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:48:11 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-9fade3fa-d0e1-459f-931d-10e8b8b97f9f tempest-VolumesTransfersV357Test-1095447592 None] Volume volume-390a60dd-753e-4d67-b99c-84cf35229c7a (390a60dd-753e-4d67-b99c-84cf35229c7a): created successfully Sep 28 11:48:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9fade3fa-d0e1-459f-931d-10e8b8b97f9f tempest-VolumesTransfersV357Test-1095447592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4403e355-b835-4efc-9066-ea789577236f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:48:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9fade3fa-d0e1-459f-931d-10e8b8b97f9f tempest-VolumesTransfersV357Test-1095447592 None] Flow 'volume_create_manager' (9392fd48-4daa-43bb-8dfc-133312df7267) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:48:11 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-9fade3fa-d0e1-459f-931d-10e8b8b97f9f tempest-VolumesTransfersV357Test-1095447592 None] Created volume successfully. Sep 28 11:48:11 devstack sudo[90713]: pam_unix(sudo:session): session closed for user root Sep 28 11:48:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-de6dc123-a963-4f1d-95de-adbc8635661f tempest-ServerRescueNegativeTestJSON-1103361569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cc52ec82-5def-4b02-a595-2d56e6b3a0fc" returned: 0 in 0.348s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:48:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-de6dc123-a963-4f1d-95de-adbc8635661f tempest-ServerRescueNegativeTestJSON-1103361569 None] Lock "cinder-quobyte-cc52ec82-5def-4b02-a595-2d56e6b3a0fc" released by "delete_volume" :: held 1.076s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:48:11 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-de6dc123-a963-4f1d-95de-adbc8635661f tempest-ServerRescueNegativeTestJSON-1103361569 None] Created reservations ['9fdf1f81-4e23-4350-bd04-eec2b41b80fb', 'cdb95b65-469d-4031-961b-c3df0f059536', 'ba89cd76-003c-4391-b468-11bee5c9545d', '957010af-d491-460b-bc74-0688d4294ad8'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:48:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-de6dc123-a963-4f1d-95de-adbc8635661f tempest-ServerRescueNegativeTestJSON-1103361569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:48:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-de6dc123-a963-4f1d-95de-adbc8635661f tempest-ServerRescueNegativeTestJSON-1103361569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:48:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-de6dc123-a963-4f1d-95de-adbc8635661f tempest-ServerRescueNegativeTestJSON-1103361569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:48:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-de6dc123-a963-4f1d-95de-adbc8635661f tempest-ServerRescueNegativeTestJSON-1103361569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:48:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-de6dc123-a963-4f1d-95de-adbc8635661f tempest-ServerRescueNegativeTestJSON-1103361569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:48:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-de6dc123-a963-4f1d-95de-adbc8635661f tempest-ServerRescueNegativeTestJSON-1103361569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:48:11 devstack sudo[90718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:48:11 devstack sudo[90718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:48:11 devstack sudo[90718]: pam_unix(sudo:session): session closed for user root Sep 28 11:48:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-de6dc123-a963-4f1d-95de-adbc8635661f tempest-ServerRescueNegativeTestJSON-1103361569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.341s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:48:11 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-de6dc123-a963-4f1d-95de-adbc8635661f tempest-ServerRescueNegativeTestJSON-1103361569 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:48:11 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-de6dc123-a963-4f1d-95de-adbc8635661f tempest-ServerRescueNegativeTestJSON-1103361569 None] Deleted volume successfully. Sep 28 11:48:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-de6dc123-a963-4f1d-95de-adbc8635661f tempest-ServerRescueNegativeTestJSON-1103361569 None] Lock "cinder-cc52ec82-5def-4b02-a595-2d56e6b3a0fc-delete_volume" released by "delete_volume" :: held 1.770s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:48:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5017bfab-2d4f-4e6d-8614-d58bc38514dc tempest-VolumesTransfersV357Test-433397778 None] Acquiring lock "cinder-390a60dd-753e-4d67-b99c-84cf35229c7a-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:48:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5017bfab-2d4f-4e6d-8614-d58bc38514dc tempest-VolumesTransfersV357Test-433397778 None] Lock "cinder-390a60dd-753e-4d67-b99c-84cf35229c7a-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:48:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5017bfab-2d4f-4e6d-8614-d58bc38514dc tempest-VolumesTransfersV357Test-433397778 None] Acquiring lock "cinder-quobyte-390a60dd-753e-4d67-b99c-84cf35229c7a" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:48:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5017bfab-2d4f-4e6d-8614-d58bc38514dc tempest-VolumesTransfersV357Test-433397778 None] Lock "cinder-quobyte-390a60dd-753e-4d67-b99c-84cf35229c7a" acquired by "delete_volume" :: waited 0.066s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:48:12 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cac5ea6-21b9-4157-a7e9-70319bfa921e]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:48:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5017bfab-2d4f-4e6d-8614-d58bc38514dc tempest-VolumesTransfersV357Test-433397778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-390a60dd-753e-4d67-b99c-84cf35229c7a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:48:12 devstack sudo[90753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-390a60dd-753e-4d67-b99c-84cf35229c7a Sep 28 11:48:12 devstack sudo[90753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:48:13 devstack sudo[90753]: pam_unix(sudo:session): session closed for user root Sep 28 11:48:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5017bfab-2d4f-4e6d-8614-d58bc38514dc tempest-VolumesTransfersV357Test-433397778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-390a60dd-753e-4d67-b99c-84cf35229c7a" returned: 0 in 0.520s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:48:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5017bfab-2d4f-4e6d-8614-d58bc38514dc tempest-VolumesTransfersV357Test-433397778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-390a60dd-753e-4d67-b99c-84cf35229c7a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:48:13 devstack sudo[90768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-390a60dd-753e-4d67-b99c-84cf35229c7a Sep 28 11:48:13 devstack sudo[90768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:48:13 devstack sudo[90768]: pam_unix(sudo:session): session closed for user root Sep 28 11:48:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5017bfab-2d4f-4e6d-8614-d58bc38514dc tempest-VolumesTransfersV357Test-433397778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-390a60dd-753e-4d67-b99c-84cf35229c7a" returned: 0 in 0.565s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:48:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5017bfab-2d4f-4e6d-8614-d58bc38514dc tempest-VolumesTransfersV357Test-433397778 None] Lock "cinder-quobyte-390a60dd-753e-4d67-b99c-84cf35229c7a" released by "delete_volume" :: held 1.202s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:48:14 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-5017bfab-2d4f-4e6d-8614-d58bc38514dc tempest-VolumesTransfersV357Test-433397778 None] Created reservations ['1ee3132f-75f7-4885-9321-e2c3c5ed1b13', 'b2d47223-ff05-42f5-994a-1ac704499d2c', 'e436bea7-a0bb-400e-b46c-58b2dabbf0d6', '0400a492-b2a2-4493-bfda-083ccf109dc8'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:48:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5017bfab-2d4f-4e6d-8614-d58bc38514dc tempest-VolumesTransfersV357Test-433397778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:48:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5017bfab-2d4f-4e6d-8614-d58bc38514dc tempest-VolumesTransfersV357Test-433397778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:48:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5017bfab-2d4f-4e6d-8614-d58bc38514dc tempest-VolumesTransfersV357Test-433397778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:48:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5017bfab-2d4f-4e6d-8614-d58bc38514dc tempest-VolumesTransfersV357Test-433397778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:48:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5017bfab-2d4f-4e6d-8614-d58bc38514dc tempest-VolumesTransfersV357Test-433397778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:48:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5017bfab-2d4f-4e6d-8614-d58bc38514dc tempest-VolumesTransfersV357Test-433397778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:48:14 devstack sudo[90802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:48:14 devstack sudo[90802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:48:14 devstack sudo[90802]: pam_unix(sudo:session): session closed for user root Sep 28 11:48:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5017bfab-2d4f-4e6d-8614-d58bc38514dc tempest-VolumesTransfersV357Test-433397778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.377s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:48:14 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-5017bfab-2d4f-4e6d-8614-d58bc38514dc tempest-VolumesTransfersV357Test-433397778 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:48:14 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-5017bfab-2d4f-4e6d-8614-d58bc38514dc tempest-VolumesTransfersV357Test-433397778 None] Deleted volume successfully. Sep 28 11:48:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5017bfab-2d4f-4e6d-8614-d58bc38514dc tempest-VolumesTransfersV357Test-433397778 None] Lock "cinder-390a60dd-753e-4d67-b99c-84cf35229c7a-delete_volume" released by "delete_volume" :: held 2.087s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:48:23 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-851e9e86-d9df-41d7-870d-b20de1141ddf tempest-ServerActionsTestOtherA-485250721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:48:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-851e9e86-d9df-41d7-870d-b20de1141ddf tempest-ServerActionsTestOtherA-485250721 None] Flow 'volume_create_manager' (0351acde-9301-4ebd-89cf-f264ac0441c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:48:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-851e9e86-d9df-41d7-870d-b20de1141ddf tempest-ServerActionsTestOtherA-485250721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebed5963-a0ec-4e5b-bea4-82584e78fda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:48:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-851e9e86-d9df-41d7-870d-b20de1141ddf tempest-ServerActionsTestOtherA-485250721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebed5963-a0ec-4e5b-bea4-82584e78fda1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:48:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-448573951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd501413-3795-4aa7-bdee-881ab67dd5f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6afb6bcec8dd4146b096076ce0ce3be7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:48:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:48:23Z,use_quota=True,user_id='d9cd5fa29b604dc4b8ed6b89cca77281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:48:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-851e9e86-d9df-41d7-870d-b20de1141ddf tempest-ServerActionsTestOtherA-485250721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57f3dc6d-cb50-4b15-a5c1-f8fe2133dcd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:48:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-851e9e86-d9df-41d7-870d-b20de1141ddf tempest-ServerActionsTestOtherA-485250721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57f3dc6d-cb50-4b15-a5c1-f8fe2133dcd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:48:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-851e9e86-d9df-41d7-870d-b20de1141ddf tempest-ServerActionsTestOtherA-485250721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80efeead-6c62-4fef-b08d-8c6cd569257e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:48:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-851e9e86-d9df-41d7-870d-b20de1141ddf tempest-ServerActionsTestOtherA-485250721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80efeead-6c62-4fef-b08d-8c6cd569257e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd501413-3795-4aa7-bdee-881ab67dd5f7', 'volume_name': 'volume-cd501413-3795-4aa7-bdee-881ab67dd5f7', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:48:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-851e9e86-d9df-41d7-870d-b20de1141ddf tempest-ServerActionsTestOtherA-485250721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92b3c0c0-2825-4413-934b-e1e735f8fdde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:48:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-851e9e86-d9df-41d7-870d-b20de1141ddf tempest-ServerActionsTestOtherA-485250721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92b3c0c0-2825-4413-934b-e1e735f8fdde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:48:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-851e9e86-d9df-41d7-870d-b20de1141ddf tempest-ServerActionsTestOtherA-485250721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c5ba0a9-3b7e-4357-9eef-c2435b4b2283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:48:23 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-851e9e86-d9df-41d7-870d-b20de1141ddf tempest-ServerActionsTestOtherA-485250721 None] Volume cd501413-3795-4aa7-bdee-881ab67dd5f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd501413-3795-4aa7-bdee-881ab67dd5f7', 'volume_size': 1} Sep 28 11:48:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-851e9e86-d9df-41d7-870d-b20de1141ddf tempest-ServerActionsTestOtherA-485250721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:48:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-851e9e86-d9df-41d7-870d-b20de1141ddf tempest-ServerActionsTestOtherA-485250721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:48:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-851e9e86-d9df-41d7-870d-b20de1141ddf tempest-ServerActionsTestOtherA-485250721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:48:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-448573951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd501413-3795-4aa7-bdee-881ab67dd5f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6afb6bcec8dd4146b096076ce0ce3be7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:48:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:48:23Z,use_quota=True,user_id='d9cd5fa29b604dc4b8ed6b89cca77281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:48:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-851e9e86-d9df-41d7-870d-b20de1141ddf tempest-ServerActionsTestOtherA-485250721 None] Creating volume cd501413-3795-4aa7-bdee-881ab67dd5f7 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:48:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-851e9e86-d9df-41d7-870d-b20de1141ddf tempest-ServerActionsTestOtherA-485250721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:48:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-851e9e86-d9df-41d7-870d-b20de1141ddf tempest-ServerActionsTestOtherA-485250721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:48:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-851e9e86-d9df-41d7-870d-b20de1141ddf tempest-ServerActionsTestOtherA-485250721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:48:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-851e9e86-d9df-41d7-870d-b20de1141ddf tempest-ServerActionsTestOtherA-485250721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:48:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-851e9e86-d9df-41d7-870d-b20de1141ddf tempest-ServerActionsTestOtherA-485250721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:48:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-851e9e86-d9df-41d7-870d-b20de1141ddf tempest-ServerActionsTestOtherA-485250721 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:48:23 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-851e9e86-d9df-41d7-870d-b20de1141ddf tempest-ServerActionsTestOtherA-485250721 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:48:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-851e9e86-d9df-41d7-870d-b20de1141ddf tempest-ServerActionsTestOtherA-485250721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cd501413-3795-4aa7-bdee-881ab67dd5f7 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:48:23 devstack sudo[90870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cd501413-3795-4aa7-bdee-881ab67dd5f7 1073741824 Sep 28 11:48:23 devstack sudo[90870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:48:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-c005a66e-7ee8-446b-949c-7aa1be20eebd req-d477eac6-31e6-450a-af60-52db66abfd35 tempest-AttachVolumeShelveTestJSON-777856843 None] No connector for attachment 44d98373-b009-4c8b-804a-3838196890f7; skipping storage backend terminate_connection call. {{(pid=86916) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 28 11:48:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-c005a66e-7ee8-446b-949c-7aa1be20eebd req-d477eac6-31e6-450a-af60-52db66abfd35 tempest-AttachVolumeShelveTestJSON-777856843 None] Deleting attachment 44d98373-b009-4c8b-804a-3838196890f7. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 11:48:24 devstack sudo[90870]: pam_unix(sudo:session): session closed for user root Sep 28 11:48:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-851e9e86-d9df-41d7-870d-b20de1141ddf tempest-ServerActionsTestOtherA-485250721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cd501413-3795-4aa7-bdee-881ab67dd5f7 1073741824" returned: 0 in 0.577s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:48:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-851e9e86-d9df-41d7-870d-b20de1141ddf tempest-ServerActionsTestOtherA-485250721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cd501413-3795-4aa7-bdee-881ab67dd5f7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:48:24 devstack sudo[90876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cd501413-3795-4aa7-bdee-881ab67dd5f7 Sep 28 11:48:24 devstack sudo[90876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:48:24 devstack sudo[90876]: pam_unix(sudo:session): session closed for user root Sep 28 11:48:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-851e9e86-d9df-41d7-870d-b20de1141ddf tempest-ServerActionsTestOtherA-485250721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cd501413-3795-4aa7-bdee-881ab67dd5f7" returned: 0 in 0.309s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:48:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-851e9e86-d9df-41d7-870d-b20de1141ddf tempest-ServerActionsTestOtherA-485250721 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:48:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-851e9e86-d9df-41d7-870d-b20de1141ddf tempest-ServerActionsTestOtherA-485250721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:48:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-851e9e86-d9df-41d7-870d-b20de1141ddf tempest-ServerActionsTestOtherA-485250721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c5ba0a9-3b7e-4357-9eef-c2435b4b2283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd501413-3795-4aa7-bdee-881ab67dd5f7', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:48:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-851e9e86-d9df-41d7-870d-b20de1141ddf tempest-ServerActionsTestOtherA-485250721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c015bf3-f7a3-46bb-894f-cf6057d9f10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:48:24 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-851e9e86-d9df-41d7-870d-b20de1141ddf tempest-ServerActionsTestOtherA-485250721 None] Volume volume-cd501413-3795-4aa7-bdee-881ab67dd5f7 (cd501413-3795-4aa7-bdee-881ab67dd5f7): created successfully Sep 28 11:48:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-851e9e86-d9df-41d7-870d-b20de1141ddf tempest-ServerActionsTestOtherA-485250721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c015bf3-f7a3-46bb-894f-cf6057d9f10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:48:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-851e9e86-d9df-41d7-870d-b20de1141ddf tempest-ServerActionsTestOtherA-485250721 None] Flow 'volume_create_manager' (0351acde-9301-4ebd-89cf-f264ac0441c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:48:24 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-851e9e86-d9df-41d7-870d-b20de1141ddf tempest-ServerActionsTestOtherA-485250721 None] Created volume successfully. Sep 28 11:48:25 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-05103163-f83d-4d85-bbc8-fa20c374b806 tempest-VolumesCloneTest-505531652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:48:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-05103163-f83d-4d85-bbc8-fa20c374b806 tempest-VolumesCloneTest-505531652 None] Flow 'volume_create_manager' (8dacb7dd-cf57-4238-93d1-4c3ef6b2d822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:48:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-05103163-f83d-4d85-bbc8-fa20c374b806 tempest-VolumesCloneTest-505531652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc3e7481-0bee-4deb-86a8-8448b7ca50aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:48:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-05103163-f83d-4d85-bbc8-fa20c374b806 tempest-VolumesCloneTest-505531652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc3e7481-0bee-4deb-86a8-8448b7ca50aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:48:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-299871979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af826b33-e979-4417-9726-350b02f737c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9178a1fc03a49b7b49c9e3a48a79ed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:48:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:48:25Z,use_quota=True,user_id='145c51c98f93493ba209a690f0af5e94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:48:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-05103163-f83d-4d85-bbc8-fa20c374b806 tempest-VolumesCloneTest-505531652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da43864d-8c83-4c73-92f4-dd0b515ff6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:48:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-05103163-f83d-4d85-bbc8-fa20c374b806 tempest-VolumesCloneTest-505531652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da43864d-8c83-4c73-92f4-dd0b515ff6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:48:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-05103163-f83d-4d85-bbc8-fa20c374b806 tempest-VolumesCloneTest-505531652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaf47194-9802-4195-8281-fce51d1bad8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:48:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-05103163-f83d-4d85-bbc8-fa20c374b806 tempest-VolumesCloneTest-505531652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaf47194-9802-4195-8281-fce51d1bad8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af826b33-e979-4417-9726-350b02f737c5', 'volume_name': 'volume-af826b33-e979-4417-9726-350b02f737c5', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:48:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-05103163-f83d-4d85-bbc8-fa20c374b806 tempest-VolumesCloneTest-505531652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2e589bb-dedc-404c-9b9a-ffd992e2a0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:48:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-05103163-f83d-4d85-bbc8-fa20c374b806 tempest-VolumesCloneTest-505531652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2e589bb-dedc-404c-9b9a-ffd992e2a0ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:48:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-05103163-f83d-4d85-bbc8-fa20c374b806 tempest-VolumesCloneTest-505531652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77440618-9512-4a6b-afe9-ede3bd2e0ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:48:25 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-05103163-f83d-4d85-bbc8-fa20c374b806 tempest-VolumesCloneTest-505531652 None] Volume af826b33-e979-4417-9726-350b02f737c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af826b33-e979-4417-9726-350b02f737c5', 'volume_size': 1} Sep 28 11:48:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-05103163-f83d-4d85-bbc8-fa20c374b806 tempest-VolumesCloneTest-505531652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:48:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-05103163-f83d-4d85-bbc8-fa20c374b806 tempest-VolumesCloneTest-505531652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:48:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-05103163-f83d-4d85-bbc8-fa20c374b806 tempest-VolumesCloneTest-505531652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:48:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-299871979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af826b33-e979-4417-9726-350b02f737c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9178a1fc03a49b7b49c9e3a48a79ed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:48:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:48:25Z,use_quota=True,user_id='145c51c98f93493ba209a690f0af5e94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:48:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-05103163-f83d-4d85-bbc8-fa20c374b806 tempest-VolumesCloneTest-505531652 None] Creating volume af826b33-e979-4417-9726-350b02f737c5 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:48:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-05103163-f83d-4d85-bbc8-fa20c374b806 tempest-VolumesCloneTest-505531652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:48:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-05103163-f83d-4d85-bbc8-fa20c374b806 tempest-VolumesCloneTest-505531652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:48:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-05103163-f83d-4d85-bbc8-fa20c374b806 tempest-VolumesCloneTest-505531652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:48:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-05103163-f83d-4d85-bbc8-fa20c374b806 tempest-VolumesCloneTest-505531652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:48:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-05103163-f83d-4d85-bbc8-fa20c374b806 tempest-VolumesCloneTest-505531652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:48:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-05103163-f83d-4d85-bbc8-fa20c374b806 tempest-VolumesCloneTest-505531652 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:48:25 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-05103163-f83d-4d85-bbc8-fa20c374b806 tempest-VolumesCloneTest-505531652 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:48:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-05103163-f83d-4d85-bbc8-fa20c374b806 tempest-VolumesCloneTest-505531652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af826b33-e979-4417-9726-350b02f737c5 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:48:25 devstack sudo[90881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af826b33-e979-4417-9726-350b02f737c5 1073741824 Sep 28 11:48:25 devstack sudo[90881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:48:25 devstack sudo[90881]: pam_unix(sudo:session): session closed for user root Sep 28 11:48:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-05103163-f83d-4d85-bbc8-fa20c374b806 tempest-VolumesCloneTest-505531652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af826b33-e979-4417-9726-350b02f737c5 1073741824" returned: 0 in 0.508s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:48:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-05103163-f83d-4d85-bbc8-fa20c374b806 tempest-VolumesCloneTest-505531652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af826b33-e979-4417-9726-350b02f737c5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:48:25 devstack sudo[90887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af826b33-e979-4417-9726-350b02f737c5 Sep 28 11:48:25 devstack sudo[90887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:48:25 devstack sudo[90887]: pam_unix(sudo:session): session closed for user root Sep 28 11:48:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-05103163-f83d-4d85-bbc8-fa20c374b806 tempest-VolumesCloneTest-505531652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af826b33-e979-4417-9726-350b02f737c5" returned: 0 in 0.245s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:48:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-05103163-f83d-4d85-bbc8-fa20c374b806 tempest-VolumesCloneTest-505531652 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:48:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-05103163-f83d-4d85-bbc8-fa20c374b806 tempest-VolumesCloneTest-505531652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:48:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-05103163-f83d-4d85-bbc8-fa20c374b806 tempest-VolumesCloneTest-505531652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77440618-9512-4a6b-afe9-ede3bd2e0ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af826b33-e979-4417-9726-350b02f737c5', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:48:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-05103163-f83d-4d85-bbc8-fa20c374b806 tempest-VolumesCloneTest-505531652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83adb2bf-ed13-454d-9da1-0c4caab41d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:48:26 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-05103163-f83d-4d85-bbc8-fa20c374b806 tempest-VolumesCloneTest-505531652 None] Volume volume-af826b33-e979-4417-9726-350b02f737c5 (af826b33-e979-4417-9726-350b02f737c5): created successfully Sep 28 11:48:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-05103163-f83d-4d85-bbc8-fa20c374b806 tempest-VolumesCloneTest-505531652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83adb2bf-ed13-454d-9da1-0c4caab41d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:48:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-05103163-f83d-4d85-bbc8-fa20c374b806 tempest-VolumesCloneTest-505531652 None] Flow 'volume_create_manager' (8dacb7dd-cf57-4238-93d1-4c3ef6b2d822) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:48:26 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-05103163-f83d-4d85-bbc8-fa20c374b806 tempest-VolumesCloneTest-505531652 None] Created volume successfully. Sep 28 11:48:28 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:48:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] Flow 'volume_create_manager' (cc083917-d7c9-4c4f-801d-2124c89c860d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:48:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2984c733-c79a-4eab-9731-36b0d6d38421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:48:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2984c733-c79a-4eab-9731-36b0d6d38421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:48:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1990109319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e66bf63d-3ea1-4bbe-8cd8-25ef2089ec99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9178a1fc03a49b7b49c9e3a48a79ed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:48:28Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=af826b33-e979-4417-9726-350b02f737c5,status='creating',terminated_at=None,updated_at=2026-09-28T09:48:28Z,use_quota=True,user_id='145c51c98f93493ba209a690f0af5e94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:48:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9acda586-b19c-44a6-9f5b-3612cb965abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:48:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9acda586-b19c-44a6-9f5b-3612cb965abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:48:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94cc0882-d176-4993-82d3-4e43b8f52dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:48:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94cc0882-d176-4993-82d3-4e43b8f52dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e66bf63d-3ea1-4bbe-8cd8-25ef2089ec99', 'volume_name': 'volume-e66bf63d-3ea1-4bbe-8cd8-25ef2089ec99', 'volume_size': 2, 'source_volid': 'af826b33-e979-4417-9726-350b02f737c5', 'source_volstatus': 'available'}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:48:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a78ba771-dda3-42df-8683-1c7c3d5c48d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:48:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a78ba771-dda3-42df-8683-1c7c3d5c48d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:48:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b8083c5-21e7-4861-aec3-461274eaac1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:48:28 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] Volume e66bf63d-3ea1-4bbe-8cd8-25ef2089ec99: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e66bf63d-3ea1-4bbe-8cd8-25ef2089ec99', 'volume_size': 2, 'source_volid': 'af826b33-e979-4417-9726-350b02f737c5', 'source_volstatus': 'available'} Sep 28 11:48:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:48:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:48:28 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] Cloning volume af826b33-e979-4417-9726-350b02f737c5 to volume e66bf63d-3ea1-4bbe-8cd8-25ef2089ec99 Sep 28 11:48:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] Creating offline snapshot 35a9642b-64db-4c8c-8605-bd9aa30ca3a1 of volume af826b33-e979-4417-9726-350b02f737c5 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 11:48:28 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[83105891-3d93-4581-bca6-167a01b4e5eb]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:48:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af826b33-e979-4417-9726-350b02f737c5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:48:28 devstack sudo[90897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af826b33-e979-4417-9726-350b02f737c5 Sep 28 11:48:28 devstack sudo[90897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:48:28 devstack sudo[90897]: pam_unix(sudo:session): session closed for user root Sep 28 11:48:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af826b33-e979-4417-9726-350b02f737c5" returned: 0 in 0.566s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:48:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af826b33-e979-4417-9726-350b02f737c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af826b33-e979-4417-9726-350b02f737c5.35a9642b-64db-4c8c-8605-bd9aa30ca3a1 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:48:28 devstack sudo[90905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af826b33-e979-4417-9726-350b02f737c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af826b33-e979-4417-9726-350b02f737c5.35a9642b-64db-4c8c-8605-bd9aa30ca3a1 1G Sep 28 11:48:28 devstack sudo[90905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:48:29 devstack sudo[90905]: pam_unix(sudo:session): session closed for user root Sep 28 11:48:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af826b33-e979-4417-9726-350b02f737c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af826b33-e979-4417-9726-350b02f737c5.35a9642b-64db-4c8c-8605-bd9aa30ca3a1 1G" returned: 0 in 0.687s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:48:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af826b33-e979-4417-9726-350b02f737c5 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af826b33-e979-4417-9726-350b02f737c5.35a9642b-64db-4c8c-8605-bd9aa30ca3a1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:48:29 devstack sudo[90913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af826b33-e979-4417-9726-350b02f737c5 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af826b33-e979-4417-9726-350b02f737c5.35a9642b-64db-4c8c-8605-bd9aa30ca3a1 Sep 28 11:48:29 devstack sudo[90913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:48:30 devstack sudo[90913]: pam_unix(sudo:session): session closed for user root Sep 28 11:48:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af826b33-e979-4417-9726-350b02f737c5 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af826b33-e979-4417-9726-350b02f737c5.35a9642b-64db-4c8c-8605-bd9aa30ca3a1" returned: 0 in 0.463s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:48:30 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af826b33-e979-4417-9726-350b02f737c5.35a9642b-64db-4c8c-8605-bd9aa30ca3a1 is being set with open permissions: ugo+rw Sep 28 11:48:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af826b33-e979-4417-9726-350b02f737c5.35a9642b-64db-4c8c-8605-bd9aa30ca3a1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:48:30 devstack sudo[90923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af826b33-e979-4417-9726-350b02f737c5.35a9642b-64db-4c8c-8605-bd9aa30ca3a1 Sep 28 11:48:30 devstack sudo[90923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:48:30 devstack sudo[90923]: pam_unix(sudo:session): session closed for user root Sep 28 11:48:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af826b33-e979-4417-9726-350b02f737c5.35a9642b-64db-4c8c-8605-bd9aa30ca3a1" returned: 0 in 0.468s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:48:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af826b33-e979-4417-9726-350b02f737c5.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:48:30 devstack sudo[90938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af826b33-e979-4417-9726-350b02f737c5.info Sep 28 11:48:30 devstack sudo[90938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:48:30 devstack sudo[90938]: pam_unix(sudo:session): session closed for user root Sep 28 11:48:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af826b33-e979-4417-9726-350b02f737c5.info" returned: 0 in 0.405s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:48:30 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af826b33-e979-4417-9726-350b02f737c5.info is being set with open permissions: ugo+rw Sep 28 11:48:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af826b33-e979-4417-9726-350b02f737c5.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:48:31 devstack sudo[90941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af826b33-e979-4417-9726-350b02f737c5.info Sep 28 11:48:31 devstack sudo[90941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:48:31 devstack sudo[90941]: pam_unix(sudo:session): session closed for user root Sep 28 11:48:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af826b33-e979-4417-9726-350b02f737c5.info" returned: 0 in 0.433s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:48:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] Acquiring lock "cinder-quobyte-e66bf63d-3ea1-4bbe-8cd8-25ef2089ec99" by "_copy_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:48:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] Lock "cinder-quobyte-e66bf63d-3ea1-4bbe-8cd8-25ef2089ec99" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:48:31 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] snapshot: 35a9642b-64db-4c8c-8605-bd9aa30ca3a1, volume: e66bf63d-3ea1-4bbe-8cd8-25ef2089ec99, {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 11:48:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:48:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:48:31 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:48:31 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:48:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:48:31 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c563690-495e-4f39-be58-d3f3432cc62f]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:48:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af826b33-e979-4417-9726-350b02f737c5.35a9642b-64db-4c8c-8605-bd9aa30ca3a1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:48:31 devstack sudo[90944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af826b33-e979-4417-9726-350b02f737c5.35a9642b-64db-4c8c-8605-bd9aa30ca3a1 Sep 28 11:48:31 devstack sudo[90944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:48:32 devstack sudo[90944]: pam_unix(sudo:session): session closed for user root Sep 28 11:48:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af826b33-e979-4417-9726-350b02f737c5.35a9642b-64db-4c8c-8605-bd9aa30ca3a1" returned: 0 in 0.557s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:48:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af826b33-e979-4417-9726-350b02f737c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 11:48:32 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[6009c422-a615-4c4b-9163-df84fff4e919]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:48:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af826b33-e979-4417-9726-350b02f737c5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:48:32 devstack sudo[90950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af826b33-e979-4417-9726-350b02f737c5 Sep 28 11:48:32 devstack sudo[90950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:48:32 devstack sudo[90950]: pam_unix(sudo:session): session closed for user root Sep 28 11:48:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af826b33-e979-4417-9726-350b02f737c5" returned: 0 in 0.568s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:48:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af826b33-e979-4417-9726-350b02f737c5 {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 11:48:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] Creating direct copy from snapshot {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 11:48:32 devstack cinder-volume[86916]: DEBUG cinder.utils [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] Path /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e66bf63d-3ea1-4bbe-8cd8-25ef2089ec99 not found in is_blk_device check {{(pid=86916) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 11:48:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af826b33-e979-4417-9726-350b02f737c5 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e66bf63d-3ea1-4bbe-8cd8-25ef2089ec99 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:48:32 devstack sudo[90955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af826b33-e979-4417-9726-350b02f737c5 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e66bf63d-3ea1-4bbe-8cd8-25ef2089ec99 Sep 28 11:48:32 devstack sudo[90955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:48:37 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=42,cinder:UPDATE=57,cinder:INSERT=14,cinder:DELETE=6 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 11:48:37 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-9be38b89-ebdc-48c6-8e7b-46db6f3014cc tempest-VolumeQuotasAdminTestJSON-98839872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:48:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9be38b89-ebdc-48c6-8e7b-46db6f3014cc tempest-VolumeQuotasAdminTestJSON-98839872 None] Flow 'volume_create_manager' (8a01cfd0-4943-484d-b2be-3e9104557e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:48:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9be38b89-ebdc-48c6-8e7b-46db6f3014cc tempest-VolumeQuotasAdminTestJSON-98839872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f623f8c2-fd20-4585-9f16-2cccef56a9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:48:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9be38b89-ebdc-48c6-8e7b-46db6f3014cc tempest-VolumeQuotasAdminTestJSON-98839872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f623f8c2-fd20-4585-9f16-2cccef56a9a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:48:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1830126335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e4a25b3-f9b4-4ac2-a2d9-49262f5ca266,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea28d1f079b1403d93cd67e84c29774b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:48:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:48:37Z,use_quota=True,user_id='75fede1315214e7c906ea86531b2b06b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:48:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9be38b89-ebdc-48c6-8e7b-46db6f3014cc tempest-VolumeQuotasAdminTestJSON-98839872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a477ed3-15fb-486d-9855-f2df3c8b4ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:48:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9be38b89-ebdc-48c6-8e7b-46db6f3014cc tempest-VolumeQuotasAdminTestJSON-98839872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a477ed3-15fb-486d-9855-f2df3c8b4ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:48:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9be38b89-ebdc-48c6-8e7b-46db6f3014cc tempest-VolumeQuotasAdminTestJSON-98839872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33560945-12ce-4f2f-9cf5-a4128e5fe844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:48:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9be38b89-ebdc-48c6-8e7b-46db6f3014cc tempest-VolumeQuotasAdminTestJSON-98839872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33560945-12ce-4f2f-9cf5-a4128e5fe844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e4a25b3-f9b4-4ac2-a2d9-49262f5ca266', 'volume_name': 'volume-8e4a25b3-f9b4-4ac2-a2d9-49262f5ca266', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:48:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9be38b89-ebdc-48c6-8e7b-46db6f3014cc tempest-VolumeQuotasAdminTestJSON-98839872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7291332f-1bff-46de-bce3-1fd6c24c5009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:48:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9be38b89-ebdc-48c6-8e7b-46db6f3014cc tempest-VolumeQuotasAdminTestJSON-98839872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7291332f-1bff-46de-bce3-1fd6c24c5009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:48:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9be38b89-ebdc-48c6-8e7b-46db6f3014cc tempest-VolumeQuotasAdminTestJSON-98839872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (515ec59b-89d5-469f-93b2-94d1be8bfd2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:48:37 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-9be38b89-ebdc-48c6-8e7b-46db6f3014cc tempest-VolumeQuotasAdminTestJSON-98839872 None] Volume 8e4a25b3-f9b4-4ac2-a2d9-49262f5ca266: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e4a25b3-f9b4-4ac2-a2d9-49262f5ca266', 'volume_size': 1} Sep 28 11:48:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9be38b89-ebdc-48c6-8e7b-46db6f3014cc tempest-VolumeQuotasAdminTestJSON-98839872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:48:38 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 11:48:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:48:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:48:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:48:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:48:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:48:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:48:38 devstack sudo[91076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:48:38 devstack sudo[91076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:48:39 devstack sudo[91076]: pam_unix(sudo:session): session closed for user root Sep 28 11:48:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 1.146s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:48:39 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:48:39 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 11:48:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] thread count: 8 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 11:48:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] thread info: [<_MainThread(MainThread, started 135408582168704)>, , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 11:48:45 devstack sudo[90955]: pam_unix(sudo:session): session closed for user root Sep 28 11:48:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af826b33-e979-4417-9726-350b02f737c5 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e66bf63d-3ea1-4bbe-8cd8-25ef2089ec99" returned: 0 in 12.712s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:48:45 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] Image conversion details: src /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af826b33-e979-4417-9726-350b02f737c5, size 1024.00 MB, duration 12.71 sec, destination /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e66bf63d-3ea1-4bbe-8cd8-25ef2089ec99 {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 11:48:45 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] Converted 1024.00 MB image at 80.54 MB/s Sep 28 11:48:45 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e66bf63d-3ea1-4bbe-8cd8-25ef2089ec99 is being set with open permissions: ugo+rw Sep 28 11:48:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e66bf63d-3ea1-4bbe-8cd8-25ef2089ec99 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:48:45 devstack sudo[91167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e66bf63d-3ea1-4bbe-8cd8-25ef2089ec99 Sep 28 11:48:45 devstack sudo[91167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:48:46 devstack sudo[91167]: pam_unix(sudo:session): session closed for user root Sep 28 11:48:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e66bf63d-3ea1-4bbe-8cd8-25ef2089ec99" returned: 0 in 0.603s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:48:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] Lock "cinder-quobyte-e66bf63d-3ea1-4bbe-8cd8-25ef2089ec99" released by "_copy_volume_from_snapshot" :: held 14.625s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:48:46 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:INSERT=11,cinder:UPDATE=54,cinder:DELETE=5,cinder:SELECT=40 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 11:48:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] Acquiring lock "cinder-quobyte-35a9642b-64db-4c8c-8605-bd9aa30ca3a1" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:48:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] Lock "cinder-quobyte-35a9642b-64db-4c8c-8605-bd9aa30ca3a1" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:48:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] Deleting offline snapshot 35a9642b-64db-4c8c-8605-bd9aa30ca3a1 of volume af826b33-e979-4417-9726-350b02f737c5 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 11:48:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] snapshot_file for this snap is: volume-af826b33-e979-4417-9726-350b02f737c5.35a9642b-64db-4c8c-8605-bd9aa30ca3a1 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 11:48:46 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0487fc1-382f-4341-97a8-6d7ca425228d]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:48:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af826b33-e979-4417-9726-350b02f737c5.35a9642b-64db-4c8c-8605-bd9aa30ca3a1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:48:46 devstack sudo[91171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af826b33-e979-4417-9726-350b02f737c5.35a9642b-64db-4c8c-8605-bd9aa30ca3a1 Sep 28 11:48:46 devstack sudo[91171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:48:46 devstack sudo[91171]: pam_unix(sudo:session): session closed for user root Sep 28 11:48:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af826b33-e979-4417-9726-350b02f737c5.35a9642b-64db-4c8c-8605-bd9aa30ca3a1" returned: 0 in 0.562s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:48:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af826b33-e979-4417-9726-350b02f737c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 11:48:46 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[07bd52ca-e9f1-437c-88fb-03b365a7d706]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:48:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af826b33-e979-4417-9726-350b02f737c5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:48:47 devstack sudo[91179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af826b33-e979-4417-9726-350b02f737c5 Sep 28 11:48:47 devstack sudo[91179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:48:47 devstack sudo[91179]: pam_unix(sudo:session): session closed for user root Sep 28 11:48:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af826b33-e979-4417-9726-350b02f737c5" returned: 0 in 0.703s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:48:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af826b33-e979-4417-9726-350b02f737c5.35a9642b-64db-4c8c-8605-bd9aa30ca3a1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:48:47 devstack sudo[91185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af826b33-e979-4417-9726-350b02f737c5.35a9642b-64db-4c8c-8605-bd9aa30ca3a1 Sep 28 11:48:47 devstack sudo[91185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:48:47 devstack sudo[91185]: pam_unix(sudo:session): session closed for user root Sep 28 11:48:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af826b33-e979-4417-9726-350b02f737c5.35a9642b-64db-4c8c-8605-bd9aa30ca3a1" returned: 0 in 0.350s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:48:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af826b33-e979-4417-9726-350b02f737c5.35a9642b-64db-4c8c-8605-bd9aa30ca3a1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:48:47 devstack sudo[91190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af826b33-e979-4417-9726-350b02f737c5.35a9642b-64db-4c8c-8605-bd9aa30ca3a1 Sep 28 11:48:47 devstack sudo[91190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:48:48 devstack sudo[91190]: pam_unix(sudo:session): session closed for user root Sep 28 11:48:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af826b33-e979-4417-9726-350b02f737c5.35a9642b-64db-4c8c-8605-bd9aa30ca3a1" returned: 0 in 0.270s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:48:48 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] Lock "cinder-quobyte-35a9642b-64db-4c8c-8605-bd9aa30ca3a1" released by "_delete_snapshot" :: held 2.061s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:48:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 20.096s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:48:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9be38b89-ebdc-48c6-8e7b-46db6f3014cc tempest-VolumeQuotasAdminTestJSON-98839872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.857s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:48:48 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9be38b89-ebdc-48c6-8e7b-46db6f3014cc tempest-VolumeQuotasAdminTestJSON-98839872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:48:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1830126335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e4a25b3-f9b4-4ac2-a2d9-49262f5ca266,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea28d1f079b1403d93cd67e84c29774b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:48:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:48:37Z,use_quota=True,user_id='75fede1315214e7c906ea86531b2b06b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:48:48 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-9be38b89-ebdc-48c6-8e7b-46db6f3014cc tempest-VolumeQuotasAdminTestJSON-98839872 None] Creating volume 8e4a25b3-f9b4-4ac2-a2d9-49262f5ca266 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:48:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9be38b89-ebdc-48c6-8e7b-46db6f3014cc tempest-VolumeQuotasAdminTestJSON-98839872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:48:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9be38b89-ebdc-48c6-8e7b-46db6f3014cc tempest-VolumeQuotasAdminTestJSON-98839872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:48:48 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9be38b89-ebdc-48c6-8e7b-46db6f3014cc tempest-VolumeQuotasAdminTestJSON-98839872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:48:48 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9be38b89-ebdc-48c6-8e7b-46db6f3014cc tempest-VolumeQuotasAdminTestJSON-98839872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:48:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9be38b89-ebdc-48c6-8e7b-46db6f3014cc tempest-VolumeQuotasAdminTestJSON-98839872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:48:48 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9be38b89-ebdc-48c6-8e7b-46db6f3014cc tempest-VolumeQuotasAdminTestJSON-98839872 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:48:48 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-9be38b89-ebdc-48c6-8e7b-46db6f3014cc tempest-VolumeQuotasAdminTestJSON-98839872 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:48:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9be38b89-ebdc-48c6-8e7b-46db6f3014cc tempest-VolumeQuotasAdminTestJSON-98839872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8e4a25b3-f9b4-4ac2-a2d9-49262f5ca266 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:48:48 devstack sudo[91193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8e4a25b3-f9b4-4ac2-a2d9-49262f5ca266 1073741824 Sep 28 11:48:48 devstack sudo[91193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:48:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b8083c5-21e7-4861-aec3-461274eaac1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e66bf63d-3ea1-4bbe-8cd8-25ef2089ec99', 'volume_size': 2, 'source_volid': 'af826b33-e979-4417-9726-350b02f737c5', 'source_volstatus': 'available'}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:48:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (facad417-0b85-434f-988c-f8b4fd3685a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:48:48 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] Volume volume-e66bf63d-3ea1-4bbe-8cd8-25ef2089ec99 (e66bf63d-3ea1-4bbe-8cd8-25ef2089ec99): created successfully Sep 28 11:48:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (facad417-0b85-434f-988c-f8b4fd3685a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:48:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] Flow 'volume_create_manager' (cc083917-d7c9-4c4f-801d-2124c89c860d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:48:48 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-91b725d3-f71f-44dc-8b4b-3958b0789a8f tempest-VolumesCloneTest-505531652 None] Created volume successfully. Sep 28 11:48:48 devstack sudo[91193]: pam_unix(sudo:session): session closed for user root Sep 28 11:48:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9be38b89-ebdc-48c6-8e7b-46db6f3014cc tempest-VolumeQuotasAdminTestJSON-98839872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8e4a25b3-f9b4-4ac2-a2d9-49262f5ca266 1073741824" returned: 0 in 0.480s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:48:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9be38b89-ebdc-48c6-8e7b-46db6f3014cc tempest-VolumeQuotasAdminTestJSON-98839872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8e4a25b3-f9b4-4ac2-a2d9-49262f5ca266 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:48:48 devstack sudo[91199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8e4a25b3-f9b4-4ac2-a2d9-49262f5ca266 Sep 28 11:48:48 devstack sudo[91199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:48:49 devstack sudo[91199]: pam_unix(sudo:session): session closed for user root Sep 28 11:48:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9be38b89-ebdc-48c6-8e7b-46db6f3014cc tempest-VolumeQuotasAdminTestJSON-98839872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8e4a25b3-f9b4-4ac2-a2d9-49262f5ca266" returned: 0 in 0.341s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:48:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9be38b89-ebdc-48c6-8e7b-46db6f3014cc tempest-VolumeQuotasAdminTestJSON-98839872 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:48:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9be38b89-ebdc-48c6-8e7b-46db6f3014cc tempest-VolumeQuotasAdminTestJSON-98839872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:48:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9be38b89-ebdc-48c6-8e7b-46db6f3014cc tempest-VolumeQuotasAdminTestJSON-98839872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (515ec59b-89d5-469f-93b2-94d1be8bfd2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e4a25b3-f9b4-4ac2-a2d9-49262f5ca266', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:48:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9be38b89-ebdc-48c6-8e7b-46db6f3014cc tempest-VolumeQuotasAdminTestJSON-98839872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85b4d4b1-7c7b-4ddb-b956-1f6c545e4273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:48:49 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-9be38b89-ebdc-48c6-8e7b-46db6f3014cc tempest-VolumeQuotasAdminTestJSON-98839872 None] Volume volume-8e4a25b3-f9b4-4ac2-a2d9-49262f5ca266 (8e4a25b3-f9b4-4ac2-a2d9-49262f5ca266): created successfully Sep 28 11:48:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9be38b89-ebdc-48c6-8e7b-46db6f3014cc tempest-VolumeQuotasAdminTestJSON-98839872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85b4d4b1-7c7b-4ddb-b956-1f6c545e4273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:48:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9be38b89-ebdc-48c6-8e7b-46db6f3014cc tempest-VolumeQuotasAdminTestJSON-98839872 None] Flow 'volume_create_manager' (8a01cfd0-4943-484d-b2be-3e9104557e14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:48:49 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4bb0dc32-590d-4ce6-a599-543545f69dc3 tempest-VolumesCloneTest-505531652 None] Acquiring lock "cinder-e66bf63d-3ea1-4bbe-8cd8-25ef2089ec99-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:48:49 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-9be38b89-ebdc-48c6-8e7b-46db6f3014cc tempest-VolumeQuotasAdminTestJSON-98839872 None] Created volume successfully. Sep 28 11:48:49 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4bb0dc32-590d-4ce6-a599-543545f69dc3 tempest-VolumesCloneTest-505531652 None] Lock "cinder-e66bf63d-3ea1-4bbe-8cd8-25ef2089ec99-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:48:49 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4bb0dc32-590d-4ce6-a599-543545f69dc3 tempest-VolumesCloneTest-505531652 None] Acquiring lock "cinder-quobyte-e66bf63d-3ea1-4bbe-8cd8-25ef2089ec99" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:48:49 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4bb0dc32-590d-4ce6-a599-543545f69dc3 tempest-VolumesCloneTest-505531652 None] Lock "cinder-quobyte-e66bf63d-3ea1-4bbe-8cd8-25ef2089ec99" acquired by "delete_volume" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:48:49 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[5094399a-a4e4-4d2e-ae18-ee74ab202804]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:48:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4bb0dc32-590d-4ce6-a599-543545f69dc3 tempest-VolumesCloneTest-505531652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e66bf63d-3ea1-4bbe-8cd8-25ef2089ec99 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:48:49 devstack sudo[91203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e66bf63d-3ea1-4bbe-8cd8-25ef2089ec99 Sep 28 11:48:49 devstack sudo[91203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:48:49 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1fbf2d38-6331-4643-a9f2-84b9bfccb998 tempest-VolumeQuotasAdminTestJSON-98839872 None] Acquiring lock "cinder-8e4a25b3-f9b4-4ac2-a2d9-49262f5ca266-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:48:49 devstack sudo[91203]: pam_unix(sudo:session): session closed for user root Sep 28 11:48:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4bb0dc32-590d-4ce6-a599-543545f69dc3 tempest-VolumesCloneTest-505531652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e66bf63d-3ea1-4bbe-8cd8-25ef2089ec99" returned: 0 in 0.461s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:48:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4bb0dc32-590d-4ce6-a599-543545f69dc3 tempest-VolumesCloneTest-505531652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e66bf63d-3ea1-4bbe-8cd8-25ef2089ec99 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:48:49 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1fbf2d38-6331-4643-a9f2-84b9bfccb998 tempest-VolumeQuotasAdminTestJSON-98839872 None] Lock "cinder-8e4a25b3-f9b4-4ac2-a2d9-49262f5ca266-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:48:49 devstack sudo[91208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e66bf63d-3ea1-4bbe-8cd8-25ef2089ec99 Sep 28 11:48:49 devstack sudo[91208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:48:49 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1fbf2d38-6331-4643-a9f2-84b9bfccb998 tempest-VolumeQuotasAdminTestJSON-98839872 None] Acquiring lock "cinder-quobyte-8e4a25b3-f9b4-4ac2-a2d9-49262f5ca266" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:48:49 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1fbf2d38-6331-4643-a9f2-84b9bfccb998 tempest-VolumeQuotasAdminTestJSON-98839872 None] Lock "cinder-quobyte-8e4a25b3-f9b4-4ac2-a2d9-49262f5ca266" acquired by "delete_volume" :: waited 0.028s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:48:50 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8da628-6fea-495b-af05-8bd13efaf1d8]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:48:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1fbf2d38-6331-4643-a9f2-84b9bfccb998 tempest-VolumeQuotasAdminTestJSON-98839872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8e4a25b3-f9b4-4ac2-a2d9-49262f5ca266 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:48:50 devstack sudo[91210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8e4a25b3-f9b4-4ac2-a2d9-49262f5ca266 Sep 28 11:48:50 devstack sudo[91210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:48:50 devstack sudo[91208]: pam_unix(sudo:session): session closed for user root Sep 28 11:48:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4bb0dc32-590d-4ce6-a599-543545f69dc3 tempest-VolumesCloneTest-505531652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e66bf63d-3ea1-4bbe-8cd8-25ef2089ec99" returned: 0 in 0.309s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:48:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4bb0dc32-590d-4ce6-a599-543545f69dc3 tempest-VolumesCloneTest-505531652 None] Lock "cinder-quobyte-e66bf63d-3ea1-4bbe-8cd8-25ef2089ec99" released by "delete_volume" :: held 0.842s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:48:50 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-4bb0dc32-590d-4ce6-a599-543545f69dc3 tempest-VolumesCloneTest-505531652 None] Created reservations ['89d5b4e9-cc5d-4ce9-a3b2-171322ae672c', '3884a90f-5e9b-45aa-8491-4ee9a0699011', '8c9a4808-2d26-41c5-a1a3-f08b5fc680b5', '664f2b8a-06c8-4a03-9f60-83af00665922'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:48:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4bb0dc32-590d-4ce6-a599-543545f69dc3 tempest-VolumesCloneTest-505531652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:48:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4bb0dc32-590d-4ce6-a599-543545f69dc3 tempest-VolumesCloneTest-505531652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:48:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4bb0dc32-590d-4ce6-a599-543545f69dc3 tempest-VolumesCloneTest-505531652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:48:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4bb0dc32-590d-4ce6-a599-543545f69dc3 tempest-VolumesCloneTest-505531652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:48:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4bb0dc32-590d-4ce6-a599-543545f69dc3 tempest-VolumesCloneTest-505531652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:48:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4bb0dc32-590d-4ce6-a599-543545f69dc3 tempest-VolumesCloneTest-505531652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:48:50 devstack sudo[91215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:48:50 devstack sudo[91215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:48:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8448c82c-4cb2-4a7b-a065-7361b271723c tempest-VolumesCloneTest-505531652 None] Acquiring lock "cinder-af826b33-e979-4417-9726-350b02f737c5-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:48:50 devstack sudo[91210]: pam_unix(sudo:session): session closed for user root Sep 28 11:48:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1fbf2d38-6331-4643-a9f2-84b9bfccb998 tempest-VolumeQuotasAdminTestJSON-98839872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8e4a25b3-f9b4-4ac2-a2d9-49262f5ca266" returned: 0 in 0.591s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:48:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1fbf2d38-6331-4643-a9f2-84b9bfccb998 tempest-VolumeQuotasAdminTestJSON-98839872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8e4a25b3-f9b4-4ac2-a2d9-49262f5ca266 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:48:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8448c82c-4cb2-4a7b-a065-7361b271723c tempest-VolumesCloneTest-505531652 None] Lock "cinder-af826b33-e979-4417-9726-350b02f737c5-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:48:50 devstack sudo[91218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8e4a25b3-f9b4-4ac2-a2d9-49262f5ca266 Sep 28 11:48:50 devstack sudo[91218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:48:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8448c82c-4cb2-4a7b-a065-7361b271723c tempest-VolumesCloneTest-505531652 None] Acquiring lock "cinder-quobyte-af826b33-e979-4417-9726-350b02f737c5" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:48:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8448c82c-4cb2-4a7b-a065-7361b271723c tempest-VolumesCloneTest-505531652 None] Lock "cinder-quobyte-af826b33-e979-4417-9726-350b02f737c5" acquired by "delete_volume" :: waited 0.027s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:48:50 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f7f183-1a70-4347-a728-7a4aca07c7f4]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:48:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8448c82c-4cb2-4a7b-a065-7361b271723c tempest-VolumesCloneTest-505531652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af826b33-e979-4417-9726-350b02f737c5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:48:50 devstack sudo[91220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af826b33-e979-4417-9726-350b02f737c5 Sep 28 11:48:50 devstack sudo[91220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:48:51 devstack sudo[91215]: pam_unix(sudo:session): session closed for user root Sep 28 11:48:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4bb0dc32-590d-4ce6-a599-543545f69dc3 tempest-VolumesCloneTest-505531652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.621s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:48:51 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-4bb0dc32-590d-4ce6-a599-543545f69dc3 tempest-VolumesCloneTest-505531652 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:48:51 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-4bb0dc32-590d-4ce6-a599-543545f69dc3 tempest-VolumesCloneTest-505531652 None] Deleted volume successfully. Sep 28 11:48:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4bb0dc32-590d-4ce6-a599-543545f69dc3 tempest-VolumesCloneTest-505531652 None] Lock "cinder-e66bf63d-3ea1-4bbe-8cd8-25ef2089ec99-delete_volume" released by "delete_volume" :: held 1.819s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:48:51 devstack sudo[91218]: pam_unix(sudo:session): session closed for user root Sep 28 11:48:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1fbf2d38-6331-4643-a9f2-84b9bfccb998 tempest-VolumeQuotasAdminTestJSON-98839872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8e4a25b3-f9b4-4ac2-a2d9-49262f5ca266" returned: 0 in 0.546s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:48:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1fbf2d38-6331-4643-a9f2-84b9bfccb998 tempest-VolumeQuotasAdminTestJSON-98839872 None] Lock "cinder-quobyte-8e4a25b3-f9b4-4ac2-a2d9-49262f5ca266" released by "delete_volume" :: held 1.194s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:48:51 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-1fbf2d38-6331-4643-a9f2-84b9bfccb998 tempest-VolumeQuotasAdminTestJSON-98839872 None] Created reservations ['fc815b7f-218f-4466-a5ab-325e9d64d813', '562a145b-9e3f-4233-b5b7-8642d10efde6', '44be722d-a2f3-4e19-ac28-6490a5305d95', '5ac1934a-6190-4edc-922a-19cec6e43138'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:48:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1fbf2d38-6331-4643-a9f2-84b9bfccb998 tempest-VolumeQuotasAdminTestJSON-98839872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:48:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1fbf2d38-6331-4643-a9f2-84b9bfccb998 tempest-VolumeQuotasAdminTestJSON-98839872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:48:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1fbf2d38-6331-4643-a9f2-84b9bfccb998 tempest-VolumeQuotasAdminTestJSON-98839872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:48:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1fbf2d38-6331-4643-a9f2-84b9bfccb998 tempest-VolumeQuotasAdminTestJSON-98839872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:48:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1fbf2d38-6331-4643-a9f2-84b9bfccb998 tempest-VolumeQuotasAdminTestJSON-98839872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:48:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1fbf2d38-6331-4643-a9f2-84b9bfccb998 tempest-VolumeQuotasAdminTestJSON-98839872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:48:51 devstack sudo[91220]: pam_unix(sudo:session): session closed for user root Sep 28 11:48:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8448c82c-4cb2-4a7b-a065-7361b271723c tempest-VolumesCloneTest-505531652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af826b33-e979-4417-9726-350b02f737c5" returned: 0 in 0.561s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:48:51 devstack sudo[91227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:48:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8448c82c-4cb2-4a7b-a065-7361b271723c tempest-VolumesCloneTest-505531652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af826b33-e979-4417-9726-350b02f737c5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:48:51 devstack sudo[91227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:48:51 devstack sudo[91230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af826b33-e979-4417-9726-350b02f737c5 Sep 28 11:48:51 devstack sudo[91230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:48:51 devstack sudo[91230]: pam_unix(sudo:session): session closed for user root Sep 28 11:48:51 devstack sudo[91227]: pam_unix(sudo:session): session closed for user root Sep 28 11:48:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8448c82c-4cb2-4a7b-a065-7361b271723c tempest-VolumesCloneTest-505531652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af826b33-e979-4417-9726-350b02f737c5" returned: 0 in 0.304s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:48:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1fbf2d38-6331-4643-a9f2-84b9bfccb998 tempest-VolumeQuotasAdminTestJSON-98839872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.356s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:48:51 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-1fbf2d38-6331-4643-a9f2-84b9bfccb998 tempest-VolumeQuotasAdminTestJSON-98839872 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:48:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8448c82c-4cb2-4a7b-a065-7361b271723c tempest-VolumesCloneTest-505531652 None] Lock "cinder-quobyte-af826b33-e979-4417-9726-350b02f737c5" released by "delete_volume" :: held 0.964s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:48:51 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-1fbf2d38-6331-4643-a9f2-84b9bfccb998 tempest-VolumeQuotasAdminTestJSON-98839872 None] Deleted volume successfully. Sep 28 11:48:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1fbf2d38-6331-4643-a9f2-84b9bfccb998 tempest-VolumeQuotasAdminTestJSON-98839872 None] Lock "cinder-8e4a25b3-f9b4-4ac2-a2d9-49262f5ca266-delete_volume" released by "delete_volume" :: held 1.851s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:48:51 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-8448c82c-4cb2-4a7b-a065-7361b271723c tempest-VolumesCloneTest-505531652 None] Created reservations ['947d0406-5355-480f-b1a4-b3d72cad59aa', '0f6fe5b7-f6bd-4fad-9052-f3b3b912b56a', '50bd4d85-de0e-41f0-9f50-05168c1ea328', '98340cbc-7b36-4668-b7f4-142ec12472cb'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:48:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8448c82c-4cb2-4a7b-a065-7361b271723c tempest-VolumesCloneTest-505531652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:48:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8448c82c-4cb2-4a7b-a065-7361b271723c tempest-VolumesCloneTest-505531652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:48:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8448c82c-4cb2-4a7b-a065-7361b271723c tempest-VolumesCloneTest-505531652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:48:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8448c82c-4cb2-4a7b-a065-7361b271723c tempest-VolumesCloneTest-505531652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:48:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8448c82c-4cb2-4a7b-a065-7361b271723c tempest-VolumesCloneTest-505531652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:48:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8448c82c-4cb2-4a7b-a065-7361b271723c tempest-VolumesCloneTest-505531652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:48:51 devstack sudo[91273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:48:51 devstack sudo[91273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:48:52 devstack sudo[91273]: pam_unix(sudo:session): session closed for user root Sep 28 11:48:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8448c82c-4cb2-4a7b-a065-7361b271723c tempest-VolumesCloneTest-505531652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.286s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:48:52 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-8448c82c-4cb2-4a7b-a065-7361b271723c tempest-VolumesCloneTest-505531652 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:48:52 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-8448c82c-4cb2-4a7b-a065-7361b271723c tempest-VolumesCloneTest-505531652 None] Deleted volume successfully. Sep 28 11:48:52 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8448c82c-4cb2-4a7b-a065-7361b271723c tempest-VolumesCloneTest-505531652 None] Lock "cinder-af826b33-e979-4417-9726-350b02f737c5-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:48:52 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d46e933-a86d-4dd4-8cf7-59041623794b tempest-VolumeQuotasAdminTestJSON-98839872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:48:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6d46e933-a86d-4dd4-8cf7-59041623794b tempest-VolumeQuotasAdminTestJSON-98839872 None] Flow 'volume_create_manager' (6fdc9c3b-b7ea-45f4-8275-bcde38da8675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:48:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6d46e933-a86d-4dd4-8cf7-59041623794b tempest-VolumeQuotasAdminTestJSON-98839872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52bdd2ff-7d6a-4244-b21c-fd5dfda67045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:48:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6d46e933-a86d-4dd4-8cf7-59041623794b tempest-VolumeQuotasAdminTestJSON-98839872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52bdd2ff-7d6a-4244-b21c-fd5dfda67045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:48:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1575635865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d788e58-83ca-4784-86e7-a03d1a4d84d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea28d1f079b1403d93cd67e84c29774b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:48:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:48:53Z,use_quota=True,user_id='75fede1315214e7c906ea86531b2b06b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:48:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6d46e933-a86d-4dd4-8cf7-59041623794b tempest-VolumeQuotasAdminTestJSON-98839872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb70a274-178a-42d4-8f96-8483a522e170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:48:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6d46e933-a86d-4dd4-8cf7-59041623794b tempest-VolumeQuotasAdminTestJSON-98839872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb70a274-178a-42d4-8f96-8483a522e170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:48:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6d46e933-a86d-4dd4-8cf7-59041623794b tempest-VolumeQuotasAdminTestJSON-98839872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ebcd33d-604b-4e86-8a55-f352834a0258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:48:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6d46e933-a86d-4dd4-8cf7-59041623794b tempest-VolumeQuotasAdminTestJSON-98839872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ebcd33d-604b-4e86-8a55-f352834a0258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d788e58-83ca-4784-86e7-a03d1a4d84d9', 'volume_name': 'volume-2d788e58-83ca-4784-86e7-a03d1a4d84d9', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:48:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6d46e933-a86d-4dd4-8cf7-59041623794b tempest-VolumeQuotasAdminTestJSON-98839872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97ebd67d-350c-44e6-9e0c-f28331042600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:48:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6d46e933-a86d-4dd4-8cf7-59041623794b tempest-VolumeQuotasAdminTestJSON-98839872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97ebd67d-350c-44e6-9e0c-f28331042600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:48:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6d46e933-a86d-4dd4-8cf7-59041623794b tempest-VolumeQuotasAdminTestJSON-98839872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92855c78-3718-47ba-8d71-7dfa4360f614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:48:52 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-6d46e933-a86d-4dd4-8cf7-59041623794b tempest-VolumeQuotasAdminTestJSON-98839872 None] Volume 2d788e58-83ca-4784-86e7-a03d1a4d84d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d788e58-83ca-4784-86e7-a03d1a4d84d9', 'volume_size': 1} Sep 28 11:48:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6d46e933-a86d-4dd4-8cf7-59041623794b tempest-VolumeQuotasAdminTestJSON-98839872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:48:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6d46e933-a86d-4dd4-8cf7-59041623794b tempest-VolumeQuotasAdminTestJSON-98839872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:48:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6d46e933-a86d-4dd4-8cf7-59041623794b tempest-VolumeQuotasAdminTestJSON-98839872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:48:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1575635865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d788e58-83ca-4784-86e7-a03d1a4d84d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea28d1f079b1403d93cd67e84c29774b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:48:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:48:53Z,use_quota=True,user_id='75fede1315214e7c906ea86531b2b06b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:48:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-6d46e933-a86d-4dd4-8cf7-59041623794b tempest-VolumeQuotasAdminTestJSON-98839872 None] Creating volume 2d788e58-83ca-4784-86e7-a03d1a4d84d9 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:48:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6d46e933-a86d-4dd4-8cf7-59041623794b tempest-VolumeQuotasAdminTestJSON-98839872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:48:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6d46e933-a86d-4dd4-8cf7-59041623794b tempest-VolumeQuotasAdminTestJSON-98839872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:48:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6d46e933-a86d-4dd4-8cf7-59041623794b tempest-VolumeQuotasAdminTestJSON-98839872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:48:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6d46e933-a86d-4dd4-8cf7-59041623794b tempest-VolumeQuotasAdminTestJSON-98839872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:48:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6d46e933-a86d-4dd4-8cf7-59041623794b tempest-VolumeQuotasAdminTestJSON-98839872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:48:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6d46e933-a86d-4dd4-8cf7-59041623794b tempest-VolumeQuotasAdminTestJSON-98839872 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:48:52 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-6d46e933-a86d-4dd4-8cf7-59041623794b tempest-VolumeQuotasAdminTestJSON-98839872 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:48:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6d46e933-a86d-4dd4-8cf7-59041623794b tempest-VolumeQuotasAdminTestJSON-98839872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2d788e58-83ca-4784-86e7-a03d1a4d84d9 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:48:52 devstack sudo[91276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2d788e58-83ca-4784-86e7-a03d1a4d84d9 1073741824 Sep 28 11:48:52 devstack sudo[91276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:48:53 devstack sudo[91276]: pam_unix(sudo:session): session closed for user root Sep 28 11:48:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6d46e933-a86d-4dd4-8cf7-59041623794b tempest-VolumeQuotasAdminTestJSON-98839872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2d788e58-83ca-4784-86e7-a03d1a4d84d9 1073741824" returned: 0 in 0.483s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:48:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6d46e933-a86d-4dd4-8cf7-59041623794b tempest-VolumeQuotasAdminTestJSON-98839872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2d788e58-83ca-4784-86e7-a03d1a4d84d9 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:48:53 devstack sudo[91284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2d788e58-83ca-4784-86e7-a03d1a4d84d9 Sep 28 11:48:53 devstack sudo[91284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:48:53 devstack sudo[91284]: pam_unix(sudo:session): session closed for user root Sep 28 11:48:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6d46e933-a86d-4dd4-8cf7-59041623794b tempest-VolumeQuotasAdminTestJSON-98839872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2d788e58-83ca-4784-86e7-a03d1a4d84d9" returned: 0 in 0.264s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:48:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6d46e933-a86d-4dd4-8cf7-59041623794b tempest-VolumeQuotasAdminTestJSON-98839872 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:48:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6d46e933-a86d-4dd4-8cf7-59041623794b tempest-VolumeQuotasAdminTestJSON-98839872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:48:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6d46e933-a86d-4dd4-8cf7-59041623794b tempest-VolumeQuotasAdminTestJSON-98839872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92855c78-3718-47ba-8d71-7dfa4360f614) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d788e58-83ca-4784-86e7-a03d1a4d84d9', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:48:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6d46e933-a86d-4dd4-8cf7-59041623794b tempest-VolumeQuotasAdminTestJSON-98839872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c60fb60e-f9ae-4167-8678-bb0cb3b64701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:48:53 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-6d46e933-a86d-4dd4-8cf7-59041623794b tempest-VolumeQuotasAdminTestJSON-98839872 None] Volume volume-2d788e58-83ca-4784-86e7-a03d1a4d84d9 (2d788e58-83ca-4784-86e7-a03d1a4d84d9): created successfully Sep 28 11:48:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6d46e933-a86d-4dd4-8cf7-59041623794b tempest-VolumeQuotasAdminTestJSON-98839872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c60fb60e-f9ae-4167-8678-bb0cb3b64701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:48:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6d46e933-a86d-4dd4-8cf7-59041623794b tempest-VolumeQuotasAdminTestJSON-98839872 None] Flow 'volume_create_manager' (6fdc9c3b-b7ea-45f4-8275-bcde38da8675) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:48:53 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-6d46e933-a86d-4dd4-8cf7-59041623794b tempest-VolumeQuotasAdminTestJSON-98839872 None] Created volume successfully. Sep 28 11:48:55 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-6dd29791-d5a7-42ba-b29f-61d24790d13c tempest-VolumeQuotasAdminTestJSON-1994437289 None] Transfer volume completed successfully. Sep 28 11:48:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c869b083-07fc-4d46-9aec-1e75646c378b tempest-VolumeQuotasAdminTestJSON-1122724994 None] Acquiring lock "cinder-2d788e58-83ca-4784-86e7-a03d1a4d84d9-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:48:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c869b083-07fc-4d46-9aec-1e75646c378b tempest-VolumeQuotasAdminTestJSON-1122724994 None] Lock "cinder-2d788e58-83ca-4784-86e7-a03d1a4d84d9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:48:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c869b083-07fc-4d46-9aec-1e75646c378b tempest-VolumeQuotasAdminTestJSON-1122724994 None] Acquiring lock "cinder-quobyte-2d788e58-83ca-4784-86e7-a03d1a4d84d9" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:48:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c869b083-07fc-4d46-9aec-1e75646c378b tempest-VolumeQuotasAdminTestJSON-1122724994 None] Lock "cinder-quobyte-2d788e58-83ca-4784-86e7-a03d1a4d84d9" acquired by "delete_volume" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:48:56 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[977fa338-b4d3-49a2-a710-74c7799fbc0a]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:48:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c869b083-07fc-4d46-9aec-1e75646c378b tempest-VolumeQuotasAdminTestJSON-1122724994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2d788e58-83ca-4784-86e7-a03d1a4d84d9 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:48:56 devstack sudo[91290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2d788e58-83ca-4784-86e7-a03d1a4d84d9 Sep 28 11:48:56 devstack sudo[91290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:48:56 devstack sudo[91290]: pam_unix(sudo:session): session closed for user root Sep 28 11:48:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c869b083-07fc-4d46-9aec-1e75646c378b tempest-VolumeQuotasAdminTestJSON-1122724994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2d788e58-83ca-4784-86e7-a03d1a4d84d9" returned: 0 in 0.417s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:48:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c869b083-07fc-4d46-9aec-1e75646c378b tempest-VolumeQuotasAdminTestJSON-1122724994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2d788e58-83ca-4784-86e7-a03d1a4d84d9 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:48:56 devstack sudo[91295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2d788e58-83ca-4784-86e7-a03d1a4d84d9 Sep 28 11:48:56 devstack sudo[91295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:48:56 devstack sudo[91295]: pam_unix(sudo:session): session closed for user root Sep 28 11:48:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c869b083-07fc-4d46-9aec-1e75646c378b tempest-VolumeQuotasAdminTestJSON-1122724994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2d788e58-83ca-4784-86e7-a03d1a4d84d9" returned: 0 in 0.270s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:48:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c869b083-07fc-4d46-9aec-1e75646c378b tempest-VolumeQuotasAdminTestJSON-1122724994 None] Lock "cinder-quobyte-2d788e58-83ca-4784-86e7-a03d1a4d84d9" released by "delete_volume" :: held 0.748s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:48:57 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-c869b083-07fc-4d46-9aec-1e75646c378b tempest-VolumeQuotasAdminTestJSON-1122724994 None] Created reservations ['cf29b38a-853e-4fc0-8d11-70eb1108e833', '5e154cfd-34c2-48da-ad4a-e04b5002a1ff', '2ab5f80c-c681-4130-815e-bcf1e2bea485', '8125763b-a0e5-4c95-bdeb-1365757dfa91'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:48:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c869b083-07fc-4d46-9aec-1e75646c378b tempest-VolumeQuotasAdminTestJSON-1122724994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:48:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c869b083-07fc-4d46-9aec-1e75646c378b tempest-VolumeQuotasAdminTestJSON-1122724994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:48:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c869b083-07fc-4d46-9aec-1e75646c378b tempest-VolumeQuotasAdminTestJSON-1122724994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:48:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c869b083-07fc-4d46-9aec-1e75646c378b tempest-VolumeQuotasAdminTestJSON-1122724994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:48:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c869b083-07fc-4d46-9aec-1e75646c378b tempest-VolumeQuotasAdminTestJSON-1122724994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:48:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c869b083-07fc-4d46-9aec-1e75646c378b tempest-VolumeQuotasAdminTestJSON-1122724994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:48:57 devstack sudo[91298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:48:57 devstack sudo[91298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:48:57 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b7bdec7-d1cb-447d-876a-0059f06cde64 tempest-VolumesListTestJSON-1251130800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:48:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9b7bdec7-d1cb-447d-876a-0059f06cde64 tempest-VolumesListTestJSON-1251130800 None] Flow 'volume_create_manager' (69064811-d716-47be-b9dc-6b4620464b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:48:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9b7bdec7-d1cb-447d-876a-0059f06cde64 tempest-VolumesListTestJSON-1251130800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acca090d-e99c-44a9-8984-816d092438c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:48:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9b7bdec7-d1cb-447d-876a-0059f06cde64 tempest-VolumesListTestJSON-1251130800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acca090d-e99c-44a9-8984-816d092438c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:48:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-12725190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f8166b3-c878-4999-be98-2acb52a00afd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='25c9fa00359c4182a2d3d339040f45a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:48:57Z,use_quota=True,user_id='466dfc9a0d6a4f5cada2f672abfad945',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:48:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9b7bdec7-d1cb-447d-876a-0059f06cde64 tempest-VolumesListTestJSON-1251130800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (940fbbb4-7420-45f3-9007-05180065a2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:48:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9b7bdec7-d1cb-447d-876a-0059f06cde64 tempest-VolumesListTestJSON-1251130800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (940fbbb4-7420-45f3-9007-05180065a2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:48:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9b7bdec7-d1cb-447d-876a-0059f06cde64 tempest-VolumesListTestJSON-1251130800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7675535f-bde2-4c72-9faf-77b83886a2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:48:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9b7bdec7-d1cb-447d-876a-0059f06cde64 tempest-VolumesListTestJSON-1251130800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7675535f-bde2-4c72-9faf-77b83886a2cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f8166b3-c878-4999-be98-2acb52a00afd', 'volume_name': 'volume-5f8166b3-c878-4999-be98-2acb52a00afd', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:48:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9b7bdec7-d1cb-447d-876a-0059f06cde64 tempest-VolumesListTestJSON-1251130800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (084fbcb3-7e22-44ef-837a-2810203a531e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:48:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9b7bdec7-d1cb-447d-876a-0059f06cde64 tempest-VolumesListTestJSON-1251130800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (084fbcb3-7e22-44ef-837a-2810203a531e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:48:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9b7bdec7-d1cb-447d-876a-0059f06cde64 tempest-VolumesListTestJSON-1251130800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a76ed14-577b-49dd-8fda-cfb9612ba747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:48:57 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-9b7bdec7-d1cb-447d-876a-0059f06cde64 tempest-VolumesListTestJSON-1251130800 None] Volume 5f8166b3-c878-4999-be98-2acb52a00afd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f8166b3-c878-4999-be98-2acb52a00afd', 'volume_size': 1} Sep 28 11:48:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9b7bdec7-d1cb-447d-876a-0059f06cde64 tempest-VolumesListTestJSON-1251130800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:48:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9b7bdec7-d1cb-447d-876a-0059f06cde64 tempest-VolumesListTestJSON-1251130800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:48:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9b7bdec7-d1cb-447d-876a-0059f06cde64 tempest-VolumesListTestJSON-1251130800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:48:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-12725190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f8166b3-c878-4999-be98-2acb52a00afd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='25c9fa00359c4182a2d3d339040f45a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:48:57Z,use_quota=True,user_id='466dfc9a0d6a4f5cada2f672abfad945',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:48:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-9b7bdec7-d1cb-447d-876a-0059f06cde64 tempest-VolumesListTestJSON-1251130800 None] Creating volume 5f8166b3-c878-4999-be98-2acb52a00afd {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:48:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9b7bdec7-d1cb-447d-876a-0059f06cde64 tempest-VolumesListTestJSON-1251130800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:48:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9b7bdec7-d1cb-447d-876a-0059f06cde64 tempest-VolumesListTestJSON-1251130800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:48:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9b7bdec7-d1cb-447d-876a-0059f06cde64 tempest-VolumesListTestJSON-1251130800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:48:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9b7bdec7-d1cb-447d-876a-0059f06cde64 tempest-VolumesListTestJSON-1251130800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:48:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9b7bdec7-d1cb-447d-876a-0059f06cde64 tempest-VolumesListTestJSON-1251130800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:48:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9b7bdec7-d1cb-447d-876a-0059f06cde64 tempest-VolumesListTestJSON-1251130800 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:48:57 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-9b7bdec7-d1cb-447d-876a-0059f06cde64 tempest-VolumesListTestJSON-1251130800 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:48:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9b7bdec7-d1cb-447d-876a-0059f06cde64 tempest-VolumesListTestJSON-1251130800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5f8166b3-c878-4999-be98-2acb52a00afd 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:48:57 devstack sudo[91300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5f8166b3-c878-4999-be98-2acb52a00afd 1073741824 Sep 28 11:48:57 devstack sudo[91300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:48:57 devstack sudo[91298]: pam_unix(sudo:session): session closed for user root Sep 28 11:48:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c869b083-07fc-4d46-9aec-1e75646c378b tempest-VolumeQuotasAdminTestJSON-1122724994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.332s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:48:57 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-c869b083-07fc-4d46-9aec-1e75646c378b tempest-VolumeQuotasAdminTestJSON-1122724994 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:48:57 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-c869b083-07fc-4d46-9aec-1e75646c378b tempest-VolumeQuotasAdminTestJSON-1122724994 None] Deleted volume successfully. Sep 28 11:48:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c869b083-07fc-4d46-9aec-1e75646c378b tempest-VolumeQuotasAdminTestJSON-1122724994 None] Lock "cinder-2d788e58-83ca-4784-86e7-a03d1a4d84d9-delete_volume" released by "delete_volume" :: held 1.347s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:48:57 devstack sudo[91300]: pam_unix(sudo:session): session closed for user root Sep 28 11:48:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9b7bdec7-d1cb-447d-876a-0059f06cde64 tempest-VolumesListTestJSON-1251130800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5f8166b3-c878-4999-be98-2acb52a00afd 1073741824" returned: 0 in 0.546s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:48:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9b7bdec7-d1cb-447d-876a-0059f06cde64 tempest-VolumesListTestJSON-1251130800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5f8166b3-c878-4999-be98-2acb52a00afd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:48:57 devstack sudo[91307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5f8166b3-c878-4999-be98-2acb52a00afd Sep 28 11:48:57 devstack sudo[91307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:48:58 devstack sudo[91307]: pam_unix(sudo:session): session closed for user root Sep 28 11:48:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9b7bdec7-d1cb-447d-876a-0059f06cde64 tempest-VolumesListTestJSON-1251130800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5f8166b3-c878-4999-be98-2acb52a00afd" returned: 0 in 0.289s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:48:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9b7bdec7-d1cb-447d-876a-0059f06cde64 tempest-VolumesListTestJSON-1251130800 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:48:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9b7bdec7-d1cb-447d-876a-0059f06cde64 tempest-VolumesListTestJSON-1251130800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:48:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9b7bdec7-d1cb-447d-876a-0059f06cde64 tempest-VolumesListTestJSON-1251130800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a76ed14-577b-49dd-8fda-cfb9612ba747) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f8166b3-c878-4999-be98-2acb52a00afd', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:48:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9b7bdec7-d1cb-447d-876a-0059f06cde64 tempest-VolumesListTestJSON-1251130800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (015d1126-5ea2-4cb6-a23a-9ef2153237e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:48:58 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-9b7bdec7-d1cb-447d-876a-0059f06cde64 tempest-VolumesListTestJSON-1251130800 None] Volume volume-5f8166b3-c878-4999-be98-2acb52a00afd (5f8166b3-c878-4999-be98-2acb52a00afd): created successfully Sep 28 11:48:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9b7bdec7-d1cb-447d-876a-0059f06cde64 tempest-VolumesListTestJSON-1251130800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (015d1126-5ea2-4cb6-a23a-9ef2153237e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:48:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9b7bdec7-d1cb-447d-876a-0059f06cde64 tempest-VolumesListTestJSON-1251130800 None] Flow 'volume_create_manager' (69064811-d716-47be-b9dc-6b4620464b66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:48:58 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-9b7bdec7-d1cb-447d-876a-0059f06cde64 tempest-VolumesListTestJSON-1251130800 None] Created volume successfully. Sep 28 11:49:00 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bc4f1f7-e7b0-4172-9507-f1945fe53ec9 tempest-VolumesListTestJSON-1251130800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:49:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1bc4f1f7-e7b0-4172-9507-f1945fe53ec9 tempest-VolumesListTestJSON-1251130800 None] Flow 'volume_create_manager' (0b1b85f2-dae1-4285-b670-70e9fcc5395b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:49:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1bc4f1f7-e7b0-4172-9507-f1945fe53ec9 tempest-VolumesListTestJSON-1251130800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05180a47-9d25-4ced-8add-de149bfc6edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:49:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1bc4f1f7-e7b0-4172-9507-f1945fe53ec9 tempest-VolumesListTestJSON-1251130800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05180a47-9d25-4ced-8add-de149bfc6edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:49:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-538729957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=035589e1-0da5-4a3b-b388-61850d580c15,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='25c9fa00359c4182a2d3d339040f45a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:49:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:49:00Z,use_quota=True,user_id='466dfc9a0d6a4f5cada2f672abfad945',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:49:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1bc4f1f7-e7b0-4172-9507-f1945fe53ec9 tempest-VolumesListTestJSON-1251130800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7eebc1c-ec4f-4896-9095-71537df53bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:49:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1bc4f1f7-e7b0-4172-9507-f1945fe53ec9 tempest-VolumesListTestJSON-1251130800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7eebc1c-ec4f-4896-9095-71537df53bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:49:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1bc4f1f7-e7b0-4172-9507-f1945fe53ec9 tempest-VolumesListTestJSON-1251130800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dd6b6b1-180b-445e-a682-913352434fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:49:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1bc4f1f7-e7b0-4172-9507-f1945fe53ec9 tempest-VolumesListTestJSON-1251130800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dd6b6b1-180b-445e-a682-913352434fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '035589e1-0da5-4a3b-b388-61850d580c15', 'volume_name': 'volume-035589e1-0da5-4a3b-b388-61850d580c15', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:49:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1bc4f1f7-e7b0-4172-9507-f1945fe53ec9 tempest-VolumesListTestJSON-1251130800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58d49fde-a2b2-43e1-bbff-c78b70e99821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:49:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1bc4f1f7-e7b0-4172-9507-f1945fe53ec9 tempest-VolumesListTestJSON-1251130800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58d49fde-a2b2-43e1-bbff-c78b70e99821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:49:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1bc4f1f7-e7b0-4172-9507-f1945fe53ec9 tempest-VolumesListTestJSON-1251130800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0da18415-2cc1-4cac-84dc-adad0353293d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:49:00 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-1bc4f1f7-e7b0-4172-9507-f1945fe53ec9 tempest-VolumesListTestJSON-1251130800 None] Volume 035589e1-0da5-4a3b-b388-61850d580c15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-035589e1-0da5-4a3b-b388-61850d580c15', 'volume_size': 1} Sep 28 11:49:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1bc4f1f7-e7b0-4172-9507-f1945fe53ec9 tempest-VolumesListTestJSON-1251130800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:49:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1bc4f1f7-e7b0-4172-9507-f1945fe53ec9 tempest-VolumesListTestJSON-1251130800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:49:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1bc4f1f7-e7b0-4172-9507-f1945fe53ec9 tempest-VolumesListTestJSON-1251130800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:49:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-538729957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=035589e1-0da5-4a3b-b388-61850d580c15,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='25c9fa00359c4182a2d3d339040f45a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:49:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:49:00Z,use_quota=True,user_id='466dfc9a0d6a4f5cada2f672abfad945',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:49:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-1bc4f1f7-e7b0-4172-9507-f1945fe53ec9 tempest-VolumesListTestJSON-1251130800 None] Creating volume 035589e1-0da5-4a3b-b388-61850d580c15 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:49:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1bc4f1f7-e7b0-4172-9507-f1945fe53ec9 tempest-VolumesListTestJSON-1251130800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:49:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1bc4f1f7-e7b0-4172-9507-f1945fe53ec9 tempest-VolumesListTestJSON-1251130800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:49:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1bc4f1f7-e7b0-4172-9507-f1945fe53ec9 tempest-VolumesListTestJSON-1251130800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:49:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1bc4f1f7-e7b0-4172-9507-f1945fe53ec9 tempest-VolumesListTestJSON-1251130800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:49:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1bc4f1f7-e7b0-4172-9507-f1945fe53ec9 tempest-VolumesListTestJSON-1251130800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:49:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1bc4f1f7-e7b0-4172-9507-f1945fe53ec9 tempest-VolumesListTestJSON-1251130800 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:49:00 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-1bc4f1f7-e7b0-4172-9507-f1945fe53ec9 tempest-VolumesListTestJSON-1251130800 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:49:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1bc4f1f7-e7b0-4172-9507-f1945fe53ec9 tempest-VolumesListTestJSON-1251130800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-035589e1-0da5-4a3b-b388-61850d580c15 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:00 devstack sudo[91314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-035589e1-0da5-4a3b-b388-61850d580c15 1073741824 Sep 28 11:49:00 devstack sudo[91314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:00 devstack sudo[91314]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1bc4f1f7-e7b0-4172-9507-f1945fe53ec9 tempest-VolumesListTestJSON-1251130800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-035589e1-0da5-4a3b-b388-61850d580c15 1073741824" returned: 0 in 0.527s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1bc4f1f7-e7b0-4172-9507-f1945fe53ec9 tempest-VolumesListTestJSON-1251130800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-035589e1-0da5-4a3b-b388-61850d580c15 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:00 devstack sudo[91320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-035589e1-0da5-4a3b-b388-61850d580c15 Sep 28 11:49:00 devstack sudo[91320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:01 devstack sudo[91320]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1bc4f1f7-e7b0-4172-9507-f1945fe53ec9 tempest-VolumesListTestJSON-1251130800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-035589e1-0da5-4a3b-b388-61850d580c15" returned: 0 in 0.268s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1bc4f1f7-e7b0-4172-9507-f1945fe53ec9 tempest-VolumesListTestJSON-1251130800 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:49:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1bc4f1f7-e7b0-4172-9507-f1945fe53ec9 tempest-VolumesListTestJSON-1251130800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:49:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1bc4f1f7-e7b0-4172-9507-f1945fe53ec9 tempest-VolumesListTestJSON-1251130800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0da18415-2cc1-4cac-84dc-adad0353293d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-035589e1-0da5-4a3b-b388-61850d580c15', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:49:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1bc4f1f7-e7b0-4172-9507-f1945fe53ec9 tempest-VolumesListTestJSON-1251130800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59e03224-fab7-45ef-a6f6-9a5fa335b2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:49:01 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-1bc4f1f7-e7b0-4172-9507-f1945fe53ec9 tempest-VolumesListTestJSON-1251130800 None] Volume volume-035589e1-0da5-4a3b-b388-61850d580c15 (035589e1-0da5-4a3b-b388-61850d580c15): created successfully Sep 28 11:49:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1bc4f1f7-e7b0-4172-9507-f1945fe53ec9 tempest-VolumesListTestJSON-1251130800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59e03224-fab7-45ef-a6f6-9a5fa335b2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:49:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1bc4f1f7-e7b0-4172-9507-f1945fe53ec9 tempest-VolumesListTestJSON-1251130800 None] Flow 'volume_create_manager' (0b1b85f2-dae1-4285-b670-70e9fcc5395b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:49:01 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-1bc4f1f7-e7b0-4172-9507-f1945fe53ec9 tempest-VolumesListTestJSON-1251130800 None] Created volume successfully. Sep 28 11:49:02 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c674b7d-c3e8-4a1c-9a29-0fdf8c501d1f tempest-VolumesListTestJSON-1251130800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:49:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4c674b7d-c3e8-4a1c-9a29-0fdf8c501d1f tempest-VolumesListTestJSON-1251130800 None] Flow 'volume_create_manager' (39de4db4-f800-45d6-a604-d6854edb7045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:49:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4c674b7d-c3e8-4a1c-9a29-0fdf8c501d1f tempest-VolumesListTestJSON-1251130800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b843e83-75b1-4c57-b7ed-18f8673cb111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:49:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4c674b7d-c3e8-4a1c-9a29-0fdf8c501d1f tempest-VolumesListTestJSON-1251130800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b843e83-75b1-4c57-b7ed-18f8673cb111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:49:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1282901036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=915217de-d4cc-4a3a-a3dd-2c52bec84aed,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='25c9fa00359c4182a2d3d339040f45a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:49:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:49:03Z,use_quota=True,user_id='466dfc9a0d6a4f5cada2f672abfad945',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:49:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4c674b7d-c3e8-4a1c-9a29-0fdf8c501d1f tempest-VolumesListTestJSON-1251130800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60794a76-0c62-4412-b74b-c360a1552b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:49:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4c674b7d-c3e8-4a1c-9a29-0fdf8c501d1f tempest-VolumesListTestJSON-1251130800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60794a76-0c62-4412-b74b-c360a1552b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:49:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4c674b7d-c3e8-4a1c-9a29-0fdf8c501d1f tempest-VolumesListTestJSON-1251130800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea1a79ad-5df4-4e4e-8401-dc5bc7e5d507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:49:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4c674b7d-c3e8-4a1c-9a29-0fdf8c501d1f tempest-VolumesListTestJSON-1251130800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea1a79ad-5df4-4e4e-8401-dc5bc7e5d507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '915217de-d4cc-4a3a-a3dd-2c52bec84aed', 'volume_name': 'volume-915217de-d4cc-4a3a-a3dd-2c52bec84aed', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:49:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4c674b7d-c3e8-4a1c-9a29-0fdf8c501d1f tempest-VolumesListTestJSON-1251130800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79488393-417b-4160-9d8a-258176852275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:49:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4c674b7d-c3e8-4a1c-9a29-0fdf8c501d1f tempest-VolumesListTestJSON-1251130800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79488393-417b-4160-9d8a-258176852275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:49:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4c674b7d-c3e8-4a1c-9a29-0fdf8c501d1f tempest-VolumesListTestJSON-1251130800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (211001c6-1a70-4ec5-b62c-bb943e7f0deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:49:02 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-4c674b7d-c3e8-4a1c-9a29-0fdf8c501d1f tempest-VolumesListTestJSON-1251130800 None] Volume 915217de-d4cc-4a3a-a3dd-2c52bec84aed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-915217de-d4cc-4a3a-a3dd-2c52bec84aed', 'volume_size': 1} Sep 28 11:49:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4c674b7d-c3e8-4a1c-9a29-0fdf8c501d1f tempest-VolumesListTestJSON-1251130800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:49:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4c674b7d-c3e8-4a1c-9a29-0fdf8c501d1f tempest-VolumesListTestJSON-1251130800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:49:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4c674b7d-c3e8-4a1c-9a29-0fdf8c501d1f tempest-VolumesListTestJSON-1251130800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:49:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1282901036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=915217de-d4cc-4a3a-a3dd-2c52bec84aed,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='25c9fa00359c4182a2d3d339040f45a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:49:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:49:03Z,use_quota=True,user_id='466dfc9a0d6a4f5cada2f672abfad945',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:49:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-4c674b7d-c3e8-4a1c-9a29-0fdf8c501d1f tempest-VolumesListTestJSON-1251130800 None] Creating volume 915217de-d4cc-4a3a-a3dd-2c52bec84aed {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:49:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4c674b7d-c3e8-4a1c-9a29-0fdf8c501d1f tempest-VolumesListTestJSON-1251130800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:49:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4c674b7d-c3e8-4a1c-9a29-0fdf8c501d1f tempest-VolumesListTestJSON-1251130800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:49:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4c674b7d-c3e8-4a1c-9a29-0fdf8c501d1f tempest-VolumesListTestJSON-1251130800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:49:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4c674b7d-c3e8-4a1c-9a29-0fdf8c501d1f tempest-VolumesListTestJSON-1251130800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:49:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4c674b7d-c3e8-4a1c-9a29-0fdf8c501d1f tempest-VolumesListTestJSON-1251130800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:49:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4c674b7d-c3e8-4a1c-9a29-0fdf8c501d1f tempest-VolumesListTestJSON-1251130800 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:49:02 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-4c674b7d-c3e8-4a1c-9a29-0fdf8c501d1f tempest-VolumesListTestJSON-1251130800 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:49:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4c674b7d-c3e8-4a1c-9a29-0fdf8c501d1f tempest-VolumesListTestJSON-1251130800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-915217de-d4cc-4a3a-a3dd-2c52bec84aed 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:02 devstack sudo[91370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-915217de-d4cc-4a3a-a3dd-2c52bec84aed 1073741824 Sep 28 11:49:02 devstack sudo[91370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:03 devstack sudo[91370]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4c674b7d-c3e8-4a1c-9a29-0fdf8c501d1f tempest-VolumesListTestJSON-1251130800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-915217de-d4cc-4a3a-a3dd-2c52bec84aed 1073741824" returned: 0 in 0.524s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4c674b7d-c3e8-4a1c-9a29-0fdf8c501d1f tempest-VolumesListTestJSON-1251130800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-915217de-d4cc-4a3a-a3dd-2c52bec84aed {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:03 devstack sudo[91386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-915217de-d4cc-4a3a-a3dd-2c52bec84aed Sep 28 11:49:03 devstack sudo[91386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:03 devstack sudo[91386]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4c674b7d-c3e8-4a1c-9a29-0fdf8c501d1f tempest-VolumesListTestJSON-1251130800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-915217de-d4cc-4a3a-a3dd-2c52bec84aed" returned: 0 in 0.286s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4c674b7d-c3e8-4a1c-9a29-0fdf8c501d1f tempest-VolumesListTestJSON-1251130800 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:49:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4c674b7d-c3e8-4a1c-9a29-0fdf8c501d1f tempest-VolumesListTestJSON-1251130800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:49:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4c674b7d-c3e8-4a1c-9a29-0fdf8c501d1f tempest-VolumesListTestJSON-1251130800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (211001c6-1a70-4ec5-b62c-bb943e7f0deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-915217de-d4cc-4a3a-a3dd-2c52bec84aed', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:49:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4c674b7d-c3e8-4a1c-9a29-0fdf8c501d1f tempest-VolumesListTestJSON-1251130800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (933278a6-7b5e-4c1c-a116-82ead39ec537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:49:03 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-4c674b7d-c3e8-4a1c-9a29-0fdf8c501d1f tempest-VolumesListTestJSON-1251130800 None] Volume volume-915217de-d4cc-4a3a-a3dd-2c52bec84aed (915217de-d4cc-4a3a-a3dd-2c52bec84aed): created successfully Sep 28 11:49:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4c674b7d-c3e8-4a1c-9a29-0fdf8c501d1f tempest-VolumesListTestJSON-1251130800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (933278a6-7b5e-4c1c-a116-82ead39ec537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:49:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4c674b7d-c3e8-4a1c-9a29-0fdf8c501d1f tempest-VolumesListTestJSON-1251130800 None] Flow 'volume_create_manager' (39de4db4-f800-45d6-a604-d6854edb7045) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:49:03 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-4c674b7d-c3e8-4a1c-9a29-0fdf8c501d1f tempest-VolumesListTestJSON-1251130800 None] Created volume successfully. Sep 28 11:49:05 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-47fd4356-acfc-47da-b254-59621c7c8583 tempest-VolumeQuotasNegativeTestJSON-2062885025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:49:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-47fd4356-acfc-47da-b254-59621c7c8583 tempest-VolumeQuotasNegativeTestJSON-2062885025 None] Flow 'volume_create_manager' (4256974a-c421-478d-b194-08d30ab22104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:49:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-47fd4356-acfc-47da-b254-59621c7c8583 tempest-VolumeQuotasNegativeTestJSON-2062885025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f44c6b4-b302-488d-b14e-3cf6a03b1274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:49:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-47fd4356-acfc-47da-b254-59621c7c8583 tempest-VolumeQuotasNegativeTestJSON-2062885025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f44c6b4-b302-488d-b14e-3cf6a03b1274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:49:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-180575145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1638f74-ca02-4453-8bcb-3123e1bc95a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4414b6c2daa54e45bb2802fad725012b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:49:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:49:05Z,use_quota=True,user_id='17e846f47fb14d1e97e74071be027bf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:49:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-47fd4356-acfc-47da-b254-59621c7c8583 tempest-VolumeQuotasNegativeTestJSON-2062885025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc9e54ec-d53f-4168-923d-fc6f690fffc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:49:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-47fd4356-acfc-47da-b254-59621c7c8583 tempest-VolumeQuotasNegativeTestJSON-2062885025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc9e54ec-d53f-4168-923d-fc6f690fffc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:49:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-47fd4356-acfc-47da-b254-59621c7c8583 tempest-VolumeQuotasNegativeTestJSON-2062885025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0b43133-2184-4715-b100-7ddec204e870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:49:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-47fd4356-acfc-47da-b254-59621c7c8583 tempest-VolumeQuotasNegativeTestJSON-2062885025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0b43133-2184-4715-b100-7ddec204e870) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1638f74-ca02-4453-8bcb-3123e1bc95a8', 'volume_name': 'volume-c1638f74-ca02-4453-8bcb-3123e1bc95a8', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:49:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-47fd4356-acfc-47da-b254-59621c7c8583 tempest-VolumeQuotasNegativeTestJSON-2062885025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dd1cc39-98fb-44af-b832-3c2431c8e619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:49:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-47fd4356-acfc-47da-b254-59621c7c8583 tempest-VolumeQuotasNegativeTestJSON-2062885025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dd1cc39-98fb-44af-b832-3c2431c8e619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:49:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-47fd4356-acfc-47da-b254-59621c7c8583 tempest-VolumeQuotasNegativeTestJSON-2062885025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eb85107-5392-48e6-9c67-decbd306257d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:49:05 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-47fd4356-acfc-47da-b254-59621c7c8583 tempest-VolumeQuotasNegativeTestJSON-2062885025 None] Volume c1638f74-ca02-4453-8bcb-3123e1bc95a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1638f74-ca02-4453-8bcb-3123e1bc95a8', 'volume_size': 1} Sep 28 11:49:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-47fd4356-acfc-47da-b254-59621c7c8583 tempest-VolumeQuotasNegativeTestJSON-2062885025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:49:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-47fd4356-acfc-47da-b254-59621c7c8583 tempest-VolumeQuotasNegativeTestJSON-2062885025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:49:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-47fd4356-acfc-47da-b254-59621c7c8583 tempest-VolumeQuotasNegativeTestJSON-2062885025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:49:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-180575145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1638f74-ca02-4453-8bcb-3123e1bc95a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4414b6c2daa54e45bb2802fad725012b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:49:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:49:05Z,use_quota=True,user_id='17e846f47fb14d1e97e74071be027bf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:49:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-47fd4356-acfc-47da-b254-59621c7c8583 tempest-VolumeQuotasNegativeTestJSON-2062885025 None] Creating volume c1638f74-ca02-4453-8bcb-3123e1bc95a8 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:49:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-47fd4356-acfc-47da-b254-59621c7c8583 tempest-VolumeQuotasNegativeTestJSON-2062885025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:49:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-47fd4356-acfc-47da-b254-59621c7c8583 tempest-VolumeQuotasNegativeTestJSON-2062885025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:49:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-47fd4356-acfc-47da-b254-59621c7c8583 tempest-VolumeQuotasNegativeTestJSON-2062885025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:49:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-47fd4356-acfc-47da-b254-59621c7c8583 tempest-VolumeQuotasNegativeTestJSON-2062885025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:49:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-47fd4356-acfc-47da-b254-59621c7c8583 tempest-VolumeQuotasNegativeTestJSON-2062885025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:49:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-47fd4356-acfc-47da-b254-59621c7c8583 tempest-VolumeQuotasNegativeTestJSON-2062885025 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:49:05 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-47fd4356-acfc-47da-b254-59621c7c8583 tempest-VolumeQuotasNegativeTestJSON-2062885025 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:49:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-47fd4356-acfc-47da-b254-59621c7c8583 tempest-VolumeQuotasNegativeTestJSON-2062885025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c1638f74-ca02-4453-8bcb-3123e1bc95a8 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:05 devstack sudo[91389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c1638f74-ca02-4453-8bcb-3123e1bc95a8 1073741824 Sep 28 11:49:05 devstack sudo[91389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:06 devstack sudo[91389]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-47fd4356-acfc-47da-b254-59621c7c8583 tempest-VolumeQuotasNegativeTestJSON-2062885025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c1638f74-ca02-4453-8bcb-3123e1bc95a8 1073741824" returned: 0 in 0.587s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-47fd4356-acfc-47da-b254-59621c7c8583 tempest-VolumeQuotasNegativeTestJSON-2062885025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c1638f74-ca02-4453-8bcb-3123e1bc95a8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:06 devstack sudo[91397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c1638f74-ca02-4453-8bcb-3123e1bc95a8 Sep 28 11:49:06 devstack sudo[91397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:06 devstack sudo[91397]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-47fd4356-acfc-47da-b254-59621c7c8583 tempest-VolumeQuotasNegativeTestJSON-2062885025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c1638f74-ca02-4453-8bcb-3123e1bc95a8" returned: 0 in 0.312s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-47fd4356-acfc-47da-b254-59621c7c8583 tempest-VolumeQuotasNegativeTestJSON-2062885025 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:49:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-47fd4356-acfc-47da-b254-59621c7c8583 tempest-VolumeQuotasNegativeTestJSON-2062885025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:49:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-47fd4356-acfc-47da-b254-59621c7c8583 tempest-VolumeQuotasNegativeTestJSON-2062885025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eb85107-5392-48e6-9c67-decbd306257d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1638f74-ca02-4453-8bcb-3123e1bc95a8', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:49:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-47fd4356-acfc-47da-b254-59621c7c8583 tempest-VolumeQuotasNegativeTestJSON-2062885025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3df03c7b-b331-42e0-8973-307f6e36ab25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:49:06 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-47fd4356-acfc-47da-b254-59621c7c8583 tempest-VolumeQuotasNegativeTestJSON-2062885025 None] Volume volume-c1638f74-ca02-4453-8bcb-3123e1bc95a8 (c1638f74-ca02-4453-8bcb-3123e1bc95a8): created successfully Sep 28 11:49:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-47fd4356-acfc-47da-b254-59621c7c8583 tempest-VolumeQuotasNegativeTestJSON-2062885025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3df03c7b-b331-42e0-8973-307f6e36ab25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:49:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-47fd4356-acfc-47da-b254-59621c7c8583 tempest-VolumeQuotasNegativeTestJSON-2062885025 None] Flow 'volume_create_manager' (4256974a-c421-478d-b194-08d30ab22104) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:49:06 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-47fd4356-acfc-47da-b254-59621c7c8583 tempest-VolumeQuotasNegativeTestJSON-2062885025 None] Created volume successfully. Sep 28 11:49:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-d405a615-46e1-457d-a525-a569f3c1d3fc req-47fe61bb-789e-4055-a3ca-ccb072f13a9e tempest-ServerActionsTestOtherA-485250721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:49:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-d405a615-46e1-457d-a525-a569f3c1d3fc req-47fe61bb-789e-4055-a3ca-ccb072f13a9e tempest-ServerActionsTestOtherA-485250721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:49:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-90a158a3-b4c6-4bad-b510-ce437765a94c tempest-VolumesListTestJSON-1251130800 None] Acquiring lock "cinder-915217de-d4cc-4a3a-a3dd-2c52bec84aed-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:49:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-d405a615-46e1-457d-a525-a569f3c1d3fc req-47fe61bb-789e-4055-a3ca-ccb072f13a9e tempest-ServerActionsTestOtherA-485250721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:49:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-90a158a3-b4c6-4bad-b510-ce437765a94c tempest-VolumesListTestJSON-1251130800 None] Lock "cinder-915217de-d4cc-4a3a-a3dd-2c52bec84aed-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:49:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-d405a615-46e1-457d-a525-a569f3c1d3fc req-47fe61bb-789e-4055-a3ca-ccb072f13a9e tempest-ServerActionsTestOtherA-485250721 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0', 'name': 'volume-cd501413-3795-4aa7-bdee-881ab67dd5f7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '77cbc70e-3a8a-49b2-a855-33cfa8181efd', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 11:49:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-90a158a3-b4c6-4bad-b510-ce437765a94c tempest-VolumesListTestJSON-1251130800 None] Acquiring lock "cinder-quobyte-915217de-d4cc-4a3a-a3dd-2c52bec84aed" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:49:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-90a158a3-b4c6-4bad-b510-ce437765a94c tempest-VolumesListTestJSON-1251130800 None] Lock "cinder-quobyte-915217de-d4cc-4a3a-a3dd-2c52bec84aed" acquired by "delete_volume" :: waited 0.026s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:49:07 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-d405a615-46e1-457d-a525-a569f3c1d3fc req-47fe61bb-789e-4055-a3ca-ccb072f13a9e tempest-ServerActionsTestOtherA-485250721 None] attachment_update completed successfully. Sep 28 11:49:07 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c919b4-4562-4175-b57d-bb24f329d375]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:49:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-90a158a3-b4c6-4bad-b510-ce437765a94c tempest-VolumesListTestJSON-1251130800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-915217de-d4cc-4a3a-a3dd-2c52bec84aed {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:07 devstack sudo[91416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-915217de-d4cc-4a3a-a3dd-2c52bec84aed Sep 28 11:49:07 devstack sudo[91416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:08 devstack sudo[91416]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-90a158a3-b4c6-4bad-b510-ce437765a94c tempest-VolumesListTestJSON-1251130800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-915217de-d4cc-4a3a-a3dd-2c52bec84aed" returned: 0 in 0.539s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-90a158a3-b4c6-4bad-b510-ce437765a94c tempest-VolumesListTestJSON-1251130800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-915217de-d4cc-4a3a-a3dd-2c52bec84aed {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:08 devstack sudo[91769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-915217de-d4cc-4a3a-a3dd-2c52bec84aed Sep 28 11:49:08 devstack sudo[91769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:08 devstack sudo[91769]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-90a158a3-b4c6-4bad-b510-ce437765a94c tempest-VolumesListTestJSON-1251130800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-915217de-d4cc-4a3a-a3dd-2c52bec84aed" returned: 0 in 0.299s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-90a158a3-b4c6-4bad-b510-ce437765a94c tempest-VolumesListTestJSON-1251130800 None] Lock "cinder-quobyte-915217de-d4cc-4a3a-a3dd-2c52bec84aed" released by "delete_volume" :: held 0.897s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:49:08 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-90a158a3-b4c6-4bad-b510-ce437765a94c tempest-VolumesListTestJSON-1251130800 None] Created reservations ['9647f283-6b6e-400c-bf87-79b8aef0e4cb', 'b04a5ab4-31a8-4d75-92be-8472fe593dfc', '7f28ad23-c1fc-4d89-92e7-0bd71ab949c0', '5ffbe6a9-3b63-4b39-b229-f34d81d74b98'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:49:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-90a158a3-b4c6-4bad-b510-ce437765a94c tempest-VolumesListTestJSON-1251130800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:49:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-90a158a3-b4c6-4bad-b510-ce437765a94c tempest-VolumesListTestJSON-1251130800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:49:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-90a158a3-b4c6-4bad-b510-ce437765a94c tempest-VolumesListTestJSON-1251130800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:49:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-90a158a3-b4c6-4bad-b510-ce437765a94c tempest-VolumesListTestJSON-1251130800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:49:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-90a158a3-b4c6-4bad-b510-ce437765a94c tempest-VolumesListTestJSON-1251130800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:49:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-90a158a3-b4c6-4bad-b510-ce437765a94c tempest-VolumesListTestJSON-1251130800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:08 devstack sudo[91845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:49:08 devstack sudo[91845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8e1ce1ef-6885-4e5b-9070-c1b236bf0074 tempest-VolumesListTestJSON-1251130800 None] Acquiring lock "cinder-035589e1-0da5-4a3b-b388-61850d580c15-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:49:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8e1ce1ef-6885-4e5b-9070-c1b236bf0074 tempest-VolumesListTestJSON-1251130800 None] Lock "cinder-035589e1-0da5-4a3b-b388-61850d580c15-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:49:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8e1ce1ef-6885-4e5b-9070-c1b236bf0074 tempest-VolumesListTestJSON-1251130800 None] Acquiring lock "cinder-quobyte-035589e1-0da5-4a3b-b388-61850d580c15" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:49:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8e1ce1ef-6885-4e5b-9070-c1b236bf0074 tempest-VolumesListTestJSON-1251130800 None] Lock "cinder-quobyte-035589e1-0da5-4a3b-b388-61850d580c15" acquired by "delete_volume" :: waited 0.032s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:49:09 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad0a252-43fe-433a-912c-0b2309062edb]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:49:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8e1ce1ef-6885-4e5b-9070-c1b236bf0074 tempest-VolumesListTestJSON-1251130800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-035589e1-0da5-4a3b-b388-61850d580c15 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:09 devstack sudo[91845]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-90a158a3-b4c6-4bad-b510-ce437765a94c tempest-VolumesListTestJSON-1251130800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.637s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:09 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-90a158a3-b4c6-4bad-b510-ce437765a94c tempest-VolumesListTestJSON-1251130800 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:49:09 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-90a158a3-b4c6-4bad-b510-ce437765a94c tempest-VolumesListTestJSON-1251130800 None] Deleted volume successfully. Sep 28 11:49:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-90a158a3-b4c6-4bad-b510-ce437765a94c tempest-VolumesListTestJSON-1251130800 None] Lock "cinder-915217de-d4cc-4a3a-a3dd-2c52bec84aed-delete_volume" released by "delete_volume" :: held 1.851s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:49:09 devstack sudo[91868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-035589e1-0da5-4a3b-b388-61850d580c15 Sep 28 11:49:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9caca9fc-27f6-4a96-b04a-d3c1d281960e tempest-VolumeQuotasNegativeTestJSON-2062885025 None] Acquiring lock "cinder-c1638f74-ca02-4453-8bcb-3123e1bc95a8-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:49:09 devstack sudo[91868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9caca9fc-27f6-4a96-b04a-d3c1d281960e tempest-VolumeQuotasNegativeTestJSON-2062885025 None] Lock "cinder-c1638f74-ca02-4453-8bcb-3123e1bc95a8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:49:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9caca9fc-27f6-4a96-b04a-d3c1d281960e tempest-VolumeQuotasNegativeTestJSON-2062885025 None] Acquiring lock "cinder-quobyte-c1638f74-ca02-4453-8bcb-3123e1bc95a8" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:49:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9caca9fc-27f6-4a96-b04a-d3c1d281960e tempest-VolumeQuotasNegativeTestJSON-2062885025 None] Lock "cinder-quobyte-c1638f74-ca02-4453-8bcb-3123e1bc95a8" acquired by "delete_volume" :: waited 0.046s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:49:09 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3d2750-ee2e-4eb1-a4ce-fcf62eded35b]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:49:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9caca9fc-27f6-4a96-b04a-d3c1d281960e tempest-VolumeQuotasNegativeTestJSON-2062885025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c1638f74-ca02-4453-8bcb-3123e1bc95a8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:09 devstack sudo[91873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c1638f74-ca02-4453-8bcb-3123e1bc95a8 Sep 28 11:49:09 devstack sudo[91873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:09 devstack sudo[91868]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8e1ce1ef-6885-4e5b-9070-c1b236bf0074 tempest-VolumesListTestJSON-1251130800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-035589e1-0da5-4a3b-b388-61850d580c15" returned: 0 in 0.666s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8e1ce1ef-6885-4e5b-9070-c1b236bf0074 tempest-VolumesListTestJSON-1251130800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-035589e1-0da5-4a3b-b388-61850d580c15 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:09 devstack sudo[91878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-035589e1-0da5-4a3b-b388-61850d580c15 Sep 28 11:49:09 devstack sudo[91878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:10 devstack sudo[91873]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9caca9fc-27f6-4a96-b04a-d3c1d281960e tempest-VolumeQuotasNegativeTestJSON-2062885025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c1638f74-ca02-4453-8bcb-3123e1bc95a8" returned: 0 in 0.527s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9caca9fc-27f6-4a96-b04a-d3c1d281960e tempest-VolumeQuotasNegativeTestJSON-2062885025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c1638f74-ca02-4453-8bcb-3123e1bc95a8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:10 devstack sudo[91885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c1638f74-ca02-4453-8bcb-3123e1bc95a8 Sep 28 11:49:10 devstack sudo[91885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:10 devstack sudo[91878]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8e1ce1ef-6885-4e5b-9070-c1b236bf0074 tempest-VolumesListTestJSON-1251130800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-035589e1-0da5-4a3b-b388-61850d580c15" returned: 0 in 0.346s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:10 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8e1ce1ef-6885-4e5b-9070-c1b236bf0074 tempest-VolumesListTestJSON-1251130800 None] Lock "cinder-quobyte-035589e1-0da5-4a3b-b388-61850d580c15" released by "delete_volume" :: held 1.086s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:49:10 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-8e1ce1ef-6885-4e5b-9070-c1b236bf0074 tempest-VolumesListTestJSON-1251130800 None] Created reservations ['76afe9ce-a741-450c-a4c9-ff2ed171ee26', 'c9fc24a6-a210-4c7f-b98b-39f226f34955', '3065cf41-6793-4cbc-9d9a-6ee1dce95d68', '0d3ea003-89e3-40a5-9534-9eff50af5059'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:49:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8e1ce1ef-6885-4e5b-9070-c1b236bf0074 tempest-VolumesListTestJSON-1251130800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:49:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8e1ce1ef-6885-4e5b-9070-c1b236bf0074 tempest-VolumesListTestJSON-1251130800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:49:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8e1ce1ef-6885-4e5b-9070-c1b236bf0074 tempest-VolumesListTestJSON-1251130800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:49:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8e1ce1ef-6885-4e5b-9070-c1b236bf0074 tempest-VolumesListTestJSON-1251130800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:49:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8e1ce1ef-6885-4e5b-9070-c1b236bf0074 tempest-VolumesListTestJSON-1251130800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:49:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8e1ce1ef-6885-4e5b-9070-c1b236bf0074 tempest-VolumesListTestJSON-1251130800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:10 devstack sudo[91889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:49:10 devstack sudo[91889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:10 devstack sudo[91885]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9caca9fc-27f6-4a96-b04a-d3c1d281960e tempest-VolumeQuotasNegativeTestJSON-2062885025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c1638f74-ca02-4453-8bcb-3123e1bc95a8" returned: 0 in 0.363s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:10 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9caca9fc-27f6-4a96-b04a-d3c1d281960e tempest-VolumeQuotasNegativeTestJSON-2062885025 None] Lock "cinder-quobyte-c1638f74-ca02-4453-8bcb-3123e1bc95a8" released by "delete_volume" :: held 0.969s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:49:10 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-9caca9fc-27f6-4a96-b04a-d3c1d281960e tempest-VolumeQuotasNegativeTestJSON-2062885025 None] Created reservations ['7b2f0c5b-c39f-421c-a299-d1e4edf5e362', '9048bc96-9f35-4633-b617-1013c306344f', 'ff34c822-309a-4528-af17-881d87d20b25', '7d4d4fc0-3146-4858-95a4-f7f103e26ac6'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:49:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9caca9fc-27f6-4a96-b04a-d3c1d281960e tempest-VolumeQuotasNegativeTestJSON-2062885025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:49:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9caca9fc-27f6-4a96-b04a-d3c1d281960e tempest-VolumeQuotasNegativeTestJSON-2062885025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:49:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9caca9fc-27f6-4a96-b04a-d3c1d281960e tempest-VolumeQuotasNegativeTestJSON-2062885025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:49:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9caca9fc-27f6-4a96-b04a-d3c1d281960e tempest-VolumeQuotasNegativeTestJSON-2062885025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:49:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9caca9fc-27f6-4a96-b04a-d3c1d281960e tempest-VolumeQuotasNegativeTestJSON-2062885025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:49:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9caca9fc-27f6-4a96-b04a-d3c1d281960e tempest-VolumeQuotasNegativeTestJSON-2062885025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:10 devstack sudo[91893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:49:10 devstack sudo[91893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:10 devstack sudo[91889]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8e1ce1ef-6885-4e5b-9070-c1b236bf0074 tempest-VolumesListTestJSON-1251130800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.419s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:10 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-8e1ce1ef-6885-4e5b-9070-c1b236bf0074 tempest-VolumesListTestJSON-1251130800 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:49:10 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-8e1ce1ef-6885-4e5b-9070-c1b236bf0074 tempest-VolumesListTestJSON-1251130800 None] Deleted volume successfully. Sep 28 11:49:10 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8e1ce1ef-6885-4e5b-9070-c1b236bf0074 tempest-VolumesListTestJSON-1251130800 None] Lock "cinder-035589e1-0da5-4a3b-b388-61850d580c15-delete_volume" released by "delete_volume" :: held 1.969s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:49:11 devstack sudo[91893]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9caca9fc-27f6-4a96-b04a-d3c1d281960e tempest-VolumeQuotasNegativeTestJSON-2062885025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.433s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:11 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-9caca9fc-27f6-4a96-b04a-d3c1d281960e tempest-VolumeQuotasNegativeTestJSON-2062885025 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:49:11 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-9caca9fc-27f6-4a96-b04a-d3c1d281960e tempest-VolumeQuotasNegativeTestJSON-2062885025 None] Deleted volume successfully. Sep 28 11:49:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9caca9fc-27f6-4a96-b04a-d3c1d281960e tempest-VolumeQuotasNegativeTestJSON-2062885025 None] Lock "cinder-c1638f74-ca02-4453-8bcb-3123e1bc95a8-delete_volume" released by "delete_volume" :: held 1.758s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:49:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-49502a44-00a3-4338-a26a-0ba1b651d133 tempest-VolumesListTestJSON-1251130800 None] Acquiring lock "cinder-5f8166b3-c878-4999-be98-2acb52a00afd-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:49:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-49502a44-00a3-4338-a26a-0ba1b651d133 tempest-VolumesListTestJSON-1251130800 None] Lock "cinder-5f8166b3-c878-4999-be98-2acb52a00afd-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:49:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-49502a44-00a3-4338-a26a-0ba1b651d133 tempest-VolumesListTestJSON-1251130800 None] Acquiring lock "cinder-quobyte-5f8166b3-c878-4999-be98-2acb52a00afd" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:49:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-49502a44-00a3-4338-a26a-0ba1b651d133 tempest-VolumesListTestJSON-1251130800 None] Lock "cinder-quobyte-5f8166b3-c878-4999-be98-2acb52a00afd" acquired by "delete_volume" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:49:11 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa0aa22-6783-436f-90a0-33bac731ae27]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:49:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-49502a44-00a3-4338-a26a-0ba1b651d133 tempest-VolumesListTestJSON-1251130800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5f8166b3-c878-4999-be98-2acb52a00afd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:11 devstack sudo[91901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5f8166b3-c878-4999-be98-2acb52a00afd Sep 28 11:49:11 devstack sudo[91901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:12 devstack sudo[91901]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-49502a44-00a3-4338-a26a-0ba1b651d133 tempest-VolumesListTestJSON-1251130800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5f8166b3-c878-4999-be98-2acb52a00afd" returned: 0 in 0.469s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-49502a44-00a3-4338-a26a-0ba1b651d133 tempest-VolumesListTestJSON-1251130800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5f8166b3-c878-4999-be98-2acb52a00afd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:12 devstack sudo[91914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5f8166b3-c878-4999-be98-2acb52a00afd Sep 28 11:49:12 devstack sudo[91914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:12 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-65720580-53cf-4153-ae33-8e1980996a8d req-e94d7adc-84c1-42d1-98f9-022438c7e7b6 tempest-ServerActionsTestOtherA-485250721 None] Terminate volume connection completed successfully. Sep 28 11:49:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-65720580-53cf-4153-ae33-8e1980996a8d req-e94d7adc-84c1-42d1-98f9-022438c7e7b6 tempest-ServerActionsTestOtherA-485250721 None] Deleting attachment 77cbc70e-3a8a-49b2-a855-33cfa8181efd. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 11:49:12 devstack sudo[91914]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-49502a44-00a3-4338-a26a-0ba1b651d133 tempest-VolumesListTestJSON-1251130800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5f8166b3-c878-4999-be98-2acb52a00afd" returned: 0 in 0.359s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-49502a44-00a3-4338-a26a-0ba1b651d133 tempest-VolumesListTestJSON-1251130800 None] Lock "cinder-quobyte-5f8166b3-c878-4999-be98-2acb52a00afd" released by "delete_volume" :: held 0.904s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:49:12 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-49502a44-00a3-4338-a26a-0ba1b651d133 tempest-VolumesListTestJSON-1251130800 None] Created reservations ['da072121-c6e0-45d2-bf57-86a0bfd63def', 'bffdcd69-a18e-4bc8-9b9d-1c3135683651', '7a67018b-2aa3-471e-b287-11e2cd2b9f61', 'c8251e58-b44e-4389-81b2-7218fede18af'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:49:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-49502a44-00a3-4338-a26a-0ba1b651d133 tempest-VolumesListTestJSON-1251130800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:49:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-49502a44-00a3-4338-a26a-0ba1b651d133 tempest-VolumesListTestJSON-1251130800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:49:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-49502a44-00a3-4338-a26a-0ba1b651d133 tempest-VolumesListTestJSON-1251130800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:49:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-49502a44-00a3-4338-a26a-0ba1b651d133 tempest-VolumesListTestJSON-1251130800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:49:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-49502a44-00a3-4338-a26a-0ba1b651d133 tempest-VolumesListTestJSON-1251130800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:49:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-49502a44-00a3-4338-a26a-0ba1b651d133 tempest-VolumesListTestJSON-1251130800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:13 devstack sudo[91956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:49:13 devstack sudo[91956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:13 devstack sudo[91956]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-49502a44-00a3-4338-a26a-0ba1b651d133 tempest-VolumesListTestJSON-1251130800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.473s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:13 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-49502a44-00a3-4338-a26a-0ba1b651d133 tempest-VolumesListTestJSON-1251130800 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:49:13 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-49502a44-00a3-4338-a26a-0ba1b651d133 tempest-VolumesListTestJSON-1251130800 None] Deleted volume successfully. Sep 28 11:49:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-65720580-53cf-4153-ae33-8e1980996a8d req-d1b48dd2-d077-4149-87fb-08a3fe58beb7 tempest-ServerActionsTestOtherA-485250721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:49:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-65720580-53cf-4153-ae33-8e1980996a8d req-d1b48dd2-d077-4149-87fb-08a3fe58beb7 tempest-ServerActionsTestOtherA-485250721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:49:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-65720580-53cf-4153-ae33-8e1980996a8d req-d1b48dd2-d077-4149-87fb-08a3fe58beb7 tempest-ServerActionsTestOtherA-485250721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:49:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-49502a44-00a3-4338-a26a-0ba1b651d133 tempest-VolumesListTestJSON-1251130800 None] Lock "cinder-5f8166b3-c878-4999-be98-2acb52a00afd-delete_volume" released by "delete_volume" :: held 1.882s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:49:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-65720580-53cf-4153-ae33-8e1980996a8d req-d1b48dd2-d077-4149-87fb-08a3fe58beb7 tempest-ServerActionsTestOtherA-485250721 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0', 'name': 'volume-cd501413-3795-4aa7-bdee-881ab67dd5f7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fd0f607d-4887-42f6-8f70-0ca3725bdc93', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 11:49:13 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-65720580-53cf-4153-ae33-8e1980996a8d req-d1b48dd2-d077-4149-87fb-08a3fe58beb7 tempest-ServerActionsTestOtherA-485250721 None] attachment_update completed successfully. Sep 28 11:49:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ebae75a8-5f97-47e7-99db-13470ed6b2dc tempest-AttachVolumeShelveTestJSON-777856843 None] Acquiring lock "cinder-5077fdc9-b0b6-48c8-98f5-050b7b6e1a8a-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:49:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ebae75a8-5f97-47e7-99db-13470ed6b2dc tempest-AttachVolumeShelveTestJSON-777856843 None] Lock "cinder-5077fdc9-b0b6-48c8-98f5-050b7b6e1a8a-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:49:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ebae75a8-5f97-47e7-99db-13470ed6b2dc tempest-AttachVolumeShelveTestJSON-777856843 None] Acquiring lock "cinder-quobyte-5077fdc9-b0b6-48c8-98f5-050b7b6e1a8a" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:49:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ebae75a8-5f97-47e7-99db-13470ed6b2dc tempest-AttachVolumeShelveTestJSON-777856843 None] Lock "cinder-quobyte-5077fdc9-b0b6-48c8-98f5-050b7b6e1a8a" acquired by "delete_volume" :: waited 0.025s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:49:14 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda2f69b-7379-4ae3-8c48-f8ec3b7795f1]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:49:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ebae75a8-5f97-47e7-99db-13470ed6b2dc tempest-AttachVolumeShelveTestJSON-777856843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5077fdc9-b0b6-48c8-98f5-050b7b6e1a8a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:14 devstack sudo[91984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5077fdc9-b0b6-48c8-98f5-050b7b6e1a8a Sep 28 11:49:14 devstack sudo[91984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:15 devstack sudo[91984]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ebae75a8-5f97-47e7-99db-13470ed6b2dc tempest-AttachVolumeShelveTestJSON-777856843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5077fdc9-b0b6-48c8-98f5-050b7b6e1a8a" returned: 0 in 0.533s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ebae75a8-5f97-47e7-99db-13470ed6b2dc tempest-AttachVolumeShelveTestJSON-777856843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5077fdc9-b0b6-48c8-98f5-050b7b6e1a8a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:15 devstack sudo[92025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5077fdc9-b0b6-48c8-98f5-050b7b6e1a8a Sep 28 11:49:15 devstack sudo[92025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:15 devstack sudo[92025]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ebae75a8-5f97-47e7-99db-13470ed6b2dc tempest-AttachVolumeShelveTestJSON-777856843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5077fdc9-b0b6-48c8-98f5-050b7b6e1a8a" returned: 0 in 0.489s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ebae75a8-5f97-47e7-99db-13470ed6b2dc tempest-AttachVolumeShelveTestJSON-777856843 None] Lock "cinder-quobyte-5077fdc9-b0b6-48c8-98f5-050b7b6e1a8a" released by "delete_volume" :: held 1.097s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:49:15 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-ebae75a8-5f97-47e7-99db-13470ed6b2dc tempest-AttachVolumeShelveTestJSON-777856843 None] Created reservations ['7638f1e6-5574-4db6-934f-eea1f78fa7c3', '8aa55112-1277-4661-8246-9001d6ef2f20', '6512d24d-f3d5-4c05-8b38-4add55e369eb', '1045d492-6437-4a37-9ef7-12961f3573e0'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:49:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ebae75a8-5f97-47e7-99db-13470ed6b2dc tempest-AttachVolumeShelveTestJSON-777856843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:49:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ebae75a8-5f97-47e7-99db-13470ed6b2dc tempest-AttachVolumeShelveTestJSON-777856843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:49:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ebae75a8-5f97-47e7-99db-13470ed6b2dc tempest-AttachVolumeShelveTestJSON-777856843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:49:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ebae75a8-5f97-47e7-99db-13470ed6b2dc tempest-AttachVolumeShelveTestJSON-777856843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:49:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ebae75a8-5f97-47e7-99db-13470ed6b2dc tempest-AttachVolumeShelveTestJSON-777856843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:49:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ebae75a8-5f97-47e7-99db-13470ed6b2dc tempest-AttachVolumeShelveTestJSON-777856843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:15 devstack sudo[92295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:49:15 devstack sudo[92295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:16 devstack sudo[92295]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ebae75a8-5f97-47e7-99db-13470ed6b2dc tempest-AttachVolumeShelveTestJSON-777856843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.320s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:16 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-ebae75a8-5f97-47e7-99db-13470ed6b2dc tempest-AttachVolumeShelveTestJSON-777856843 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:49:16 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-ebae75a8-5f97-47e7-99db-13470ed6b2dc tempest-AttachVolumeShelveTestJSON-777856843 None] Deleted volume successfully. Sep 28 11:49:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ebae75a8-5f97-47e7-99db-13470ed6b2dc tempest-AttachVolumeShelveTestJSON-777856843 None] Lock "cinder-5077fdc9-b0b6-48c8-98f5-050b7b6e1a8a-delete_volume" released by "delete_volume" :: held 1.746s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:49:20 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3ef1a22-2930-4b15-8d30-9a1c625b9005 tempest-VolumesSnapshotListTestJSON-607561243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:49:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b3ef1a22-2930-4b15-8d30-9a1c625b9005 tempest-VolumesSnapshotListTestJSON-607561243 None] Flow 'volume_create_manager' (3763d272-c909-4a1d-9931-022c84b12695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:49:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b3ef1a22-2930-4b15-8d30-9a1c625b9005 tempest-VolumesSnapshotListTestJSON-607561243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (714d414e-0155-43e9-9553-710c428b950d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:49:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b3ef1a22-2930-4b15-8d30-9a1c625b9005 tempest-VolumesSnapshotListTestJSON-607561243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (714d414e-0155-43e9-9553-710c428b950d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:49:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-626147681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5c9786c-b07a-412d-ad10-46cdec3da4f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32abd8f91dfb47de8d3df574567e8bac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:49:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:49:20Z,use_quota=True,user_id='0a6e51634e2340e999c2e809563dd8e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:49:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b3ef1a22-2930-4b15-8d30-9a1c625b9005 tempest-VolumesSnapshotListTestJSON-607561243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8e4d187-93c3-4a4c-b1f5-85930b4aca1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:49:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b3ef1a22-2930-4b15-8d30-9a1c625b9005 tempest-VolumesSnapshotListTestJSON-607561243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8e4d187-93c3-4a4c-b1f5-85930b4aca1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:49:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b3ef1a22-2930-4b15-8d30-9a1c625b9005 tempest-VolumesSnapshotListTestJSON-607561243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3547b35c-6448-41c8-b132-5c8cec30c386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:49:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b3ef1a22-2930-4b15-8d30-9a1c625b9005 tempest-VolumesSnapshotListTestJSON-607561243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3547b35c-6448-41c8-b132-5c8cec30c386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5c9786c-b07a-412d-ad10-46cdec3da4f5', 'volume_name': 'volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:49:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b3ef1a22-2930-4b15-8d30-9a1c625b9005 tempest-VolumesSnapshotListTestJSON-607561243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aca6fe42-1f87-4ba7-8f8a-bee797a6c171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:49:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b3ef1a22-2930-4b15-8d30-9a1c625b9005 tempest-VolumesSnapshotListTestJSON-607561243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aca6fe42-1f87-4ba7-8f8a-bee797a6c171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:49:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b3ef1a22-2930-4b15-8d30-9a1c625b9005 tempest-VolumesSnapshotListTestJSON-607561243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f821d4d7-61ad-46e4-8448-e5799974ddd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:49:20 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-b3ef1a22-2930-4b15-8d30-9a1c625b9005 tempest-VolumesSnapshotListTestJSON-607561243 None] Volume c5c9786c-b07a-412d-ad10-46cdec3da4f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5', 'volume_size': 1} Sep 28 11:49:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b3ef1a22-2930-4b15-8d30-9a1c625b9005 tempest-VolumesSnapshotListTestJSON-607561243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:49:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b3ef1a22-2930-4b15-8d30-9a1c625b9005 tempest-VolumesSnapshotListTestJSON-607561243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:49:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b3ef1a22-2930-4b15-8d30-9a1c625b9005 tempest-VolumesSnapshotListTestJSON-607561243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:49:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-626147681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5c9786c-b07a-412d-ad10-46cdec3da4f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32abd8f91dfb47de8d3df574567e8bac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:49:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:49:20Z,use_quota=True,user_id='0a6e51634e2340e999c2e809563dd8e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:49:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-b3ef1a22-2930-4b15-8d30-9a1c625b9005 tempest-VolumesSnapshotListTestJSON-607561243 None] Creating volume c5c9786c-b07a-412d-ad10-46cdec3da4f5 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:49:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b3ef1a22-2930-4b15-8d30-9a1c625b9005 tempest-VolumesSnapshotListTestJSON-607561243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:49:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b3ef1a22-2930-4b15-8d30-9a1c625b9005 tempest-VolumesSnapshotListTestJSON-607561243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:49:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b3ef1a22-2930-4b15-8d30-9a1c625b9005 tempest-VolumesSnapshotListTestJSON-607561243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:49:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b3ef1a22-2930-4b15-8d30-9a1c625b9005 tempest-VolumesSnapshotListTestJSON-607561243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:49:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b3ef1a22-2930-4b15-8d30-9a1c625b9005 tempest-VolumesSnapshotListTestJSON-607561243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:49:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b3ef1a22-2930-4b15-8d30-9a1c625b9005 tempest-VolumesSnapshotListTestJSON-607561243 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:49:20 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-b3ef1a22-2930-4b15-8d30-9a1c625b9005 tempest-VolumesSnapshotListTestJSON-607561243 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:49:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b3ef1a22-2930-4b15-8d30-9a1c625b9005 tempest-VolumesSnapshotListTestJSON-607561243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:20 devstack sudo[92480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5 1073741824 Sep 28 11:49:20 devstack sudo[92480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:20 devstack sudo[92480]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b3ef1a22-2930-4b15-8d30-9a1c625b9005 tempest-VolumesSnapshotListTestJSON-607561243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5 1073741824" returned: 0 in 0.650s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b3ef1a22-2930-4b15-8d30-9a1c625b9005 tempest-VolumesSnapshotListTestJSON-607561243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:20 devstack sudo[92485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5 Sep 28 11:49:20 devstack sudo[92485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:21 devstack sudo[92485]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b3ef1a22-2930-4b15-8d30-9a1c625b9005 tempest-VolumesSnapshotListTestJSON-607561243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5" returned: 0 in 0.282s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b3ef1a22-2930-4b15-8d30-9a1c625b9005 tempest-VolumesSnapshotListTestJSON-607561243 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:49:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b3ef1a22-2930-4b15-8d30-9a1c625b9005 tempest-VolumesSnapshotListTestJSON-607561243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:49:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b3ef1a22-2930-4b15-8d30-9a1c625b9005 tempest-VolumesSnapshotListTestJSON-607561243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f821d4d7-61ad-46e4-8448-e5799974ddd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:49:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b3ef1a22-2930-4b15-8d30-9a1c625b9005 tempest-VolumesSnapshotListTestJSON-607561243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbbd11b8-215a-4b9c-8d31-4e7a26829682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:49:21 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-b3ef1a22-2930-4b15-8d30-9a1c625b9005 tempest-VolumesSnapshotListTestJSON-607561243 None] Volume volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5 (c5c9786c-b07a-412d-ad10-46cdec3da4f5): created successfully Sep 28 11:49:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b3ef1a22-2930-4b15-8d30-9a1c625b9005 tempest-VolumesSnapshotListTestJSON-607561243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbbd11b8-215a-4b9c-8d31-4e7a26829682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:49:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b3ef1a22-2930-4b15-8d30-9a1c625b9005 tempest-VolumesSnapshotListTestJSON-607561243 None] Flow 'volume_create_manager' (3763d272-c909-4a1d-9931-022c84b12695) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:49:21 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b3ef1a22-2930-4b15-8d30-9a1c625b9005 tempest-VolumesSnapshotListTestJSON-607561243 None] Created volume successfully. Sep 28 11:49:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a81685f4-8771-4699-9250-d64cd58c37b4 tempest-VolumesSnapshotListTestJSON-607561243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:49:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a81685f4-8771-4699-9250-d64cd58c37b4 tempest-VolumesSnapshotListTestJSON-607561243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:49:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-a81685f4-8771-4699-9250-d64cd58c37b4 tempest-VolumesSnapshotListTestJSON-607561243 None] Creating offline snapshot 0a5829b4-1912-432d-a213-f30821f937b4 of volume c5c9786c-b07a-412d-ad10-46cdec3da4f5 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 11:49:22 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[216a9d26-cb1b-4aa8-a541-542e4cb8fad9]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:49:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a81685f4-8771-4699-9250-d64cd58c37b4 tempest-VolumesSnapshotListTestJSON-607561243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:22 devstack sudo[92489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5 Sep 28 11:49:22 devstack sudo[92489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:23 devstack sudo[92489]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a81685f4-8771-4699-9250-d64cd58c37b4 tempest-VolumesSnapshotListTestJSON-607561243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5" returned: 0 in 0.440s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a81685f4-8771-4699-9250-d64cd58c37b4 tempest-VolumesSnapshotListTestJSON-607561243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.0a5829b4-1912-432d-a213-f30821f937b4 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:23 devstack sudo[92495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.0a5829b4-1912-432d-a213-f30821f937b4 1G Sep 28 11:49:23 devstack sudo[92495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:23 devstack sudo[92495]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a81685f4-8771-4699-9250-d64cd58c37b4 tempest-VolumesSnapshotListTestJSON-607561243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.0a5829b4-1912-432d-a213-f30821f937b4 1G" returned: 0 in 0.542s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a81685f4-8771-4699-9250-d64cd58c37b4 tempest-VolumesSnapshotListTestJSON-607561243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.0a5829b4-1912-432d-a213-f30821f937b4 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:23 devstack sudo[92501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.0a5829b4-1912-432d-a213-f30821f937b4 Sep 28 11:49:23 devstack sudo[92501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:24 devstack sudo[92501]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a81685f4-8771-4699-9250-d64cd58c37b4 tempest-VolumesSnapshotListTestJSON-607561243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.0a5829b4-1912-432d-a213-f30821f937b4" returned: 0 in 0.409s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:24 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-a81685f4-8771-4699-9250-d64cd58c37b4 tempest-VolumesSnapshotListTestJSON-607561243 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.0a5829b4-1912-432d-a213-f30821f937b4 is being set with open permissions: ugo+rw Sep 28 11:49:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a81685f4-8771-4699-9250-d64cd58c37b4 tempest-VolumesSnapshotListTestJSON-607561243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.0a5829b4-1912-432d-a213-f30821f937b4 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:24 devstack sudo[92507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.0a5829b4-1912-432d-a213-f30821f937b4 Sep 28 11:49:24 devstack sudo[92507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:24 devstack sudo[92507]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a81685f4-8771-4699-9250-d64cd58c37b4 tempest-VolumesSnapshotListTestJSON-607561243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.0a5829b4-1912-432d-a213-f30821f937b4" returned: 0 in 0.382s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a81685f4-8771-4699-9250-d64cd58c37b4 tempest-VolumesSnapshotListTestJSON-607561243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:24 devstack sudo[92510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.info Sep 28 11:49:24 devstack sudo[92510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:25 devstack sudo[92510]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a81685f4-8771-4699-9250-d64cd58c37b4 tempest-VolumesSnapshotListTestJSON-607561243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.info" returned: 0 in 0.466s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:25 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-a81685f4-8771-4699-9250-d64cd58c37b4 tempest-VolumesSnapshotListTestJSON-607561243 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.info is being set with open permissions: ugo+rw Sep 28 11:49:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a81685f4-8771-4699-9250-d64cd58c37b4 tempest-VolumesSnapshotListTestJSON-607561243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:25 devstack sudo[92513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.info Sep 28 11:49:25 devstack sudo[92513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:25 devstack sudo[92513]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a81685f4-8771-4699-9250-d64cd58c37b4 tempest-VolumesSnapshotListTestJSON-607561243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.info" returned: 0 in 0.342s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a81685f4-8771-4699-9250-d64cd58c37b4 tempest-VolumesSnapshotListTestJSON-607561243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.721s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:49:25 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-a81685f4-8771-4699-9250-d64cd58c37b4 tempest-VolumesSnapshotListTestJSON-607561243 None] Create snapshot completed successfully Sep 28 11:49:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-af0145ab-f564-4aa0-a798-7750d6ebed6b tempest-VolumesSnapshotListTestJSON-607561243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:49:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-af0145ab-f564-4aa0-a798-7750d6ebed6b tempest-VolumesSnapshotListTestJSON-607561243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:49:26 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-af0145ab-f564-4aa0-a798-7750d6ebed6b tempest-VolumesSnapshotListTestJSON-607561243 None] Creating offline snapshot 52dfca48-9666-4212-87ab-c12e55f31bb0 of volume c5c9786c-b07a-412d-ad10-46cdec3da4f5 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 11:49:26 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[b605d66d-f9bc-4308-8b60-c5def3a30b23]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:49:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-af0145ab-f564-4aa0-a798-7750d6ebed6b tempest-VolumesSnapshotListTestJSON-607561243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.0a5829b4-1912-432d-a213-f30821f937b4 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:26 devstack sudo[92517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.0a5829b4-1912-432d-a213-f30821f937b4 Sep 28 11:49:26 devstack sudo[92517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:26 devstack sudo[92517]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-af0145ab-f564-4aa0-a798-7750d6ebed6b tempest-VolumesSnapshotListTestJSON-607561243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.0a5829b4-1912-432d-a213-f30821f937b4" returned: 0 in 0.603s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:26 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-af0145ab-f564-4aa0-a798-7750d6ebed6b tempest-VolumesSnapshotListTestJSON-607561243 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 11:49:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-af0145ab-f564-4aa0-a798-7750d6ebed6b tempest-VolumesSnapshotListTestJSON-607561243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.0a5829b4-1912-432d-a213-f30821f937b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.52dfca48-9666-4212-87ab-c12e55f31bb0 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:26 devstack sudo[92523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.0a5829b4-1912-432d-a213-f30821f937b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.52dfca48-9666-4212-87ab-c12e55f31bb0 1G Sep 28 11:49:26 devstack sudo[92523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:27 devstack sudo[92523]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-af0145ab-f564-4aa0-a798-7750d6ebed6b tempest-VolumesSnapshotListTestJSON-607561243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.0a5829b4-1912-432d-a213-f30821f937b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.52dfca48-9666-4212-87ab-c12e55f31bb0 1G" returned: 0 in 0.784s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-af0145ab-f564-4aa0-a798-7750d6ebed6b tempest-VolumesSnapshotListTestJSON-607561243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.0a5829b4-1912-432d-a213-f30821f937b4 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.52dfca48-9666-4212-87ab-c12e55f31bb0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:27 devstack sudo[92529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.0a5829b4-1912-432d-a213-f30821f937b4 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.52dfca48-9666-4212-87ab-c12e55f31bb0 Sep 28 11:49:27 devstack sudo[92529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:28 devstack sudo[92529]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-af0145ab-f564-4aa0-a798-7750d6ebed6b tempest-VolumesSnapshotListTestJSON-607561243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.0a5829b4-1912-432d-a213-f30821f937b4 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.52dfca48-9666-4212-87ab-c12e55f31bb0" returned: 0 in 0.332s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:28 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-af0145ab-f564-4aa0-a798-7750d6ebed6b tempest-VolumesSnapshotListTestJSON-607561243 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.52dfca48-9666-4212-87ab-c12e55f31bb0 is being set with open permissions: ugo+rw Sep 28 11:49:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-af0145ab-f564-4aa0-a798-7750d6ebed6b tempest-VolumesSnapshotListTestJSON-607561243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.52dfca48-9666-4212-87ab-c12e55f31bb0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:28 devstack sudo[92534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.52dfca48-9666-4212-87ab-c12e55f31bb0 Sep 28 11:49:28 devstack sudo[92534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:28 devstack sudo[92534]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-af0145ab-f564-4aa0-a798-7750d6ebed6b tempest-VolumesSnapshotListTestJSON-607561243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.52dfca48-9666-4212-87ab-c12e55f31bb0" returned: 0 in 0.297s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-af0145ab-f564-4aa0-a798-7750d6ebed6b tempest-VolumesSnapshotListTestJSON-607561243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.158s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:49:28 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-af0145ab-f564-4aa0-a798-7750d6ebed6b tempest-VolumesSnapshotListTestJSON-607561243 None] Create snapshot completed successfully Sep 28 11:49:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c7b9f479-386b-44ad-b65a-b95b0e58212c tempest-VolumesSnapshotListTestJSON-607561243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:49:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c7b9f479-386b-44ad-b65a-b95b0e58212c tempest-VolumesSnapshotListTestJSON-607561243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:49:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-c7b9f479-386b-44ad-b65a-b95b0e58212c tempest-VolumesSnapshotListTestJSON-607561243 None] Creating offline snapshot ef012121-15fa-4da8-be9d-65aa3d09c558 of volume c5c9786c-b07a-412d-ad10-46cdec3da4f5 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 11:49:29 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c894fc-75d5-46de-8753-32cef5b262e5]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:49:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c7b9f479-386b-44ad-b65a-b95b0e58212c tempest-VolumesSnapshotListTestJSON-607561243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.52dfca48-9666-4212-87ab-c12e55f31bb0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:29 devstack sudo[92538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.52dfca48-9666-4212-87ab-c12e55f31bb0 Sep 28 11:49:29 devstack sudo[92538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:30 devstack sudo[92538]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c7b9f479-386b-44ad-b65a-b95b0e58212c tempest-VolumesSnapshotListTestJSON-607561243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.52dfca48-9666-4212-87ab-c12e55f31bb0" returned: 0 in 0.564s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-c7b9f479-386b-44ad-b65a-b95b0e58212c tempest-VolumesSnapshotListTestJSON-607561243 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 11:49:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c7b9f479-386b-44ad-b65a-b95b0e58212c tempest-VolumesSnapshotListTestJSON-607561243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.52dfca48-9666-4212-87ab-c12e55f31bb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.ef012121-15fa-4da8-be9d-65aa3d09c558 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:30 devstack sudo[92544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.52dfca48-9666-4212-87ab-c12e55f31bb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.ef012121-15fa-4da8-be9d-65aa3d09c558 1G Sep 28 11:49:30 devstack sudo[92544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:31 devstack sudo[92544]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c7b9f479-386b-44ad-b65a-b95b0e58212c tempest-VolumesSnapshotListTestJSON-607561243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.52dfca48-9666-4212-87ab-c12e55f31bb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.ef012121-15fa-4da8-be9d-65aa3d09c558 1G" returned: 0 in 0.665s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c7b9f479-386b-44ad-b65a-b95b0e58212c tempest-VolumesSnapshotListTestJSON-607561243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.52dfca48-9666-4212-87ab-c12e55f31bb0 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.ef012121-15fa-4da8-be9d-65aa3d09c558 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:31 devstack sudo[92554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.52dfca48-9666-4212-87ab-c12e55f31bb0 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.ef012121-15fa-4da8-be9d-65aa3d09c558 Sep 28 11:49:31 devstack sudo[92554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:31 devstack sudo[92554]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c7b9f479-386b-44ad-b65a-b95b0e58212c tempest-VolumesSnapshotListTestJSON-607561243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.52dfca48-9666-4212-87ab-c12e55f31bb0 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.ef012121-15fa-4da8-be9d-65aa3d09c558" returned: 0 in 0.456s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:31 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-c7b9f479-386b-44ad-b65a-b95b0e58212c tempest-VolumesSnapshotListTestJSON-607561243 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.ef012121-15fa-4da8-be9d-65aa3d09c558 is being set with open permissions: ugo+rw Sep 28 11:49:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c7b9f479-386b-44ad-b65a-b95b0e58212c tempest-VolumesSnapshotListTestJSON-607561243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.ef012121-15fa-4da8-be9d-65aa3d09c558 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:31 devstack sudo[92587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.ef012121-15fa-4da8-be9d-65aa3d09c558 Sep 28 11:49:31 devstack sudo[92587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:31 devstack sudo[92587]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c7b9f479-386b-44ad-b65a-b95b0e58212c tempest-VolumesSnapshotListTestJSON-607561243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.ef012121-15fa-4da8-be9d-65aa3d09c558" returned: 0 in 0.449s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c7b9f479-386b-44ad-b65a-b95b0e58212c tempest-VolumesSnapshotListTestJSON-607561243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.292s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:49:32 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-c7b9f479-386b-44ad-b65a-b95b0e58212c tempest-VolumesSnapshotListTestJSON-607561243 None] Create snapshot completed successfully Sep 28 11:49:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-26ca9073-9e9a-45ec-bec5-c20a5186955c tempest-VolumesSnapshotListTestJSON-607561243 None] Acquiring lock "cinder-ef012121-15fa-4da8-be9d-65aa3d09c558-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:49:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-26ca9073-9e9a-45ec-bec5-c20a5186955c tempest-VolumesSnapshotListTestJSON-607561243 None] Lock "cinder-ef012121-15fa-4da8-be9d-65aa3d09c558-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:49:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-26ca9073-9e9a-45ec-bec5-c20a5186955c tempest-VolumesSnapshotListTestJSON-607561243 None] Acquiring lock "cinder-quobyte-c5c9786c-b07a-412d-ad10-46cdec3da4f5" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:49:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-26ca9073-9e9a-45ec-bec5-c20a5186955c tempest-VolumesSnapshotListTestJSON-607561243 None] Lock "cinder-quobyte-c5c9786c-b07a-412d-ad10-46cdec3da4f5" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:49:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-26ca9073-9e9a-45ec-bec5-c20a5186955c tempest-VolumesSnapshotListTestJSON-607561243 None] Acquiring lock "cinder-quobyte-ef012121-15fa-4da8-be9d-65aa3d09c558" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:49:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-26ca9073-9e9a-45ec-bec5-c20a5186955c tempest-VolumesSnapshotListTestJSON-607561243 None] Lock "cinder-quobyte-ef012121-15fa-4da8-be9d-65aa3d09c558" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:49:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-26ca9073-9e9a-45ec-bec5-c20a5186955c tempest-VolumesSnapshotListTestJSON-607561243 None] Deleting offline snapshot ef012121-15fa-4da8-be9d-65aa3d09c558 of volume c5c9786c-b07a-412d-ad10-46cdec3da4f5 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 11:49:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-26ca9073-9e9a-45ec-bec5-c20a5186955c tempest-VolumesSnapshotListTestJSON-607561243 None] snapshot_file for this snap is: volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.ef012121-15fa-4da8-be9d-65aa3d09c558 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 11:49:34 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d426c6-a7e9-43f9-8a45-e55b122c0cb7]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:49:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-26ca9073-9e9a-45ec-bec5-c20a5186955c tempest-VolumesSnapshotListTestJSON-607561243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.ef012121-15fa-4da8-be9d-65aa3d09c558 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:34 devstack sudo[92590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.ef012121-15fa-4da8-be9d-65aa3d09c558 Sep 28 11:49:34 devstack sudo[92590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:34 devstack sudo[92590]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-26ca9073-9e9a-45ec-bec5-c20a5186955c tempest-VolumesSnapshotListTestJSON-607561243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.ef012121-15fa-4da8-be9d-65aa3d09c558" returned: 0 in 0.415s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-26ca9073-9e9a-45ec-bec5-c20a5186955c tempest-VolumesSnapshotListTestJSON-607561243 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 11:49:34 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[9642143b-3f43-4752-84b9-2a3e67e15640]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:49:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-26ca9073-9e9a-45ec-bec5-c20a5186955c tempest-VolumesSnapshotListTestJSON-607561243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.52dfca48-9666-4212-87ab-c12e55f31bb0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:34 devstack sudo[92595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.52dfca48-9666-4212-87ab-c12e55f31bb0 Sep 28 11:49:34 devstack sudo[92595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:35 devstack sudo[92595]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-26ca9073-9e9a-45ec-bec5-c20a5186955c tempest-VolumesSnapshotListTestJSON-607561243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.52dfca48-9666-4212-87ab-c12e55f31bb0" returned: 0 in 0.493s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-26ca9073-9e9a-45ec-bec5-c20a5186955c tempest-VolumesSnapshotListTestJSON-607561243 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 11:49:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-26ca9073-9e9a-45ec-bec5-c20a5186955c tempest-VolumesSnapshotListTestJSON-607561243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.ef012121-15fa-4da8-be9d-65aa3d09c558 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:35 devstack sudo[92624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.ef012121-15fa-4da8-be9d-65aa3d09c558 Sep 28 11:49:35 devstack sudo[92624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:35 devstack sudo[92624]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-26ca9073-9e9a-45ec-bec5-c20a5186955c tempest-VolumesSnapshotListTestJSON-607561243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.ef012121-15fa-4da8-be9d-65aa3d09c558" returned: 0 in 0.523s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-26ca9073-9e9a-45ec-bec5-c20a5186955c tempest-VolumesSnapshotListTestJSON-607561243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.ef012121-15fa-4da8-be9d-65aa3d09c558 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:35 devstack sudo[92631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.ef012121-15fa-4da8-be9d-65aa3d09c558 Sep 28 11:49:35 devstack sudo[92631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:35 devstack sudo[92631]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-26ca9073-9e9a-45ec-bec5-c20a5186955c tempest-VolumesSnapshotListTestJSON-607561243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.ef012121-15fa-4da8-be9d-65aa3d09c558" returned: 0 in 0.267s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-26ca9073-9e9a-45ec-bec5-c20a5186955c tempest-VolumesSnapshotListTestJSON-607561243 None] Lock "cinder-quobyte-ef012121-15fa-4da8-be9d-65aa3d09c558" released by "_delete_snapshot" :: held 1.858s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:49:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-26ca9073-9e9a-45ec-bec5-c20a5186955c tempest-VolumesSnapshotListTestJSON-607561243 None] Lock "cinder-quobyte-c5c9786c-b07a-412d-ad10-46cdec3da4f5" released by "delete_snapshot" :: held 1.884s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:49:36 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-26ca9073-9e9a-45ec-bec5-c20a5186955c tempest-VolumesSnapshotListTestJSON-607561243 None] Created reservations ['3904476b-53eb-4769-b0ab-ff56d82c44c9', '44cd1829-742a-4ab2-a6a7-ce7ca63d8341', 'a0e52f33-c807-4f3f-ae7d-2687a589927c', 'e0e88915-4794-4522-94fe-46aa89571fa0'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:49:36 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-26ca9073-9e9a-45ec-bec5-c20a5186955c tempest-VolumesSnapshotListTestJSON-607561243 None] Delete snapshot completed successfully. Sep 28 11:49:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-26ca9073-9e9a-45ec-bec5-c20a5186955c tempest-VolumesSnapshotListTestJSON-607561243 None] Lock "cinder-ef012121-15fa-4da8-be9d-65aa3d09c558-delete_snapshot" released by "delete_snapshot" :: held 2.085s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:49:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b61a72f5-dbe7-4161-8eb8-94b44f439992 tempest-VolumesSnapshotListTestJSON-607561243 None] Acquiring lock "cinder-52dfca48-9666-4212-87ab-c12e55f31bb0-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:49:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b61a72f5-dbe7-4161-8eb8-94b44f439992 tempest-VolumesSnapshotListTestJSON-607561243 None] Lock "cinder-52dfca48-9666-4212-87ab-c12e55f31bb0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:49:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b61a72f5-dbe7-4161-8eb8-94b44f439992 tempest-VolumesSnapshotListTestJSON-607561243 None] Acquiring lock "cinder-quobyte-c5c9786c-b07a-412d-ad10-46cdec3da4f5" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:49:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b61a72f5-dbe7-4161-8eb8-94b44f439992 tempest-VolumesSnapshotListTestJSON-607561243 None] Lock "cinder-quobyte-c5c9786c-b07a-412d-ad10-46cdec3da4f5" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:49:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b61a72f5-dbe7-4161-8eb8-94b44f439992 tempest-VolumesSnapshotListTestJSON-607561243 None] Acquiring lock "cinder-quobyte-52dfca48-9666-4212-87ab-c12e55f31bb0" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:49:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b61a72f5-dbe7-4161-8eb8-94b44f439992 tempest-VolumesSnapshotListTestJSON-607561243 None] Lock "cinder-quobyte-52dfca48-9666-4212-87ab-c12e55f31bb0" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:49:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-b61a72f5-dbe7-4161-8eb8-94b44f439992 tempest-VolumesSnapshotListTestJSON-607561243 None] Deleting offline snapshot 52dfca48-9666-4212-87ab-c12e55f31bb0 of volume c5c9786c-b07a-412d-ad10-46cdec3da4f5 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 11:49:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-b61a72f5-dbe7-4161-8eb8-94b44f439992 tempest-VolumesSnapshotListTestJSON-607561243 None] snapshot_file for this snap is: volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.52dfca48-9666-4212-87ab-c12e55f31bb0 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 11:49:36 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66cd8c5-440a-4268-b989-65e38d249e7f]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:49:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b61a72f5-dbe7-4161-8eb8-94b44f439992 tempest-VolumesSnapshotListTestJSON-607561243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.52dfca48-9666-4212-87ab-c12e55f31bb0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:36 devstack sudo[92636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.52dfca48-9666-4212-87ab-c12e55f31bb0 Sep 28 11:49:36 devstack sudo[92636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:36 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-249f315c-77e3-44ef-9a3c-48823e8849b6 tempest-VolumesListAdminTestJSON-1288701082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:49:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-249f315c-77e3-44ef-9a3c-48823e8849b6 tempest-VolumesListAdminTestJSON-1288701082 None] Flow 'volume_create_manager' (a7350b98-b5fe-4039-affa-a2da19875f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:49:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-249f315c-77e3-44ef-9a3c-48823e8849b6 tempest-VolumesListAdminTestJSON-1288701082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4278ed89-926e-4b46-9912-418cc8a7d4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:49:36 devstack sudo[92636]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b61a72f5-dbe7-4161-8eb8-94b44f439992 tempest-VolumesSnapshotListTestJSON-607561243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.52dfca48-9666-4212-87ab-c12e55f31bb0" returned: 0 in 0.475s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-b61a72f5-dbe7-4161-8eb8-94b44f439992 tempest-VolumesSnapshotListTestJSON-607561243 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 11:49:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-249f315c-77e3-44ef-9a3c-48823e8849b6 tempest-VolumesListAdminTestJSON-1288701082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4278ed89-926e-4b46-9912-418cc8a7d4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:49:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-105478177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bac3419-6b94-47f9-994d-0bd471282173,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6a39900bbf04b2682b3c277f3066ef8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:49:37Z,use_quota=True,user_id='674c114a74d342fab9b1d443b3e5e597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:49:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-249f315c-77e3-44ef-9a3c-48823e8849b6 tempest-VolumesListAdminTestJSON-1288701082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f737c861-0a05-451d-9992-19560b662c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:49:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-249f315c-77e3-44ef-9a3c-48823e8849b6 tempest-VolumesListAdminTestJSON-1288701082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f737c861-0a05-451d-9992-19560b662c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:49:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-249f315c-77e3-44ef-9a3c-48823e8849b6 tempest-VolumesListAdminTestJSON-1288701082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f4ec55a-4541-48f9-856a-df4419ce0398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:49:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-249f315c-77e3-44ef-9a3c-48823e8849b6 tempest-VolumesListAdminTestJSON-1288701082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f4ec55a-4541-48f9-856a-df4419ce0398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bac3419-6b94-47f9-994d-0bd471282173', 'volume_name': 'volume-9bac3419-6b94-47f9-994d-0bd471282173', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:49:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-249f315c-77e3-44ef-9a3c-48823e8849b6 tempest-VolumesListAdminTestJSON-1288701082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84550c0d-74f9-4daf-9ef2-ee8b188a907c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:49:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-249f315c-77e3-44ef-9a3c-48823e8849b6 tempest-VolumesListAdminTestJSON-1288701082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84550c0d-74f9-4daf-9ef2-ee8b188a907c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:49:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-249f315c-77e3-44ef-9a3c-48823e8849b6 tempest-VolumesListAdminTestJSON-1288701082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14d67374-e153-486a-a141-976da310e3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:49:36 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-249f315c-77e3-44ef-9a3c-48823e8849b6 tempest-VolumesListAdminTestJSON-1288701082 None] Volume 9bac3419-6b94-47f9-994d-0bd471282173: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bac3419-6b94-47f9-994d-0bd471282173', 'volume_size': 1} Sep 28 11:49:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-249f315c-77e3-44ef-9a3c-48823e8849b6 tempest-VolumesListAdminTestJSON-1288701082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:49:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-249f315c-77e3-44ef-9a3c-48823e8849b6 tempest-VolumesListAdminTestJSON-1288701082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:49:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-249f315c-77e3-44ef-9a3c-48823e8849b6 tempest-VolumesListAdminTestJSON-1288701082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:49:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-105478177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bac3419-6b94-47f9-994d-0bd471282173,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6a39900bbf04b2682b3c277f3066ef8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:49:37Z,use_quota=True,user_id='674c114a74d342fab9b1d443b3e5e597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:49:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-249f315c-77e3-44ef-9a3c-48823e8849b6 tempest-VolumesListAdminTestJSON-1288701082 None] Creating volume 9bac3419-6b94-47f9-994d-0bd471282173 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:49:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-249f315c-77e3-44ef-9a3c-48823e8849b6 tempest-VolumesListAdminTestJSON-1288701082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:49:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-249f315c-77e3-44ef-9a3c-48823e8849b6 tempest-VolumesListAdminTestJSON-1288701082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:49:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-249f315c-77e3-44ef-9a3c-48823e8849b6 tempest-VolumesListAdminTestJSON-1288701082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:49:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-249f315c-77e3-44ef-9a3c-48823e8849b6 tempest-VolumesListAdminTestJSON-1288701082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:49:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-249f315c-77e3-44ef-9a3c-48823e8849b6 tempest-VolumesListAdminTestJSON-1288701082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:49:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-249f315c-77e3-44ef-9a3c-48823e8849b6 tempest-VolumesListAdminTestJSON-1288701082 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:49:36 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-249f315c-77e3-44ef-9a3c-48823e8849b6 tempest-VolumesListAdminTestJSON-1288701082 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:49:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-249f315c-77e3-44ef-9a3c-48823e8849b6 tempest-VolumesListAdminTestJSON-1288701082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9bac3419-6b94-47f9-994d-0bd471282173 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:36 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbbb356e-8cf0-4c8a-bba6-82f84666e81e]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:49:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b61a72f5-dbe7-4161-8eb8-94b44f439992 tempest-VolumesSnapshotListTestJSON-607561243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.0a5829b4-1912-432d-a213-f30821f937b4 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:36 devstack sudo[92642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9bac3419-6b94-47f9-994d-0bd471282173 1073741824 Sep 28 11:49:36 devstack sudo[92642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:37 devstack sudo[92643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.0a5829b4-1912-432d-a213-f30821f937b4 Sep 28 11:49:37 devstack sudo[92643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:37 devstack sudo[92643]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b61a72f5-dbe7-4161-8eb8-94b44f439992 tempest-VolumesSnapshotListTestJSON-607561243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.0a5829b4-1912-432d-a213-f30821f937b4" returned: 0 in 0.415s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-b61a72f5-dbe7-4161-8eb8-94b44f439992 tempest-VolumesSnapshotListTestJSON-607561243 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 11:49:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b61a72f5-dbe7-4161-8eb8-94b44f439992 tempest-VolumesSnapshotListTestJSON-607561243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.52dfca48-9666-4212-87ab-c12e55f31bb0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:37 devstack sudo[92652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.52dfca48-9666-4212-87ab-c12e55f31bb0 Sep 28 11:49:37 devstack sudo[92652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:37 devstack sudo[92642]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-249f315c-77e3-44ef-9a3c-48823e8849b6 tempest-VolumesListAdminTestJSON-1288701082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9bac3419-6b94-47f9-994d-0bd471282173 1073741824" returned: 0 in 0.566s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-249f315c-77e3-44ef-9a3c-48823e8849b6 tempest-VolumesListAdminTestJSON-1288701082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9bac3419-6b94-47f9-994d-0bd471282173 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:37 devstack sudo[92655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9bac3419-6b94-47f9-994d-0bd471282173 Sep 28 11:49:37 devstack sudo[92655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:37 devstack sudo[92655]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-249f315c-77e3-44ef-9a3c-48823e8849b6 tempest-VolumesListAdminTestJSON-1288701082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9bac3419-6b94-47f9-994d-0bd471282173" returned: 0 in 0.276s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-249f315c-77e3-44ef-9a3c-48823e8849b6 tempest-VolumesListAdminTestJSON-1288701082 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:49:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-249f315c-77e3-44ef-9a3c-48823e8849b6 tempest-VolumesListAdminTestJSON-1288701082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:49:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-249f315c-77e3-44ef-9a3c-48823e8849b6 tempest-VolumesListAdminTestJSON-1288701082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14d67374-e153-486a-a141-976da310e3f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bac3419-6b94-47f9-994d-0bd471282173', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:49:37 devstack sudo[92652]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-249f315c-77e3-44ef-9a3c-48823e8849b6 tempest-VolumesListAdminTestJSON-1288701082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15f933be-3ecb-4a59-8680-d3dec4a92804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:49:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b61a72f5-dbe7-4161-8eb8-94b44f439992 tempest-VolumesSnapshotListTestJSON-607561243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.52dfca48-9666-4212-87ab-c12e55f31bb0" returned: 0 in 0.481s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b61a72f5-dbe7-4161-8eb8-94b44f439992 tempest-VolumesSnapshotListTestJSON-607561243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.52dfca48-9666-4212-87ab-c12e55f31bb0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:37 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-249f315c-77e3-44ef-9a3c-48823e8849b6 tempest-VolumesListAdminTestJSON-1288701082 None] Volume volume-9bac3419-6b94-47f9-994d-0bd471282173 (9bac3419-6b94-47f9-994d-0bd471282173): created successfully Sep 28 11:49:37 devstack sudo[92661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.52dfca48-9666-4212-87ab-c12e55f31bb0 Sep 28 11:49:37 devstack sudo[92661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-249f315c-77e3-44ef-9a3c-48823e8849b6 tempest-VolumesListAdminTestJSON-1288701082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15f933be-3ecb-4a59-8680-d3dec4a92804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:49:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-249f315c-77e3-44ef-9a3c-48823e8849b6 tempest-VolumesListAdminTestJSON-1288701082 None] Flow 'volume_create_manager' (a7350b98-b5fe-4039-affa-a2da19875f68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:49:37 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-249f315c-77e3-44ef-9a3c-48823e8849b6 tempest-VolumesListAdminTestJSON-1288701082 None] Created volume successfully. Sep 28 11:49:38 devstack sudo[92661]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b61a72f5-dbe7-4161-8eb8-94b44f439992 tempest-VolumesSnapshotListTestJSON-607561243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.52dfca48-9666-4212-87ab-c12e55f31bb0" returned: 0 in 0.336s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b61a72f5-dbe7-4161-8eb8-94b44f439992 tempest-VolumesSnapshotListTestJSON-607561243 None] Lock "cinder-quobyte-52dfca48-9666-4212-87ab-c12e55f31bb0" released by "_delete_snapshot" :: held 1.910s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:49:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b61a72f5-dbe7-4161-8eb8-94b44f439992 tempest-VolumesSnapshotListTestJSON-607561243 None] Lock "cinder-quobyte-c5c9786c-b07a-412d-ad10-46cdec3da4f5" released by "delete_snapshot" :: held 1.938s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:49:38 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-b61a72f5-dbe7-4161-8eb8-94b44f439992 tempest-VolumesSnapshotListTestJSON-607561243 None] Created reservations ['57125753-2cbd-44c5-bce7-a87e906afee6', '870b6e31-6be8-4d48-99cf-66f289c237e1', 'ceaba6a7-90be-482a-b888-38cd803e0eba', '680efb41-cc10-42ff-86cc-b51a50a9e10f'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:49:38 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b61a72f5-dbe7-4161-8eb8-94b44f439992 tempest-VolumesSnapshotListTestJSON-607561243 None] Delete snapshot completed successfully. Sep 28 11:49:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b61a72f5-dbe7-4161-8eb8-94b44f439992 tempest-VolumesSnapshotListTestJSON-607561243 None] Lock "cinder-52dfca48-9666-4212-87ab-c12e55f31bb0-delete_snapshot" released by "delete_snapshot" :: held 2.127s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:49:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-aeb780b2-034f-4642-8a5f-aee77da7f8be tempest-VolumesSnapshotListTestJSON-607561243 None] Acquiring lock "cinder-0a5829b4-1912-432d-a213-f30821f937b4-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:49:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-aeb780b2-034f-4642-8a5f-aee77da7f8be tempest-VolumesSnapshotListTestJSON-607561243 None] Lock "cinder-0a5829b4-1912-432d-a213-f30821f937b4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:49:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-aeb780b2-034f-4642-8a5f-aee77da7f8be tempest-VolumesSnapshotListTestJSON-607561243 None] Acquiring lock "cinder-quobyte-c5c9786c-b07a-412d-ad10-46cdec3da4f5" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:49:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-aeb780b2-034f-4642-8a5f-aee77da7f8be tempest-VolumesSnapshotListTestJSON-607561243 None] Lock "cinder-quobyte-c5c9786c-b07a-412d-ad10-46cdec3da4f5" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:49:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-aeb780b2-034f-4642-8a5f-aee77da7f8be tempest-VolumesSnapshotListTestJSON-607561243 None] Acquiring lock "cinder-quobyte-0a5829b4-1912-432d-a213-f30821f937b4" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:49:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-aeb780b2-034f-4642-8a5f-aee77da7f8be tempest-VolumesSnapshotListTestJSON-607561243 None] Lock "cinder-quobyte-0a5829b4-1912-432d-a213-f30821f937b4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:49:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-aeb780b2-034f-4642-8a5f-aee77da7f8be tempest-VolumesSnapshotListTestJSON-607561243 None] Deleting offline snapshot 0a5829b4-1912-432d-a213-f30821f937b4 of volume c5c9786c-b07a-412d-ad10-46cdec3da4f5 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 11:49:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-aeb780b2-034f-4642-8a5f-aee77da7f8be tempest-VolumesSnapshotListTestJSON-607561243 None] snapshot_file for this snap is: volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.0a5829b4-1912-432d-a213-f30821f937b4 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 11:49:38 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 11:49:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:49:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:49:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:49:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:49:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:49:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:38 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36e44d3-bc8d-42b3-be59-245faee81c2e]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:49:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-aeb780b2-034f-4642-8a5f-aee77da7f8be tempest-VolumesSnapshotListTestJSON-607561243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.0a5829b4-1912-432d-a213-f30821f937b4 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:38 devstack sudo[92664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:49:38 devstack sudo[92664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:38 devstack sudo[92665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.0a5829b4-1912-432d-a213-f30821f937b4 Sep 28 11:49:38 devstack sudo[92665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:39 devstack sudo[92664]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.372s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:39 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:49:39 devstack sudo[92665]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-aeb780b2-034f-4642-8a5f-aee77da7f8be tempest-VolumesSnapshotListTestJSON-607561243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.0a5829b4-1912-432d-a213-f30821f937b4" returned: 0 in 0.536s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-aeb780b2-034f-4642-8a5f-aee77da7f8be tempest-VolumesSnapshotListTestJSON-607561243 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 11:49:39 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0f0f46-fa19-4aee-aeae-687ebc756487]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:49:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-aeb780b2-034f-4642-8a5f-aee77da7f8be tempest-VolumesSnapshotListTestJSON-607561243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:39 devstack sudo[92672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5 Sep 28 11:49:39 devstack sudo[92672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:39 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f771066-1561-4956-bacc-8cada773aa39 tempest-VolumesListAdminTestJSON-1288701082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:49:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2f771066-1561-4956-bacc-8cada773aa39 tempest-VolumesListAdminTestJSON-1288701082 None] Flow 'volume_create_manager' (7deb1c49-7911-44e8-84de-9cae0965a688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:49:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2f771066-1561-4956-bacc-8cada773aa39 tempest-VolumesListAdminTestJSON-1288701082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (427eb251-1eaa-48b5-93c0-c9a6ad0795fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:49:39 devstack sudo[92672]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-aeb780b2-034f-4642-8a5f-aee77da7f8be tempest-VolumesSnapshotListTestJSON-607561243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5" returned: 0 in 0.513s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-aeb780b2-034f-4642-8a5f-aee77da7f8be tempest-VolumesSnapshotListTestJSON-607561243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.0a5829b4-1912-432d-a213-f30821f937b4 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2f771066-1561-4956-bacc-8cada773aa39 tempest-VolumesListAdminTestJSON-1288701082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (427eb251-1eaa-48b5-93c0-c9a6ad0795fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:49:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-32147707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=615b61e7-d897-4d78-ac1d-042f72b37d60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6a39900bbf04b2682b3c277f3066ef8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:49:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:49:40Z,use_quota=True,user_id='674c114a74d342fab9b1d443b3e5e597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:49:39 devstack sudo[92678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.0a5829b4-1912-432d-a213-f30821f937b4 Sep 28 11:49:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2f771066-1561-4956-bacc-8cada773aa39 tempest-VolumesListAdminTestJSON-1288701082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40d26f51-5748-496c-a80b-38bca9b8cc74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:49:39 devstack sudo[92678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2f771066-1561-4956-bacc-8cada773aa39 tempest-VolumesListAdminTestJSON-1288701082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40d26f51-5748-496c-a80b-38bca9b8cc74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:49:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2f771066-1561-4956-bacc-8cada773aa39 tempest-VolumesListAdminTestJSON-1288701082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd325526-bffb-4d06-881a-959fd01650b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:49:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2f771066-1561-4956-bacc-8cada773aa39 tempest-VolumesListAdminTestJSON-1288701082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd325526-bffb-4d06-881a-959fd01650b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '615b61e7-d897-4d78-ac1d-042f72b37d60', 'volume_name': 'volume-615b61e7-d897-4d78-ac1d-042f72b37d60', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:49:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2f771066-1561-4956-bacc-8cada773aa39 tempest-VolumesListAdminTestJSON-1288701082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84bef51f-2e23-4008-b887-c58d3e96679a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:49:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2f771066-1561-4956-bacc-8cada773aa39 tempest-VolumesListAdminTestJSON-1288701082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84bef51f-2e23-4008-b887-c58d3e96679a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:49:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2f771066-1561-4956-bacc-8cada773aa39 tempest-VolumesListAdminTestJSON-1288701082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cda32016-cb4d-4445-85b3-d6ff2aa65782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:49:39 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-2f771066-1561-4956-bacc-8cada773aa39 tempest-VolumesListAdminTestJSON-1288701082 None] Volume 615b61e7-d897-4d78-ac1d-042f72b37d60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-615b61e7-d897-4d78-ac1d-042f72b37d60', 'volume_size': 1} Sep 28 11:49:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2f771066-1561-4956-bacc-8cada773aa39 tempest-VolumesListAdminTestJSON-1288701082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:49:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2f771066-1561-4956-bacc-8cada773aa39 tempest-VolumesListAdminTestJSON-1288701082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:49:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2f771066-1561-4956-bacc-8cada773aa39 tempest-VolumesListAdminTestJSON-1288701082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:49:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-32147707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=615b61e7-d897-4d78-ac1d-042f72b37d60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6a39900bbf04b2682b3c277f3066ef8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:49:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:49:40Z,use_quota=True,user_id='674c114a74d342fab9b1d443b3e5e597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:49:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-2f771066-1561-4956-bacc-8cada773aa39 tempest-VolumesListAdminTestJSON-1288701082 None] Creating volume 615b61e7-d897-4d78-ac1d-042f72b37d60 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:49:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2f771066-1561-4956-bacc-8cada773aa39 tempest-VolumesListAdminTestJSON-1288701082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:49:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2f771066-1561-4956-bacc-8cada773aa39 tempest-VolumesListAdminTestJSON-1288701082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:49:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2f771066-1561-4956-bacc-8cada773aa39 tempest-VolumesListAdminTestJSON-1288701082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:49:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2f771066-1561-4956-bacc-8cada773aa39 tempest-VolumesListAdminTestJSON-1288701082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:49:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2f771066-1561-4956-bacc-8cada773aa39 tempest-VolumesListAdminTestJSON-1288701082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:49:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2f771066-1561-4956-bacc-8cada773aa39 tempest-VolumesListAdminTestJSON-1288701082 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:49:39 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-2f771066-1561-4956-bacc-8cada773aa39 tempest-VolumesListAdminTestJSON-1288701082 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:49:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2f771066-1561-4956-bacc-8cada773aa39 tempest-VolumesListAdminTestJSON-1288701082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-615b61e7-d897-4d78-ac1d-042f72b37d60 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:39 devstack sudo[92680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-615b61e7-d897-4d78-ac1d-042f72b37d60 1073741824 Sep 28 11:49:39 devstack sudo[92680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:40 devstack sudo[92678]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-aeb780b2-034f-4642-8a5f-aee77da7f8be tempest-VolumesSnapshotListTestJSON-607561243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.0a5829b4-1912-432d-a213-f30821f937b4" returned: 0 in 0.371s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-aeb780b2-034f-4642-8a5f-aee77da7f8be tempest-VolumesSnapshotListTestJSON-607561243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.0a5829b4-1912-432d-a213-f30821f937b4 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:40 devstack sudo[92689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.0a5829b4-1912-432d-a213-f30821f937b4 Sep 28 11:49:40 devstack sudo[92689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:40 devstack sudo[92680]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:40 devstack sudo[92689]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2f771066-1561-4956-bacc-8cada773aa39 tempest-VolumesListAdminTestJSON-1288701082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-615b61e7-d897-4d78-ac1d-042f72b37d60 1073741824" returned: 0 in 0.679s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-aeb780b2-034f-4642-8a5f-aee77da7f8be tempest-VolumesSnapshotListTestJSON-607561243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5.0a5829b4-1912-432d-a213-f30821f937b4" returned: 0 in 0.390s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-aeb780b2-034f-4642-8a5f-aee77da7f8be tempest-VolumesSnapshotListTestJSON-607561243 None] Lock "cinder-quobyte-0a5829b4-1912-432d-a213-f30821f937b4" released by "_delete_snapshot" :: held 1.986s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:49:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-aeb780b2-034f-4642-8a5f-aee77da7f8be tempest-VolumesSnapshotListTestJSON-607561243 None] Lock "cinder-quobyte-c5c9786c-b07a-412d-ad10-46cdec3da4f5" released by "delete_snapshot" :: held 2.016s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:49:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2f771066-1561-4956-bacc-8cada773aa39 tempest-VolumesListAdminTestJSON-1288701082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-615b61e7-d897-4d78-ac1d-042f72b37d60 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:40 devstack sudo[92694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-615b61e7-d897-4d78-ac1d-042f72b37d60 Sep 28 11:49:40 devstack sudo[92694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:40 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-aeb780b2-034f-4642-8a5f-aee77da7f8be tempest-VolumesSnapshotListTestJSON-607561243 None] Created reservations ['61710702-c6c9-4528-af40-fa6b7fa020a4', '22c5a08a-446e-417a-926f-300a13d9b348', 'ac096a40-956a-41e2-b8d0-7e81b6f4f334', '6b94c3a7-54da-4c19-b8b6-c35a9fae5ee8'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:49:40 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-aeb780b2-034f-4642-8a5f-aee77da7f8be tempest-VolumesSnapshotListTestJSON-607561243 None] Delete snapshot completed successfully. Sep 28 11:49:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-aeb780b2-034f-4642-8a5f-aee77da7f8be tempest-VolumesSnapshotListTestJSON-607561243 None] Lock "cinder-0a5829b4-1912-432d-a213-f30821f937b4-delete_snapshot" released by "delete_snapshot" :: held 2.361s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:49:41 devstack sudo[92694]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2f771066-1561-4956-bacc-8cada773aa39 tempest-VolumesListAdminTestJSON-1288701082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-615b61e7-d897-4d78-ac1d-042f72b37d60" returned: 0 in 0.408s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2f771066-1561-4956-bacc-8cada773aa39 tempest-VolumesListAdminTestJSON-1288701082 None] <== create_volume: return (1236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:49:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2f771066-1561-4956-bacc-8cada773aa39 tempest-VolumesListAdminTestJSON-1288701082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.239s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:49:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2f771066-1561-4956-bacc-8cada773aa39 tempest-VolumesListAdminTestJSON-1288701082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cda32016-cb4d-4445-85b3-d6ff2aa65782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-615b61e7-d897-4d78-ac1d-042f72b37d60', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:49:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2f771066-1561-4956-bacc-8cada773aa39 tempest-VolumesListAdminTestJSON-1288701082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4552da7f-faca-414c-8103-5c5cfe7268de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:49:41 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-2f771066-1561-4956-bacc-8cada773aa39 tempest-VolumesListAdminTestJSON-1288701082 None] Volume volume-615b61e7-d897-4d78-ac1d-042f72b37d60 (615b61e7-d897-4d78-ac1d-042f72b37d60): created successfully Sep 28 11:49:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2f771066-1561-4956-bacc-8cada773aa39 tempest-VolumesListAdminTestJSON-1288701082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4552da7f-faca-414c-8103-5c5cfe7268de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:49:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2f771066-1561-4956-bacc-8cada773aa39 tempest-VolumesListAdminTestJSON-1288701082 None] Flow 'volume_create_manager' (7deb1c49-7911-44e8-84de-9cae0965a688) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:49:41 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-2f771066-1561-4956-bacc-8cada773aa39 tempest-VolumesListAdminTestJSON-1288701082 None] Created volume successfully. Sep 28 11:49:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-26c70d54-4076-4ef7-9065-81fb09a09faf tempest-VolumesSnapshotListTestJSON-607561243 None] Acquiring lock "cinder-c5c9786c-b07a-412d-ad10-46cdec3da4f5-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:49:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-26c70d54-4076-4ef7-9065-81fb09a09faf tempest-VolumesSnapshotListTestJSON-607561243 None] Lock "cinder-c5c9786c-b07a-412d-ad10-46cdec3da4f5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:49:41 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-85fdab5d-b288-4806-96ab-ef9d4204f1c5 req-2d1ef530-bb51-49d1-acdc-53c9626ba590 tempest-ServerActionsTestOtherA-485250721 None] Terminate volume connection completed successfully. Sep 28 11:49:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-85fdab5d-b288-4806-96ab-ef9d4204f1c5 req-2d1ef530-bb51-49d1-acdc-53c9626ba590 tempest-ServerActionsTestOtherA-485250721 None] Deleting attachment fd0f607d-4887-42f6-8f70-0ca3725bdc93. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 11:49:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-26c70d54-4076-4ef7-9065-81fb09a09faf tempest-VolumesSnapshotListTestJSON-607561243 None] Acquiring lock "cinder-quobyte-c5c9786c-b07a-412d-ad10-46cdec3da4f5" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:49:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-26c70d54-4076-4ef7-9065-81fb09a09faf tempest-VolumesSnapshotListTestJSON-607561243 None] Lock "cinder-quobyte-c5c9786c-b07a-412d-ad10-46cdec3da4f5" acquired by "delete_volume" :: waited 0.039s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:49:42 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db01b91-e932-4184-b769-67972209fc56]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:49:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-26c70d54-4076-4ef7-9065-81fb09a09faf tempest-VolumesSnapshotListTestJSON-607561243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:42 devstack sudo[92704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5 Sep 28 11:49:42 devstack sudo[92704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:42 devstack sudo[92704]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-26c70d54-4076-4ef7-9065-81fb09a09faf tempest-VolumesSnapshotListTestJSON-607561243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5" returned: 0 in 0.559s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-26c70d54-4076-4ef7-9065-81fb09a09faf tempest-VolumesSnapshotListTestJSON-607561243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:42 devstack sudo[92709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5 Sep 28 11:49:42 devstack sudo[92709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:42 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-64315db7-c93f-48aa-a801-1f71687dcb1d tempest-VolumesListAdminTestJSON-1288701082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:49:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-64315db7-c93f-48aa-a801-1f71687dcb1d tempest-VolumesListAdminTestJSON-1288701082 None] Flow 'volume_create_manager' (43256eeb-bbf4-4d1e-a523-f99370bfa5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:49:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-64315db7-c93f-48aa-a801-1f71687dcb1d tempest-VolumesListAdminTestJSON-1288701082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae32781c-ad57-40f4-99e9-f3d634f9e88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:49:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-64315db7-c93f-48aa-a801-1f71687dcb1d tempest-VolumesListAdminTestJSON-1288701082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae32781c-ad57-40f4-99e9-f3d634f9e88d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-860950060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb777238-b1ba-45c9-8a5a-3f3c7ea0f50a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6a39900bbf04b2682b3c277f3066ef8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:49:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:49:43Z,use_quota=True,user_id='674c114a74d342fab9b1d443b3e5e597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:49:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-64315db7-c93f-48aa-a801-1f71687dcb1d tempest-VolumesListAdminTestJSON-1288701082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c03b8ee2-ac75-468b-b7aa-0081a065f0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:49:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-64315db7-c93f-48aa-a801-1f71687dcb1d tempest-VolumesListAdminTestJSON-1288701082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c03b8ee2-ac75-468b-b7aa-0081a065f0f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:49:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-64315db7-c93f-48aa-a801-1f71687dcb1d tempest-VolumesListAdminTestJSON-1288701082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (601408a2-8da8-4556-90dd-be320646d39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:49:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-64315db7-c93f-48aa-a801-1f71687dcb1d tempest-VolumesListAdminTestJSON-1288701082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (601408a2-8da8-4556-90dd-be320646d39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb777238-b1ba-45c9-8a5a-3f3c7ea0f50a', 'volume_name': 'volume-cb777238-b1ba-45c9-8a5a-3f3c7ea0f50a', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:49:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-64315db7-c93f-48aa-a801-1f71687dcb1d tempest-VolumesListAdminTestJSON-1288701082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07c39a37-61e3-4ece-ad20-f2a62e4e5a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:49:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-64315db7-c93f-48aa-a801-1f71687dcb1d tempest-VolumesListAdminTestJSON-1288701082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07c39a37-61e3-4ece-ad20-f2a62e4e5a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:49:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-64315db7-c93f-48aa-a801-1f71687dcb1d tempest-VolumesListAdminTestJSON-1288701082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (780d1016-c7c6-4834-ba68-585038e4cfc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:49:42 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-64315db7-c93f-48aa-a801-1f71687dcb1d tempest-VolumesListAdminTestJSON-1288701082 None] Volume cb777238-b1ba-45c9-8a5a-3f3c7ea0f50a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb777238-b1ba-45c9-8a5a-3f3c7ea0f50a', 'volume_size': 1} Sep 28 11:49:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-64315db7-c93f-48aa-a801-1f71687dcb1d tempest-VolumesListAdminTestJSON-1288701082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:49:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-64315db7-c93f-48aa-a801-1f71687dcb1d tempest-VolumesListAdminTestJSON-1288701082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:49:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-64315db7-c93f-48aa-a801-1f71687dcb1d tempest-VolumesListAdminTestJSON-1288701082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-860950060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb777238-b1ba-45c9-8a5a-3f3c7ea0f50a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6a39900bbf04b2682b3c277f3066ef8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:49:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:49:43Z,use_quota=True,user_id='674c114a74d342fab9b1d443b3e5e597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:49:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-64315db7-c93f-48aa-a801-1f71687dcb1d tempest-VolumesListAdminTestJSON-1288701082 None] Creating volume cb777238-b1ba-45c9-8a5a-3f3c7ea0f50a {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:49:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-64315db7-c93f-48aa-a801-1f71687dcb1d tempest-VolumesListAdminTestJSON-1288701082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:49:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-64315db7-c93f-48aa-a801-1f71687dcb1d tempest-VolumesListAdminTestJSON-1288701082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:49:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-64315db7-c93f-48aa-a801-1f71687dcb1d tempest-VolumesListAdminTestJSON-1288701082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:49:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-64315db7-c93f-48aa-a801-1f71687dcb1d tempest-VolumesListAdminTestJSON-1288701082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:49:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-64315db7-c93f-48aa-a801-1f71687dcb1d tempest-VolumesListAdminTestJSON-1288701082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:49:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-64315db7-c93f-48aa-a801-1f71687dcb1d tempest-VolumesListAdminTestJSON-1288701082 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:49:42 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-64315db7-c93f-48aa-a801-1f71687dcb1d tempest-VolumesListAdminTestJSON-1288701082 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:49:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-64315db7-c93f-48aa-a801-1f71687dcb1d tempest-VolumesListAdminTestJSON-1288701082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cb777238-b1ba-45c9-8a5a-3f3c7ea0f50a 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:42 devstack sudo[92712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cb777238-b1ba-45c9-8a5a-3f3c7ea0f50a 1073741824 Sep 28 11:49:42 devstack sudo[92712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:42 devstack sudo[92709]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-26c70d54-4076-4ef7-9065-81fb09a09faf tempest-VolumesSnapshotListTestJSON-607561243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c5c9786c-b07a-412d-ad10-46cdec3da4f5" returned: 0 in 0.354s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:42 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-26c70d54-4076-4ef7-9065-81fb09a09faf tempest-VolumesSnapshotListTestJSON-607561243 None] Lock "cinder-quobyte-c5c9786c-b07a-412d-ad10-46cdec3da4f5" released by "delete_volume" :: held 1.021s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:49:43 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-26c70d54-4076-4ef7-9065-81fb09a09faf tempest-VolumesSnapshotListTestJSON-607561243 None] Created reservations ['7408ea73-2325-4af3-afc4-b64a32a606b8', '8e3c33ff-f112-410c-894d-9bb6d3449600', '45f41930-6094-4601-b371-3ffbe8210d13', '1970cfc9-4ad8-46e1-8561-71221447e8a9'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:49:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-26c70d54-4076-4ef7-9065-81fb09a09faf tempest-VolumesSnapshotListTestJSON-607561243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:49:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-26c70d54-4076-4ef7-9065-81fb09a09faf tempest-VolumesSnapshotListTestJSON-607561243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:49:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-26c70d54-4076-4ef7-9065-81fb09a09faf tempest-VolumesSnapshotListTestJSON-607561243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:49:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-26c70d54-4076-4ef7-9065-81fb09a09faf tempest-VolumesSnapshotListTestJSON-607561243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:49:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-26c70d54-4076-4ef7-9065-81fb09a09faf tempest-VolumesSnapshotListTestJSON-607561243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:49:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-26c70d54-4076-4ef7-9065-81fb09a09faf tempest-VolumesSnapshotListTestJSON-607561243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:43 devstack sudo[92721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:49:43 devstack sudo[92721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:43 devstack sudo[92712]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-64315db7-c93f-48aa-a801-1f71687dcb1d tempest-VolumesListAdminTestJSON-1288701082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cb777238-b1ba-45c9-8a5a-3f3c7ea0f50a 1073741824" returned: 0 in 0.719s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-64315db7-c93f-48aa-a801-1f71687dcb1d tempest-VolumesListAdminTestJSON-1288701082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cb777238-b1ba-45c9-8a5a-3f3c7ea0f50a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:43 devstack sudo[92742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cb777238-b1ba-45c9-8a5a-3f3c7ea0f50a Sep 28 11:49:43 devstack sudo[92742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:43 devstack sudo[92721]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-26c70d54-4076-4ef7-9065-81fb09a09faf tempest-VolumesSnapshotListTestJSON-607561243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.441s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:43 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-26c70d54-4076-4ef7-9065-81fb09a09faf tempest-VolumesSnapshotListTestJSON-607561243 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:49:43 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-26c70d54-4076-4ef7-9065-81fb09a09faf tempest-VolumesSnapshotListTestJSON-607561243 None] Deleted volume successfully. Sep 28 11:49:43 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-26c70d54-4076-4ef7-9065-81fb09a09faf tempest-VolumesSnapshotListTestJSON-607561243 None] Lock "cinder-c5c9786c-b07a-412d-ad10-46cdec3da4f5-delete_volume" released by "delete_volume" :: held 1.794s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:49:44 devstack sudo[92742]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-64315db7-c93f-48aa-a801-1f71687dcb1d tempest-VolumesListAdminTestJSON-1288701082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cb777238-b1ba-45c9-8a5a-3f3c7ea0f50a" returned: 0 in 0.450s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:44 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-64315db7-c93f-48aa-a801-1f71687dcb1d tempest-VolumesListAdminTestJSON-1288701082 None] <== create_volume: return (1242ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:49:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-64315db7-c93f-48aa-a801-1f71687dcb1d tempest-VolumesListAdminTestJSON-1288701082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.245s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:49:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-64315db7-c93f-48aa-a801-1f71687dcb1d tempest-VolumesListAdminTestJSON-1288701082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (780d1016-c7c6-4834-ba68-585038e4cfc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb777238-b1ba-45c9-8a5a-3f3c7ea0f50a', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:49:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-64315db7-c93f-48aa-a801-1f71687dcb1d tempest-VolumesListAdminTestJSON-1288701082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34a24832-f14c-46db-9e33-f8bf5f9fcae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:49:44 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-64315db7-c93f-48aa-a801-1f71687dcb1d tempest-VolumesListAdminTestJSON-1288701082 None] Volume volume-cb777238-b1ba-45c9-8a5a-3f3c7ea0f50a (cb777238-b1ba-45c9-8a5a-3f3c7ea0f50a): created successfully Sep 28 11:49:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-64315db7-c93f-48aa-a801-1f71687dcb1d tempest-VolumesListAdminTestJSON-1288701082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34a24832-f14c-46db-9e33-f8bf5f9fcae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:49:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-64315db7-c93f-48aa-a801-1f71687dcb1d tempest-VolumesListAdminTestJSON-1288701082 None] Flow 'volume_create_manager' (43256eeb-bbf4-4d1e-a523-f99370bfa5ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:49:44 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-64315db7-c93f-48aa-a801-1f71687dcb1d tempest-VolumesListAdminTestJSON-1288701082 None] Created volume successfully. Sep 28 11:49:46 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-71142b70-5e33-4eb4-99af-c6bfbe4b961a tempest-VolumesListAdminTestJSON-172961107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:49:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-71142b70-5e33-4eb4-99af-c6bfbe4b961a tempest-VolumesListAdminTestJSON-172961107 None] Flow 'volume_create_manager' (df480b01-098a-4170-9562-00c29d167530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:49:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-71142b70-5e33-4eb4-99af-c6bfbe4b961a tempest-VolumesListAdminTestJSON-172961107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8bf40a3-31e7-4352-b6d0-6727ebec8fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:49:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-71142b70-5e33-4eb4-99af-c6bfbe4b961a tempest-VolumesListAdminTestJSON-172961107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8bf40a3-31e7-4352-b6d0-6727ebec8fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ed04e71-3cb7-40f9-9f20-caa4cc23c6be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7844831e0ba482fb3f8408016cefbfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:49:46Z,use_quota=True,user_id='91fbf273496f45eebb1b15fc8d63cb01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:49:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-71142b70-5e33-4eb4-99af-c6bfbe4b961a tempest-VolumesListAdminTestJSON-172961107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95d66b58-9db1-4570-a1e3-e4ab4479ebd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:49:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-71142b70-5e33-4eb4-99af-c6bfbe4b961a tempest-VolumesListAdminTestJSON-172961107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95d66b58-9db1-4570-a1e3-e4ab4479ebd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:49:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-71142b70-5e33-4eb4-99af-c6bfbe4b961a tempest-VolumesListAdminTestJSON-172961107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebd27e2f-419d-44dc-b53b-04966a45acb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:49:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-71142b70-5e33-4eb4-99af-c6bfbe4b961a tempest-VolumesListAdminTestJSON-172961107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebd27e2f-419d-44dc-b53b-04966a45acb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ed04e71-3cb7-40f9-9f20-caa4cc23c6be', 'volume_name': 'volume-7ed04e71-3cb7-40f9-9f20-caa4cc23c6be', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:49:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-71142b70-5e33-4eb4-99af-c6bfbe4b961a tempest-VolumesListAdminTestJSON-172961107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc9948a9-9009-432e-a580-fd8792717d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:49:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-71142b70-5e33-4eb4-99af-c6bfbe4b961a tempest-VolumesListAdminTestJSON-172961107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc9948a9-9009-432e-a580-fd8792717d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:49:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-71142b70-5e33-4eb4-99af-c6bfbe4b961a tempest-VolumesListAdminTestJSON-172961107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad03b353-4cfc-4de7-b8da-a80d1fd17ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:49:46 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-71142b70-5e33-4eb4-99af-c6bfbe4b961a tempest-VolumesListAdminTestJSON-172961107 None] Volume 7ed04e71-3cb7-40f9-9f20-caa4cc23c6be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ed04e71-3cb7-40f9-9f20-caa4cc23c6be', 'volume_size': 1} Sep 28 11:49:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-71142b70-5e33-4eb4-99af-c6bfbe4b961a tempest-VolumesListAdminTestJSON-172961107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:49:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-71142b70-5e33-4eb4-99af-c6bfbe4b961a tempest-VolumesListAdminTestJSON-172961107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:49:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-71142b70-5e33-4eb4-99af-c6bfbe4b961a tempest-VolumesListAdminTestJSON-172961107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ed04e71-3cb7-40f9-9f20-caa4cc23c6be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7844831e0ba482fb3f8408016cefbfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:49:46Z,use_quota=True,user_id='91fbf273496f45eebb1b15fc8d63cb01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:49:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-71142b70-5e33-4eb4-99af-c6bfbe4b961a tempest-VolumesListAdminTestJSON-172961107 None] Creating volume 7ed04e71-3cb7-40f9-9f20-caa4cc23c6be {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:49:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-71142b70-5e33-4eb4-99af-c6bfbe4b961a tempest-VolumesListAdminTestJSON-172961107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:49:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-71142b70-5e33-4eb4-99af-c6bfbe4b961a tempest-VolumesListAdminTestJSON-172961107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:49:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-71142b70-5e33-4eb4-99af-c6bfbe4b961a tempest-VolumesListAdminTestJSON-172961107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:49:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-71142b70-5e33-4eb4-99af-c6bfbe4b961a tempest-VolumesListAdminTestJSON-172961107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:49:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-71142b70-5e33-4eb4-99af-c6bfbe4b961a tempest-VolumesListAdminTestJSON-172961107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:49:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-71142b70-5e33-4eb4-99af-c6bfbe4b961a tempest-VolumesListAdminTestJSON-172961107 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:49:46 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-71142b70-5e33-4eb4-99af-c6bfbe4b961a tempest-VolumesListAdminTestJSON-172961107 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:49:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-71142b70-5e33-4eb4-99af-c6bfbe4b961a tempest-VolumesListAdminTestJSON-172961107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-7ed04e71-3cb7-40f9-9f20-caa4cc23c6be 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:46 devstack sudo[92759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-7ed04e71-3cb7-40f9-9f20-caa4cc23c6be 1073741824 Sep 28 11:49:46 devstack sudo[92759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:47 devstack sudo[92759]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-71142b70-5e33-4eb4-99af-c6bfbe4b961a tempest-VolumesListAdminTestJSON-172961107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-7ed04e71-3cb7-40f9-9f20-caa4cc23c6be 1073741824" returned: 0 in 0.769s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:47 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=122,cinder:INSERT=37,cinder:UPDATE=122,cinder:DELETE=9 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 11:49:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-71142b70-5e33-4eb4-99af-c6bfbe4b961a tempest-VolumesListAdminTestJSON-172961107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-7ed04e71-3cb7-40f9-9f20-caa4cc23c6be {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:47 devstack sudo[92781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-7ed04e71-3cb7-40f9-9f20-caa4cc23c6be Sep 28 11:49:47 devstack sudo[92781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:47 devstack sudo[92781]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-71142b70-5e33-4eb4-99af-c6bfbe4b961a tempest-VolumesListAdminTestJSON-172961107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-7ed04e71-3cb7-40f9-9f20-caa4cc23c6be" returned: 0 in 0.436s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-71142b70-5e33-4eb4-99af-c6bfbe4b961a tempest-VolumesListAdminTestJSON-172961107 None] <== create_volume: return (1323ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:49:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-71142b70-5e33-4eb4-99af-c6bfbe4b961a tempest-VolumesListAdminTestJSON-172961107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.326s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:49:47 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:UPDATE=153,cinder:SELECT=99,cinder:DELETE=15,cinder:INSERT=28 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 11:49:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-71142b70-5e33-4eb4-99af-c6bfbe4b961a tempest-VolumesListAdminTestJSON-172961107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad03b353-4cfc-4de7-b8da-a80d1fd17ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ed04e71-3cb7-40f9-9f20-caa4cc23c6be', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:49:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-71142b70-5e33-4eb4-99af-c6bfbe4b961a tempest-VolumesListAdminTestJSON-172961107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d924ed6c-dd78-4b0e-bf99-3aa9728f526f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:49:47 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-71142b70-5e33-4eb4-99af-c6bfbe4b961a tempest-VolumesListAdminTestJSON-172961107 None] Volume volume-7ed04e71-3cb7-40f9-9f20-caa4cc23c6be (7ed04e71-3cb7-40f9-9f20-caa4cc23c6be): created successfully Sep 28 11:49:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-71142b70-5e33-4eb4-99af-c6bfbe4b961a tempest-VolumesListAdminTestJSON-172961107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d924ed6c-dd78-4b0e-bf99-3aa9728f526f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:49:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-71142b70-5e33-4eb4-99af-c6bfbe4b961a tempest-VolumesListAdminTestJSON-172961107 None] Flow 'volume_create_manager' (df480b01-098a-4170-9562-00c29d167530) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:49:47 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-71142b70-5e33-4eb4-99af-c6bfbe4b961a tempest-VolumesListAdminTestJSON-172961107 None] Created volume successfully. Sep 28 11:49:48 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7dedadc6-53f7-424c-afd8-7d5edad866d8 tempest-VolumesListAdminTestJSON-172961107 None] Acquiring lock "cinder-7ed04e71-3cb7-40f9-9f20-caa4cc23c6be-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:49:48 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7dedadc6-53f7-424c-afd8-7d5edad866d8 tempest-VolumesListAdminTestJSON-172961107 None] Lock "cinder-7ed04e71-3cb7-40f9-9f20-caa4cc23c6be-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:49:48 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7dedadc6-53f7-424c-afd8-7d5edad866d8 tempest-VolumesListAdminTestJSON-172961107 None] Acquiring lock "cinder-quobyte-7ed04e71-3cb7-40f9-9f20-caa4cc23c6be" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:49:48 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7dedadc6-53f7-424c-afd8-7d5edad866d8 tempest-VolumesListAdminTestJSON-172961107 None] Lock "cinder-quobyte-7ed04e71-3cb7-40f9-9f20-caa4cc23c6be" acquired by "delete_volume" :: waited 0.014s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:49:48 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c5e3bf-f0b4-41b4-acfc-805e79d53372]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:49:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7dedadc6-53f7-424c-afd8-7d5edad866d8 tempest-VolumesListAdminTestJSON-172961107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-7ed04e71-3cb7-40f9-9f20-caa4cc23c6be {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:48 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e8c1d4be-571d-487a-aa74-d4d71a2e67d9 tempest-VolumesListAdminTestJSON-1288701082 None] Acquiring lock "cinder-cb777238-b1ba-45c9-8a5a-3f3c7ea0f50a-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:49:48 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e8c1d4be-571d-487a-aa74-d4d71a2e67d9 tempest-VolumesListAdminTestJSON-1288701082 None] Lock "cinder-cb777238-b1ba-45c9-8a5a-3f3c7ea0f50a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:49:48 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e8c1d4be-571d-487a-aa74-d4d71a2e67d9 tempest-VolumesListAdminTestJSON-1288701082 None] Acquiring lock "cinder-quobyte-cb777238-b1ba-45c9-8a5a-3f3c7ea0f50a" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:49:48 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e8c1d4be-571d-487a-aa74-d4d71a2e67d9 tempest-VolumesListAdminTestJSON-1288701082 None] Lock "cinder-quobyte-cb777238-b1ba-45c9-8a5a-3f3c7ea0f50a" acquired by "delete_volume" :: waited 0.032s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:49:48 devstack sudo[92784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-7ed04e71-3cb7-40f9-9f20-caa4cc23c6be Sep 28 11:49:48 devstack sudo[92784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:48 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92dfd5d-0d74-4df1-b9db-5a768a803c41]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:49:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e8c1d4be-571d-487a-aa74-d4d71a2e67d9 tempest-VolumesListAdminTestJSON-1288701082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cb777238-b1ba-45c9-8a5a-3f3c7ea0f50a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:48 devstack sudo[92787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cb777238-b1ba-45c9-8a5a-3f3c7ea0f50a Sep 28 11:49:48 devstack sudo[92787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:49 devstack sudo[92784]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7dedadc6-53f7-424c-afd8-7d5edad866d8 tempest-VolumesListAdminTestJSON-172961107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-7ed04e71-3cb7-40f9-9f20-caa4cc23c6be" returned: 0 in 0.578s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7dedadc6-53f7-424c-afd8-7d5edad866d8 tempest-VolumesListAdminTestJSON-172961107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-7ed04e71-3cb7-40f9-9f20-caa4cc23c6be {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:49 devstack sudo[92792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-7ed04e71-3cb7-40f9-9f20-caa4cc23c6be Sep 28 11:49:49 devstack sudo[92792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:49 devstack sudo[92787]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e8c1d4be-571d-487a-aa74-d4d71a2e67d9 tempest-VolumesListAdminTestJSON-1288701082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cb777238-b1ba-45c9-8a5a-3f3c7ea0f50a" returned: 0 in 0.653s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e8c1d4be-571d-487a-aa74-d4d71a2e67d9 tempest-VolumesListAdminTestJSON-1288701082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cb777238-b1ba-45c9-8a5a-3f3c7ea0f50a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:49 devstack sudo[92798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cb777238-b1ba-45c9-8a5a-3f3c7ea0f50a Sep 28 11:49:49 devstack sudo[92798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:49 devstack sudo[92792]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7dedadc6-53f7-424c-afd8-7d5edad866d8 tempest-VolumesListAdminTestJSON-172961107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-7ed04e71-3cb7-40f9-9f20-caa4cc23c6be" returned: 0 in 0.447s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:49 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7dedadc6-53f7-424c-afd8-7d5edad866d8 tempest-VolumesListAdminTestJSON-172961107 None] Lock "cinder-quobyte-7ed04e71-3cb7-40f9-9f20-caa4cc23c6be" released by "delete_volume" :: held 1.108s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:49:49 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-7dedadc6-53f7-424c-afd8-7d5edad866d8 tempest-VolumesListAdminTestJSON-172961107 None] Created reservations ['14330e7d-e63c-4545-a06a-10e95ce00adb', '9310db46-0295-43cb-ad7e-e72db39a4f41', '62ce5ff6-8295-4cdc-a068-19de5d311014', 'bca0a947-da4a-4bb8-b525-0ffc59bb3e40'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:49:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7dedadc6-53f7-424c-afd8-7d5edad866d8 tempest-VolumesListAdminTestJSON-172961107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:49:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7dedadc6-53f7-424c-afd8-7d5edad866d8 tempest-VolumesListAdminTestJSON-172961107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:49:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7dedadc6-53f7-424c-afd8-7d5edad866d8 tempest-VolumesListAdminTestJSON-172961107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:49:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7dedadc6-53f7-424c-afd8-7d5edad866d8 tempest-VolumesListAdminTestJSON-172961107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:49:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7dedadc6-53f7-424c-afd8-7d5edad866d8 tempest-VolumesListAdminTestJSON-172961107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:49:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7dedadc6-53f7-424c-afd8-7d5edad866d8 tempest-VolumesListAdminTestJSON-172961107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:49 devstack sudo[92802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:49:49 devstack sudo[92802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:50 devstack sudo[92798]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e8c1d4be-571d-487a-aa74-d4d71a2e67d9 tempest-VolumesListAdminTestJSON-1288701082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cb777238-b1ba-45c9-8a5a-3f3c7ea0f50a" returned: 0 in 0.595s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e8c1d4be-571d-487a-aa74-d4d71a2e67d9 tempest-VolumesListAdminTestJSON-1288701082 None] Lock "cinder-quobyte-cb777238-b1ba-45c9-8a5a-3f3c7ea0f50a" released by "delete_volume" :: held 1.389s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:49:50 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-e8c1d4be-571d-487a-aa74-d4d71a2e67d9 tempest-VolumesListAdminTestJSON-1288701082 None] Created reservations ['5a93b2a9-294c-4ad0-a599-2844b9ca4ca0', 'c6f3e567-cc6e-43de-8ec1-4a3aea9864ff', '99cbd26f-f975-46b5-ab7e-002436d5f7b3', 'e3da3dbb-7689-4408-9fdb-e7f52f41b081'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:49:50 devstack sudo[92802]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7dedadc6-53f7-424c-afd8-7d5edad866d8 tempest-VolumesListAdminTestJSON-172961107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.597s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:50 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-7dedadc6-53f7-424c-afd8-7d5edad866d8 tempest-VolumesListAdminTestJSON-172961107 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:49:50 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-7dedadc6-53f7-424c-afd8-7d5edad866d8 tempest-VolumesListAdminTestJSON-172961107 None] Deleted volume successfully. Sep 28 11:49:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7dedadc6-53f7-424c-afd8-7d5edad866d8 tempest-VolumesListAdminTestJSON-172961107 None] Lock "cinder-7ed04e71-3cb7-40f9-9f20-caa4cc23c6be-delete_volume" released by "delete_volume" :: held 2.096s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:49:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e8c1d4be-571d-487a-aa74-d4d71a2e67d9 tempest-VolumesListAdminTestJSON-1288701082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:49:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e8c1d4be-571d-487a-aa74-d4d71a2e67d9 tempest-VolumesListAdminTestJSON-1288701082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:49:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e8c1d4be-571d-487a-aa74-d4d71a2e67d9 tempest-VolumesListAdminTestJSON-1288701082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:49:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e8c1d4be-571d-487a-aa74-d4d71a2e67d9 tempest-VolumesListAdminTestJSON-1288701082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:49:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e8c1d4be-571d-487a-aa74-d4d71a2e67d9 tempest-VolumesListAdminTestJSON-1288701082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:49:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e8c1d4be-571d-487a-aa74-d4d71a2e67d9 tempest-VolumesListAdminTestJSON-1288701082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:50 devstack sudo[92841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:49:50 devstack sudo[92841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:51 devstack sudo[92841]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e8c1d4be-571d-487a-aa74-d4d71a2e67d9 tempest-VolumesListAdminTestJSON-1288701082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.553s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:51 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-e8c1d4be-571d-487a-aa74-d4d71a2e67d9 tempest-VolumesListAdminTestJSON-1288701082 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:49:51 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e8c1d4be-571d-487a-aa74-d4d71a2e67d9 tempest-VolumesListAdminTestJSON-1288701082 None] Deleted volume successfully. Sep 28 11:49:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e8c1d4be-571d-487a-aa74-d4d71a2e67d9 tempest-VolumesListAdminTestJSON-1288701082 None] Lock "cinder-cb777238-b1ba-45c9-8a5a-3f3c7ea0f50a-delete_volume" released by "delete_volume" :: held 2.576s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:49:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-19e1c7af-3fbb-4a2e-a4a5-e7f1912e9d7c tempest-VolumesListAdminTestJSON-1288701082 None] Acquiring lock "cinder-615b61e7-d897-4d78-ac1d-042f72b37d60-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:49:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-19e1c7af-3fbb-4a2e-a4a5-e7f1912e9d7c tempest-VolumesListAdminTestJSON-1288701082 None] Lock "cinder-615b61e7-d897-4d78-ac1d-042f72b37d60-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:49:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-19e1c7af-3fbb-4a2e-a4a5-e7f1912e9d7c tempest-VolumesListAdminTestJSON-1288701082 None] Acquiring lock "cinder-quobyte-615b61e7-d897-4d78-ac1d-042f72b37d60" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:49:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-19e1c7af-3fbb-4a2e-a4a5-e7f1912e9d7c tempest-VolumesListAdminTestJSON-1288701082 None] Lock "cinder-quobyte-615b61e7-d897-4d78-ac1d-042f72b37d60" acquired by "delete_volume" :: waited 0.037s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:49:51 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db5ce05-1fde-4f5b-a0c3-320b8a1cc84d]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:49:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-19e1c7af-3fbb-4a2e-a4a5-e7f1912e9d7c tempest-VolumesListAdminTestJSON-1288701082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-615b61e7-d897-4d78-ac1d-042f72b37d60 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:51 devstack sudo[92875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-615b61e7-d897-4d78-ac1d-042f72b37d60 Sep 28 11:49:51 devstack sudo[92875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:51 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:49:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] Flow 'volume_create_manager' (7a0282e3-5875-4575-a59a-b791edf87e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:49:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (389ef2a9-6e76-4835-b992-1d2655627d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:49:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (389ef2a9-6e76-4835-b992-1d2655627d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:49:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1217126777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd9e0651-e181-4ea4-b214-7bb0653b528e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6afb6bcec8dd4146b096076ce0ce3be7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:49:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:49:52Z,use_quota=True,user_id='d9cd5fa29b604dc4b8ed6b89cca77281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:49:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (646e6f9c-029b-40d5-9143-20afc3646a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:49:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (646e6f9c-029b-40d5-9143-20afc3646a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:49:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9789714-de4b-468d-aef4-92cc662d4f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:49:51 devstack cinder-volume[86916]: DEBUG cinder.image.glance [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] Creating Keystone auth plugin from conf {{(pid=86916) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 11:49:52 devstack sudo[92875]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-19e1c7af-3fbb-4a2e-a4a5-e7f1912e9d7c tempest-VolumesListAdminTestJSON-1288701082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-615b61e7-d897-4d78-ac1d-042f72b37d60" returned: 0 in 0.667s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-19e1c7af-3fbb-4a2e-a4a5-e7f1912e9d7c tempest-VolumesListAdminTestJSON-1288701082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-615b61e7-d897-4d78-ac1d-042f72b37d60 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:52 devstack sudo[92894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-615b61e7-d897-4d78-ac1d-042f72b37d60 Sep 28 11:49:52 devstack sudo[92894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9789714-de4b-468d-aef4-92cc662d4f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cd9e0651-e181-4ea4-b214-7bb0653b528e', 'volume_name': 'volume-cd9e0651-e181-4ea4-b214-7bb0653b528e', 'volume_size': 1, 'image_id': '5400a738-7bf7-408f-b314-8b5954ac2b81', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5400a738-7bf7-408f-b314-8b5954ac2b81', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0c8ef073bf9e4608b40db55c7aa6c23c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5400a738-7bf7-408f-b314-8b5954ac2b81', 'created_at': datetime.datetime(2026, 9, 28, 9, 39, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 9, 39, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5400a738-7bf7-408f-b314-8b5954ac2b81/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:49:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebbb0b47-1ac8-4a70-a414-3d878ce4551f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:49:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebbb0b47-1ac8-4a70-a414-3d878ce4551f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:49:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e4988fa-9832-4f52-8d92-8d8e45f5562a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:49:52 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] Volume cd9e0651-e181-4ea4-b214-7bb0653b528e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cd9e0651-e181-4ea4-b214-7bb0653b528e', 'volume_size': 1, 'image_id': '5400a738-7bf7-408f-b314-8b5954ac2b81', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5400a738-7bf7-408f-b314-8b5954ac2b81', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0c8ef073bf9e4608b40db55c7aa6c23c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5400a738-7bf7-408f-b314-8b5954ac2b81', 'created_at': datetime.datetime(2026, 9, 28, 9, 39, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 9, 39, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5400a738-7bf7-408f-b314-8b5954ac2b81/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 11:49:52 devstack sudo[92894]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:52 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] Trying to clone cd9e0651-e181-4ea4-b214-7bb0653b528e from image 5400a738-7bf7-408f-b314-8b5954ac2b81 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5400a738-7bf7-408f-b314-8b5954ac2b81', 'metadata': {}}]). {{(pid=86916) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 11:49:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-19e1c7af-3fbb-4a2e-a4a5-e7f1912e9d7c tempest-VolumesListAdminTestJSON-1288701082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-615b61e7-d897-4d78-ac1d-042f72b37d60" returned: 0 in 0.409s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:52 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-19e1c7af-3fbb-4a2e-a4a5-e7f1912e9d7c tempest-VolumesListAdminTestJSON-1288701082 None] Lock "cinder-quobyte-615b61e7-d897-4d78-ac1d-042f72b37d60" released by "delete_volume" :: held 1.162s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:49:52 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-19e1c7af-3fbb-4a2e-a4a5-e7f1912e9d7c tempest-VolumesListAdminTestJSON-1288701082 None] Created reservations ['3063a9d1-417c-4d99-a11a-0455aada5d5b', 'fb693b83-a4f0-4168-a0aa-cb1ad9ab8350', '0a1a604b-b518-40d5-9677-988c8cc398a6', '3834483c-1b25-487f-85b1-83635c281b57'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:49:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-19e1c7af-3fbb-4a2e-a4a5-e7f1912e9d7c tempest-VolumesListAdminTestJSON-1288701082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:49:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-19e1c7af-3fbb-4a2e-a4a5-e7f1912e9d7c tempest-VolumesListAdminTestJSON-1288701082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:49:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-19e1c7af-3fbb-4a2e-a4a5-e7f1912e9d7c tempest-VolumesListAdminTestJSON-1288701082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:49:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-19e1c7af-3fbb-4a2e-a4a5-e7f1912e9d7c tempest-VolumesListAdminTestJSON-1288701082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:49:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-19e1c7af-3fbb-4a2e-a4a5-e7f1912e9d7c tempest-VolumesListAdminTestJSON-1288701082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:49:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-19e1c7af-3fbb-4a2e-a4a5-e7f1912e9d7c tempest-VolumesListAdminTestJSON-1288701082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:53 devstack sudo[92920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:49:53 devstack sudo[92920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:53 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_3de1g60ldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 11:49:53 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] Image download 20.69 MB at 20.69 MB/s Sep 28 11:49:53 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[733ee39d-fe90-486a-a89b-b3747bf946aa]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:49:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_3de1g60ldevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:53 devstack sudo[92924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_3de1g60ldevstack@QuobyteHD Sep 28 11:49:53 devstack sudo[92924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:53 devstack sudo[92920]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-19e1c7af-3fbb-4a2e-a4a5-e7f1912e9d7c tempest-VolumesListAdminTestJSON-1288701082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.518s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:53 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-19e1c7af-3fbb-4a2e-a4a5-e7f1912e9d7c tempest-VolumesListAdminTestJSON-1288701082 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:49:53 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-19e1c7af-3fbb-4a2e-a4a5-e7f1912e9d7c tempest-VolumesListAdminTestJSON-1288701082 None] Deleted volume successfully. Sep 28 11:49:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-19e1c7af-3fbb-4a2e-a4a5-e7f1912e9d7c tempest-VolumesListAdminTestJSON-1288701082 None] Lock "cinder-615b61e7-d897-4d78-ac1d-042f72b37d60-delete_volume" released by "delete_volume" :: held 2.316s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:49:53 devstack sudo[92924]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-efa08b07-7e15-458d-85db-bae3cb03decc tempest-VolumesListAdminTestJSON-1288701082 None] Acquiring lock "cinder-9bac3419-6b94-47f9-994d-0bd471282173-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:49:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_3de1g60ldevstack@QuobyteHD" returned: 0 in 0.584s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:53 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] Temporary image 5400a738-7bf7-408f-b314-8b5954ac2b81 is fetched for user d9cd5fa29b604dc4b8ed6b89cca77281. {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 11:49:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-efa08b07-7e15-458d-85db-bae3cb03decc tempest-VolumesListAdminTestJSON-1288701082 None] Lock "cinder-9bac3419-6b94-47f9-994d-0bd471282173-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:49:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-efa08b07-7e15-458d-85db-bae3cb03decc tempest-VolumesListAdminTestJSON-1288701082 None] Acquiring lock "cinder-quobyte-9bac3419-6b94-47f9-994d-0bd471282173" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:49:54 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67dbfd2-136c-43aa-bf12-c911de8846af]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:49:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_3de1g60ldevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-efa08b07-7e15-458d-85db-bae3cb03decc tempest-VolumesListAdminTestJSON-1288701082 None] Lock "cinder-quobyte-9bac3419-6b94-47f9-994d-0bd471282173" acquired by "delete_volume" :: waited 0.060s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:49:54 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c10f0b-a3eb-460f-b8dd-60d15ec7289b]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:49:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-efa08b07-7e15-458d-85db-bae3cb03decc tempest-VolumesListAdminTestJSON-1288701082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9bac3419-6b94-47f9-994d-0bd471282173 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:54 devstack sudo[92931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_3de1g60ldevstack@QuobyteHD Sep 28 11:49:54 devstack sudo[92931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:54 devstack sudo[92932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9bac3419-6b94-47f9-994d-0bd471282173 Sep 28 11:49:54 devstack sudo[92932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:54 devstack sudo[92931]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_3de1g60ldevstack@QuobyteHD" returned: 0 in 0.432s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:49:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:49:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:49:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1217126777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd9e0651-e181-4ea4-b214-7bb0653b528e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6afb6bcec8dd4146b096076ce0ce3be7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:49:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:49:52Z,use_quota=True,user_id='d9cd5fa29b604dc4b8ed6b89cca77281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:49:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] Creating volume cd9e0651-e181-4ea4-b214-7bb0653b528e {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:49:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:49:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:49:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:49:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:49:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:49:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:49:54 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:49:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cd9e0651-e181-4ea4-b214-7bb0653b528e 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:54 devstack sudo[92939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cd9e0651-e181-4ea4-b214-7bb0653b528e 1073741824 Sep 28 11:49:54 devstack sudo[92939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:54 devstack sudo[92932]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-efa08b07-7e15-458d-85db-bae3cb03decc tempest-VolumesListAdminTestJSON-1288701082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9bac3419-6b94-47f9-994d-0bd471282173" returned: 0 in 0.669s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-efa08b07-7e15-458d-85db-bae3cb03decc tempest-VolumesListAdminTestJSON-1288701082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9bac3419-6b94-47f9-994d-0bd471282173 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:54 devstack sudo[92945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9bac3419-6b94-47f9-994d-0bd471282173 Sep 28 11:49:54 devstack sudo[92945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:55 devstack sudo[92939]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:55 devstack sudo[92945]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-efa08b07-7e15-458d-85db-bae3cb03decc tempest-VolumesListAdminTestJSON-1288701082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9bac3419-6b94-47f9-994d-0bd471282173" returned: 0 in 0.530s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cd9e0651-e181-4ea4-b214-7bb0653b528e 1073741824" returned: 0 in 0.847s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-efa08b07-7e15-458d-85db-bae3cb03decc tempest-VolumesListAdminTestJSON-1288701082 None] Lock "cinder-quobyte-9bac3419-6b94-47f9-994d-0bd471282173" released by "delete_volume" :: held 1.281s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:49:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cd9e0651-e181-4ea4-b214-7bb0653b528e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:55 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-efa08b07-7e15-458d-85db-bae3cb03decc tempest-VolumesListAdminTestJSON-1288701082 None] Created reservations ['73628e0c-7c3b-43a6-8d62-24eb689e6d30', '19ad96f3-4cb9-4576-b14e-db6dff41e3d6', 'c44a9a37-c5c5-404f-b490-e0c70f355223', '1e081ae7-067b-4955-9757-c34c391833b4'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:49:55 devstack sudo[92952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cd9e0651-e181-4ea4-b214-7bb0653b528e Sep 28 11:49:55 devstack sudo[92952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-efa08b07-7e15-458d-85db-bae3cb03decc tempest-VolumesListAdminTestJSON-1288701082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:49:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-efa08b07-7e15-458d-85db-bae3cb03decc tempest-VolumesListAdminTestJSON-1288701082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:49:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-efa08b07-7e15-458d-85db-bae3cb03decc tempest-VolumesListAdminTestJSON-1288701082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:49:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-efa08b07-7e15-458d-85db-bae3cb03decc tempest-VolumesListAdminTestJSON-1288701082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:49:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-efa08b07-7e15-458d-85db-bae3cb03decc tempest-VolumesListAdminTestJSON-1288701082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:49:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-efa08b07-7e15-458d-85db-bae3cb03decc tempest-VolumesListAdminTestJSON-1288701082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:55 devstack sudo[92954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:49:55 devstack sudo[92954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:55 devstack sudo[92952]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cd9e0651-e181-4ea4-b214-7bb0653b528e" returned: 0 in 0.384s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] <== create_volume: return (1343ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:49:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.346s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:49:56 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] Attempting download of 5400a738-7bf7-408f-b314-8b5954ac2b81 ((None, [{'url': 'file:///opt/stack/data/glance/images/5400a738-7bf7-408f-b314-8b5954ac2b81', 'metadata': {}}])) to volume cd9e0651-e181-4ea4-b214-7bb0653b528e. {{(pid=86916) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 11:49:56 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[75eb807b-0591-47e0-b19d-6386ba1cda6f]: (4, 'raw') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:49:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5400a738-7bf7-408f-b314-8b5954ac2b81_5i0jw3ln {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:56 devstack sudo[92954]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-efa08b07-7e15-458d-85db-bae3cb03decc tempest-VolumesListAdminTestJSON-1288701082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.613s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:56 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-efa08b07-7e15-458d-85db-bae3cb03decc tempest-VolumesListAdminTestJSON-1288701082 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:49:56 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-efa08b07-7e15-458d-85db-bae3cb03decc tempest-VolumesListAdminTestJSON-1288701082 None] Deleted volume successfully. Sep 28 11:49:56 devstack sudo[92960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5400a738-7bf7-408f-b314-8b5954ac2b81_5i0jw3ln Sep 28 11:49:56 devstack sudo[92960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-efa08b07-7e15-458d-85db-bae3cb03decc tempest-VolumesListAdminTestJSON-1288701082 None] Lock "cinder-9bac3419-6b94-47f9-994d-0bd471282173-delete_volume" released by "delete_volume" :: held 2.445s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:49:56 devstack sudo[92960]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5400a738-7bf7-408f-b314-8b5954ac2b81_5i0jw3ln" returned: 0 in 0.617s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5400a738-7bf7-408f-b314-8b5954ac2b81_5i0jw3ln {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:57 devstack sudo[92966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5400a738-7bf7-408f-b314-8b5954ac2b81_5i0jw3ln Sep 28 11:49:57 devstack sudo[92966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:57 devstack sudo[92966]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5400a738-7bf7-408f-b314-8b5954ac2b81_5i0jw3ln" returned: 1 in 0.616s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5400a738-7bf7-408f-b314-8b5954ac2b81_5i0jw3ln' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 11:49:57 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb016356-afc7-4a40-bdd6-073015e639b0]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:49:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_3de1g60ldevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:57 devstack sudo[92970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_3de1g60ldevstack@QuobyteHD Sep 28 11:49:57 devstack sudo[92970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:49:57 devstack sudo[92970]: pam_unix(sudo:session): session closed for user root Sep 28 11:49:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_3de1g60ldevstack@QuobyteHD" returned: 0 in 0.501s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:49:57 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] 5400a738-7bf7-408f-b314-8b5954ac2b81 was qcow2, converting to qcow2 {{(pid=86916) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 11:49:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_3de1g60ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cd9e0651-e181-4ea4-b214-7bb0653b528e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:49:57 devstack sudo[92976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_3de1g60ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cd9e0651-e181-4ea4-b214-7bb0653b528e Sep 28 11:49:57 devstack sudo[92976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:50:00 devstack sudo[92976]: pam_unix(sudo:session): session closed for user root Sep 28 11:50:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_3de1g60ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cd9e0651-e181-4ea4-b214-7bb0653b528e" returned: 0 in 2.857s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:50:00 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_3de1g60ldevstack@QuobyteHD, size 112.00 MB, duration 2.86 sec, destination /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cd9e0651-e181-4ea4-b214-7bb0653b528e {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 11:50:00 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] Converted 112.00 MB image at 39.17 MB/s Sep 28 11:50:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cd9e0651-e181-4ea4-b214-7bb0653b528e 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:50:00 devstack sudo[92985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cd9e0651-e181-4ea4-b214-7bb0653b528e 1G Sep 28 11:50:00 devstack sudo[92985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:50:01 devstack sudo[92985]: pam_unix(sudo:session): session closed for user root Sep 28 11:50:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cd9e0651-e181-4ea4-b214-7bb0653b528e 1G" returned: 0 in 0.651s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:50:01 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] Downloaded image 5400a738-7bf7-408f-b314-8b5954ac2b81 ((None, [{'url': 'file:///opt/stack/data/glance/images/5400a738-7bf7-408f-b314-8b5954ac2b81', 'metadata': {}}])) to volume cd9e0651-e181-4ea4-b214-7bb0653b528e successfully. {{(pid=86916) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 11:50:01 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] Temporary image 5400a738-7bf7-408f-b314-8b5954ac2b81 for user d9cd5fa29b604dc4b8ed6b89cca77281 is deleted. {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 11:50:01 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] Marking volume cd9e0651-e181-4ea4-b214-7bb0653b528e as bootable. {{(pid=86916) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 11:50:01 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] Copying metadata from image 5400a738-7bf7-408f-b314-8b5954ac2b81 to cd9e0651-e181-4ea4-b214-7bb0653b528e. {{(pid=86916) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 11:50:01 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] Creating volume glance metadata for volume cd9e0651-e181-4ea4-b214-7bb0653b528e backed by image 5400a738-7bf7-408f-b314-8b5954ac2b81 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5400a738-7bf7-408f-b314-8b5954ac2b81', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86916) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 11:50:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e4988fa-9832-4f52-8d92-8d8e45f5562a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd9e0651-e181-4ea4-b214-7bb0653b528e', 'volume_size': 1, 'image_id': '5400a738-7bf7-408f-b314-8b5954ac2b81', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5400a738-7bf7-408f-b314-8b5954ac2b81', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0c8ef073bf9e4608b40db55c7aa6c23c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5400a738-7bf7-408f-b314-8b5954ac2b81', 'created_at': datetime.datetime(2026, 9, 28, 9, 39, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 9, 39, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5400a738-7bf7-408f-b314-8b5954ac2b81/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:50:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf6b3a56-abc8-41f4-a3f5-299a08205347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:50:01 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] Volume volume-cd9e0651-e181-4ea4-b214-7bb0653b528e (cd9e0651-e181-4ea4-b214-7bb0653b528e): created successfully Sep 28 11:50:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf6b3a56-abc8-41f4-a3f5-299a08205347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:50:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] Flow 'volume_create_manager' (7a0282e3-5875-4575-a59a-b791edf87e0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:50:01 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-26033c27-7aa9-4efb-92e4-e65dcc6c323b tempest-ServerActionsTestOtherA-485250721 None] Created volume successfully. Sep 28 11:50:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-e987c185-6eba-439a-b559-436f79d44958 req-1bffd591-508c-47a5-a38c-eef9f2b468f3 tempest-ServerActionsTestOtherA-485250721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:50:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-e987c185-6eba-439a-b559-436f79d44958 req-1bffd591-508c-47a5-a38c-eef9f2b468f3 tempest-ServerActionsTestOtherA-485250721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:50:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-e987c185-6eba-439a-b559-436f79d44958 req-1bffd591-508c-47a5-a38c-eef9f2b468f3 tempest-ServerActionsTestOtherA-485250721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:50:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-e987c185-6eba-439a-b559-436f79d44958 req-1bffd591-508c-47a5-a38c-eef9f2b468f3 tempest-ServerActionsTestOtherA-485250721 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0', 'name': 'volume-cd9e0651-e181-4ea4-b214-7bb0653b528e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '65f5f48d-62b1-44d9-ad93-a05ae03f363a', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 11:50:07 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-e987c185-6eba-439a-b559-436f79d44958 req-1bffd591-508c-47a5-a38c-eef9f2b468f3 tempest-ServerActionsTestOtherA-485250721 None] attachment_update completed successfully. Sep 28 11:50:11 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-59527546-2338-4c63-a206-11df13db5c52 tempest-SnapshotMetadataTestJSON-302612304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:50:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-59527546-2338-4c63-a206-11df13db5c52 tempest-SnapshotMetadataTestJSON-302612304 None] Flow 'volume_create_manager' (96d4b46b-cc5a-4dc4-b740-8821974ad088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:50:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-59527546-2338-4c63-a206-11df13db5c52 tempest-SnapshotMetadataTestJSON-302612304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b9ed4e1-7c92-4480-a468-12ff341e5fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:50:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-59527546-2338-4c63-a206-11df13db5c52 tempest-SnapshotMetadataTestJSON-302612304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b9ed4e1-7c92-4480-a468-12ff341e5fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:50:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1357896685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ef796c5-6ccb-46a2-864e-09da554b6237,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c369a3b0ba64273a1537cc002e934b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:50:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:50:12Z,use_quota=True,user_id='c7d7ca2c86b2468992a96d855b86940c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:50:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-59527546-2338-4c63-a206-11df13db5c52 tempest-SnapshotMetadataTestJSON-302612304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d34feab-2122-422b-90c7-b5a6e0242e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:50:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-59527546-2338-4c63-a206-11df13db5c52 tempest-SnapshotMetadataTestJSON-302612304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d34feab-2122-422b-90c7-b5a6e0242e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:50:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-59527546-2338-4c63-a206-11df13db5c52 tempest-SnapshotMetadataTestJSON-302612304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a2acb2c-e829-4143-bddd-b6c2340730f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:50:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-59527546-2338-4c63-a206-11df13db5c52 tempest-SnapshotMetadataTestJSON-302612304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a2acb2c-e829-4143-bddd-b6c2340730f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ef796c5-6ccb-46a2-864e-09da554b6237', 'volume_name': 'volume-9ef796c5-6ccb-46a2-864e-09da554b6237', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:50:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-59527546-2338-4c63-a206-11df13db5c52 tempest-SnapshotMetadataTestJSON-302612304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bf53e7e-c6b5-4ed2-9413-6ae1e9c036b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:50:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-59527546-2338-4c63-a206-11df13db5c52 tempest-SnapshotMetadataTestJSON-302612304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bf53e7e-c6b5-4ed2-9413-6ae1e9c036b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:50:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-59527546-2338-4c63-a206-11df13db5c52 tempest-SnapshotMetadataTestJSON-302612304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd548a5a-d7b3-45ba-996e-0fafc70b93b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:50:12 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-59527546-2338-4c63-a206-11df13db5c52 tempest-SnapshotMetadataTestJSON-302612304 None] Volume 9ef796c5-6ccb-46a2-864e-09da554b6237: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ef796c5-6ccb-46a2-864e-09da554b6237', 'volume_size': 1} Sep 28 11:50:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-59527546-2338-4c63-a206-11df13db5c52 tempest-SnapshotMetadataTestJSON-302612304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:50:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-59527546-2338-4c63-a206-11df13db5c52 tempest-SnapshotMetadataTestJSON-302612304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:50:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-59527546-2338-4c63-a206-11df13db5c52 tempest-SnapshotMetadataTestJSON-302612304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:50:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1357896685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ef796c5-6ccb-46a2-864e-09da554b6237,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c369a3b0ba64273a1537cc002e934b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:50:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:50:12Z,use_quota=True,user_id='c7d7ca2c86b2468992a96d855b86940c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:50:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-59527546-2338-4c63-a206-11df13db5c52 tempest-SnapshotMetadataTestJSON-302612304 None] Creating volume 9ef796c5-6ccb-46a2-864e-09da554b6237 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:50:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-59527546-2338-4c63-a206-11df13db5c52 tempest-SnapshotMetadataTestJSON-302612304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:50:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-59527546-2338-4c63-a206-11df13db5c52 tempest-SnapshotMetadataTestJSON-302612304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:50:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-59527546-2338-4c63-a206-11df13db5c52 tempest-SnapshotMetadataTestJSON-302612304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:50:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-59527546-2338-4c63-a206-11df13db5c52 tempest-SnapshotMetadataTestJSON-302612304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:50:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-59527546-2338-4c63-a206-11df13db5c52 tempest-SnapshotMetadataTestJSON-302612304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:50:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-59527546-2338-4c63-a206-11df13db5c52 tempest-SnapshotMetadataTestJSON-302612304 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:50:12 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-59527546-2338-4c63-a206-11df13db5c52 tempest-SnapshotMetadataTestJSON-302612304 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:50:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-59527546-2338-4c63-a206-11df13db5c52 tempest-SnapshotMetadataTestJSON-302612304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9ef796c5-6ccb-46a2-864e-09da554b6237 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:50:12 devstack sudo[93519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9ef796c5-6ccb-46a2-864e-09da554b6237 1073741824 Sep 28 11:50:12 devstack sudo[93519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:50:12 devstack sudo[93519]: pam_unix(sudo:session): session closed for user root Sep 28 11:50:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-59527546-2338-4c63-a206-11df13db5c52 tempest-SnapshotMetadataTestJSON-302612304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9ef796c5-6ccb-46a2-864e-09da554b6237 1073741824" returned: 0 in 0.721s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:50:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-59527546-2338-4c63-a206-11df13db5c52 tempest-SnapshotMetadataTestJSON-302612304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9ef796c5-6ccb-46a2-864e-09da554b6237 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:50:12 devstack sudo[93541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9ef796c5-6ccb-46a2-864e-09da554b6237 Sep 28 11:50:12 devstack sudo[93541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:50:13 devstack sudo[93541]: pam_unix(sudo:session): session closed for user root Sep 28 11:50:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-59527546-2338-4c63-a206-11df13db5c52 tempest-SnapshotMetadataTestJSON-302612304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9ef796c5-6ccb-46a2-864e-09da554b6237" returned: 0 in 0.383s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:50:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-59527546-2338-4c63-a206-11df13db5c52 tempest-SnapshotMetadataTestJSON-302612304 None] <== create_volume: return (1188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:50:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-59527546-2338-4c63-a206-11df13db5c52 tempest-SnapshotMetadataTestJSON-302612304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.191s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:50:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-59527546-2338-4c63-a206-11df13db5c52 tempest-SnapshotMetadataTestJSON-302612304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd548a5a-d7b3-45ba-996e-0fafc70b93b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ef796c5-6ccb-46a2-864e-09da554b6237', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:50:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-59527546-2338-4c63-a206-11df13db5c52 tempest-SnapshotMetadataTestJSON-302612304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e38237e-91a3-4f85-9677-b83367276a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:50:13 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-59527546-2338-4c63-a206-11df13db5c52 tempest-SnapshotMetadataTestJSON-302612304 None] Volume volume-9ef796c5-6ccb-46a2-864e-09da554b6237 (9ef796c5-6ccb-46a2-864e-09da554b6237): created successfully Sep 28 11:50:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-59527546-2338-4c63-a206-11df13db5c52 tempest-SnapshotMetadataTestJSON-302612304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e38237e-91a3-4f85-9677-b83367276a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:50:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-59527546-2338-4c63-a206-11df13db5c52 tempest-SnapshotMetadataTestJSON-302612304 None] Flow 'volume_create_manager' (96d4b46b-cc5a-4dc4-b740-8821974ad088) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:50:13 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-59527546-2338-4c63-a206-11df13db5c52 tempest-SnapshotMetadataTestJSON-302612304 None] Created volume successfully. Sep 28 11:50:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-99c7bc66-bfb6-4c6f-a777-5956f372a594 tempest-SnapshotMetadataTestJSON-302612304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:50:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-99c7bc66-bfb6-4c6f-a777-5956f372a594 tempest-SnapshotMetadataTestJSON-302612304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:50:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-99c7bc66-bfb6-4c6f-a777-5956f372a594 tempest-SnapshotMetadataTestJSON-302612304 None] Creating offline snapshot 5499f909-789c-4892-951c-5d826372edd8 of volume 9ef796c5-6ccb-46a2-864e-09da554b6237 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 11:50:14 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[651a68ce-cca1-46c9-b67d-a5af40a1fd50]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:50:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-99c7bc66-bfb6-4c6f-a777-5956f372a594 tempest-SnapshotMetadataTestJSON-302612304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9ef796c5-6ccb-46a2-864e-09da554b6237 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:50:14 devstack sudo[93561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9ef796c5-6ccb-46a2-864e-09da554b6237 Sep 28 11:50:14 devstack sudo[93561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:50:15 devstack sudo[93561]: pam_unix(sudo:session): session closed for user root Sep 28 11:50:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-99c7bc66-bfb6-4c6f-a777-5956f372a594 tempest-SnapshotMetadataTestJSON-302612304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9ef796c5-6ccb-46a2-864e-09da554b6237" returned: 0 in 0.765s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:50:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-99c7bc66-bfb6-4c6f-a777-5956f372a594 tempest-SnapshotMetadataTestJSON-302612304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9ef796c5-6ccb-46a2-864e-09da554b6237,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9ef796c5-6ccb-46a2-864e-09da554b6237.5499f909-789c-4892-951c-5d826372edd8 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:50:15 devstack sudo[93575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9ef796c5-6ccb-46a2-864e-09da554b6237,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9ef796c5-6ccb-46a2-864e-09da554b6237.5499f909-789c-4892-951c-5d826372edd8 1G Sep 28 11:50:15 devstack sudo[93575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:50:16 devstack sudo[93575]: pam_unix(sudo:session): session closed for user root Sep 28 11:50:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-99c7bc66-bfb6-4c6f-a777-5956f372a594 tempest-SnapshotMetadataTestJSON-302612304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9ef796c5-6ccb-46a2-864e-09da554b6237,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9ef796c5-6ccb-46a2-864e-09da554b6237.5499f909-789c-4892-951c-5d826372edd8 1G" returned: 0 in 0.939s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:50:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-99c7bc66-bfb6-4c6f-a777-5956f372a594 tempest-SnapshotMetadataTestJSON-302612304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ef796c5-6ccb-46a2-864e-09da554b6237 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9ef796c5-6ccb-46a2-864e-09da554b6237.5499f909-789c-4892-951c-5d826372edd8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:50:16 devstack sudo[93582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ef796c5-6ccb-46a2-864e-09da554b6237 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9ef796c5-6ccb-46a2-864e-09da554b6237.5499f909-789c-4892-951c-5d826372edd8 Sep 28 11:50:16 devstack sudo[93582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:50:17 devstack sudo[93582]: pam_unix(sudo:session): session closed for user root Sep 28 11:50:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-99c7bc66-bfb6-4c6f-a777-5956f372a594 tempest-SnapshotMetadataTestJSON-302612304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ef796c5-6ccb-46a2-864e-09da554b6237 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9ef796c5-6ccb-46a2-864e-09da554b6237.5499f909-789c-4892-951c-5d826372edd8" returned: 0 in 0.874s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:50:17 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-99c7bc66-bfb6-4c6f-a777-5956f372a594 tempest-SnapshotMetadataTestJSON-302612304 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9ef796c5-6ccb-46a2-864e-09da554b6237.5499f909-789c-4892-951c-5d826372edd8 is being set with open permissions: ugo+rw Sep 28 11:50:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-99c7bc66-bfb6-4c6f-a777-5956f372a594 tempest-SnapshotMetadataTestJSON-302612304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9ef796c5-6ccb-46a2-864e-09da554b6237.5499f909-789c-4892-951c-5d826372edd8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:50:17 devstack sudo[93588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9ef796c5-6ccb-46a2-864e-09da554b6237.5499f909-789c-4892-951c-5d826372edd8 Sep 28 11:50:17 devstack sudo[93588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:50:17 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a71cf7c-a6bc-42d9-952e-b10a8a6d8842 tempest-AttachVolumeNegativeTest-962283120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:50:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3a71cf7c-a6bc-42d9-952e-b10a8a6d8842 tempest-AttachVolumeNegativeTest-962283120 None] Flow 'volume_create_manager' (147c6827-8966-4598-a3e4-e8e02a96efc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:50:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3a71cf7c-a6bc-42d9-952e-b10a8a6d8842 tempest-AttachVolumeNegativeTest-962283120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e708578d-7288-45b5-870b-2a8d63162878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:50:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3a71cf7c-a6bc-42d9-952e-b10a8a6d8842 tempest-AttachVolumeNegativeTest-962283120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e708578d-7288-45b5-870b-2a8d63162878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-251740478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16b67192-a83e-4cd9-a29f-8106ce313696,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81ba3469bda8465fb145a233aec61f60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:50:17Z,use_quota=True,user_id='482c85c2bda54ca5a179eca038a733ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:50:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3a71cf7c-a6bc-42d9-952e-b10a8a6d8842 tempest-AttachVolumeNegativeTest-962283120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66e8c664-a368-4960-bc3b-7cb535a35128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:50:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3a71cf7c-a6bc-42d9-952e-b10a8a6d8842 tempest-AttachVolumeNegativeTest-962283120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66e8c664-a368-4960-bc3b-7cb535a35128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:50:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3a71cf7c-a6bc-42d9-952e-b10a8a6d8842 tempest-AttachVolumeNegativeTest-962283120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83a84b13-433f-40b7-a56c-b0217e32471c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:50:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3a71cf7c-a6bc-42d9-952e-b10a8a6d8842 tempest-AttachVolumeNegativeTest-962283120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83a84b13-433f-40b7-a56c-b0217e32471c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16b67192-a83e-4cd9-a29f-8106ce313696', 'volume_name': 'volume-16b67192-a83e-4cd9-a29f-8106ce313696', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:50:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3a71cf7c-a6bc-42d9-952e-b10a8a6d8842 tempest-AttachVolumeNegativeTest-962283120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83dc1fea-92e3-4907-8822-f3e9bc747009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:50:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3a71cf7c-a6bc-42d9-952e-b10a8a6d8842 tempest-AttachVolumeNegativeTest-962283120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83dc1fea-92e3-4907-8822-f3e9bc747009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:50:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3a71cf7c-a6bc-42d9-952e-b10a8a6d8842 tempest-AttachVolumeNegativeTest-962283120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca757b85-2c06-426c-bea7-096269aabbc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:50:17 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-3a71cf7c-a6bc-42d9-952e-b10a8a6d8842 tempest-AttachVolumeNegativeTest-962283120 None] Volume 16b67192-a83e-4cd9-a29f-8106ce313696: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16b67192-a83e-4cd9-a29f-8106ce313696', 'volume_size': 1} Sep 28 11:50:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3a71cf7c-a6bc-42d9-952e-b10a8a6d8842 tempest-AttachVolumeNegativeTest-962283120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:50:17 devstack sudo[93588]: pam_unix(sudo:session): session closed for user root Sep 28 11:50:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-99c7bc66-bfb6-4c6f-a777-5956f372a594 tempest-SnapshotMetadataTestJSON-302612304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9ef796c5-6ccb-46a2-864e-09da554b6237.5499f909-789c-4892-951c-5d826372edd8" returned: 0 in 0.571s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:50:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-99c7bc66-bfb6-4c6f-a777-5956f372a594 tempest-SnapshotMetadataTestJSON-302612304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9ef796c5-6ccb-46a2-864e-09da554b6237.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:50:17 devstack sudo[93592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9ef796c5-6ccb-46a2-864e-09da554b6237.info Sep 28 11:50:17 devstack sudo[93592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:50:18 devstack sudo[93592]: pam_unix(sudo:session): session closed for user root Sep 28 11:50:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-99c7bc66-bfb6-4c6f-a777-5956f372a594 tempest-SnapshotMetadataTestJSON-302612304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9ef796c5-6ccb-46a2-864e-09da554b6237.info" returned: 0 in 0.419s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:50:18 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-99c7bc66-bfb6-4c6f-a777-5956f372a594 tempest-SnapshotMetadataTestJSON-302612304 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9ef796c5-6ccb-46a2-864e-09da554b6237.info is being set with open permissions: ugo+rw Sep 28 11:50:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-99c7bc66-bfb6-4c6f-a777-5956f372a594 tempest-SnapshotMetadataTestJSON-302612304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9ef796c5-6ccb-46a2-864e-09da554b6237.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:50:18 devstack sudo[93595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9ef796c5-6ccb-46a2-864e-09da554b6237.info Sep 28 11:50:18 devstack sudo[93595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:50:18 devstack sudo[93595]: pam_unix(sudo:session): session closed for user root Sep 28 11:50:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-99c7bc66-bfb6-4c6f-a777-5956f372a594 tempest-SnapshotMetadataTestJSON-302612304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9ef796c5-6ccb-46a2-864e-09da554b6237.info" returned: 0 in 0.451s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:50:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-99c7bc66-bfb6-4c6f-a777-5956f372a594 tempest-SnapshotMetadataTestJSON-302612304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.206s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:50:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3a71cf7c-a6bc-42d9-952e-b10a8a6d8842 tempest-AttachVolumeNegativeTest-962283120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.107s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:50:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3a71cf7c-a6bc-42d9-952e-b10a8a6d8842 tempest-AttachVolumeNegativeTest-962283120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-251740478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16b67192-a83e-4cd9-a29f-8106ce313696,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81ba3469bda8465fb145a233aec61f60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:50:17Z,use_quota=True,user_id='482c85c2bda54ca5a179eca038a733ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:50:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-3a71cf7c-a6bc-42d9-952e-b10a8a6d8842 tempest-AttachVolumeNegativeTest-962283120 None] Creating volume 16b67192-a83e-4cd9-a29f-8106ce313696 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:50:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3a71cf7c-a6bc-42d9-952e-b10a8a6d8842 tempest-AttachVolumeNegativeTest-962283120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:50:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3a71cf7c-a6bc-42d9-952e-b10a8a6d8842 tempest-AttachVolumeNegativeTest-962283120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:50:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3a71cf7c-a6bc-42d9-952e-b10a8a6d8842 tempest-AttachVolumeNegativeTest-962283120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:50:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3a71cf7c-a6bc-42d9-952e-b10a8a6d8842 tempest-AttachVolumeNegativeTest-962283120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:50:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3a71cf7c-a6bc-42d9-952e-b10a8a6d8842 tempest-AttachVolumeNegativeTest-962283120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:50:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3a71cf7c-a6bc-42d9-952e-b10a8a6d8842 tempest-AttachVolumeNegativeTest-962283120 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:50:18 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-3a71cf7c-a6bc-42d9-952e-b10a8a6d8842 tempest-AttachVolumeNegativeTest-962283120 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:50:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3a71cf7c-a6bc-42d9-952e-b10a8a6d8842 tempest-AttachVolumeNegativeTest-962283120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-16b67192-a83e-4cd9-a29f-8106ce313696 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:50:18 devstack sudo[93598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-16b67192-a83e-4cd9-a29f-8106ce313696 1073741824 Sep 28 11:50:18 devstack sudo[93598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:50:18 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-99c7bc66-bfb6-4c6f-a777-5956f372a594 tempest-SnapshotMetadataTestJSON-302612304 None] Create snapshot completed successfully Sep 28 11:50:19 devstack sudo[93598]: pam_unix(sudo:session): session closed for user root Sep 28 11:50:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3a71cf7c-a6bc-42d9-952e-b10a8a6d8842 tempest-AttachVolumeNegativeTest-962283120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-16b67192-a83e-4cd9-a29f-8106ce313696 1073741824" returned: 0 in 0.856s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:50:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3a71cf7c-a6bc-42d9-952e-b10a8a6d8842 tempest-AttachVolumeNegativeTest-962283120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-16b67192-a83e-4cd9-a29f-8106ce313696 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:50:19 devstack sudo[93607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-16b67192-a83e-4cd9-a29f-8106ce313696 Sep 28 11:50:19 devstack sudo[93607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:50:20 devstack sudo[93607]: pam_unix(sudo:session): session closed for user root Sep 28 11:50:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3a71cf7c-a6bc-42d9-952e-b10a8a6d8842 tempest-AttachVolumeNegativeTest-962283120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-16b67192-a83e-4cd9-a29f-8106ce313696" returned: 0 in 0.561s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:50:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3a71cf7c-a6bc-42d9-952e-b10a8a6d8842 tempest-AttachVolumeNegativeTest-962283120 None] <== create_volume: return (1491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:50:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3a71cf7c-a6bc-42d9-952e-b10a8a6d8842 tempest-AttachVolumeNegativeTest-962283120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.497s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:50:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3a71cf7c-a6bc-42d9-952e-b10a8a6d8842 tempest-AttachVolumeNegativeTest-962283120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca757b85-2c06-426c-bea7-096269aabbc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16b67192-a83e-4cd9-a29f-8106ce313696', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:50:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3a71cf7c-a6bc-42d9-952e-b10a8a6d8842 tempest-AttachVolumeNegativeTest-962283120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d04c02cd-ceeb-4e9d-a12d-5dff8759ab55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:50:20 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-3a71cf7c-a6bc-42d9-952e-b10a8a6d8842 tempest-AttachVolumeNegativeTest-962283120 None] Volume volume-16b67192-a83e-4cd9-a29f-8106ce313696 (16b67192-a83e-4cd9-a29f-8106ce313696): created successfully Sep 28 11:50:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3a71cf7c-a6bc-42d9-952e-b10a8a6d8842 tempest-AttachVolumeNegativeTest-962283120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d04c02cd-ceeb-4e9d-a12d-5dff8759ab55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:50:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3a71cf7c-a6bc-42d9-952e-b10a8a6d8842 tempest-AttachVolumeNegativeTest-962283120 None] Flow 'volume_create_manager' (147c6827-8966-4598-a3e4-e8e02a96efc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:50:20 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-3a71cf7c-a6bc-42d9-952e-b10a8a6d8842 tempest-AttachVolumeNegativeTest-962283120 None] Created volume successfully. Sep 28 11:50:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f78b4c42-23cd-4c16-a9c7-fc4eaa103156 tempest-SnapshotMetadataTestJSON-302612304 None] Acquiring lock "cinder-5499f909-789c-4892-951c-5d826372edd8-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:50:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f78b4c42-23cd-4c16-a9c7-fc4eaa103156 tempest-SnapshotMetadataTestJSON-302612304 None] Lock "cinder-5499f909-789c-4892-951c-5d826372edd8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.070s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:50:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f78b4c42-23cd-4c16-a9c7-fc4eaa103156 tempest-SnapshotMetadataTestJSON-302612304 None] Acquiring lock "cinder-quobyte-9ef796c5-6ccb-46a2-864e-09da554b6237" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:50:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f78b4c42-23cd-4c16-a9c7-fc4eaa103156 tempest-SnapshotMetadataTestJSON-302612304 None] Lock "cinder-quobyte-9ef796c5-6ccb-46a2-864e-09da554b6237" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:50:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f78b4c42-23cd-4c16-a9c7-fc4eaa103156 tempest-SnapshotMetadataTestJSON-302612304 None] Acquiring lock "cinder-quobyte-5499f909-789c-4892-951c-5d826372edd8" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:50:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f78b4c42-23cd-4c16-a9c7-fc4eaa103156 tempest-SnapshotMetadataTestJSON-302612304 None] Lock "cinder-quobyte-5499f909-789c-4892-951c-5d826372edd8" acquired by "_delete_snapshot" :: waited 0.051s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:50:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-f78b4c42-23cd-4c16-a9c7-fc4eaa103156 tempest-SnapshotMetadataTestJSON-302612304 None] Deleting offline snapshot 5499f909-789c-4892-951c-5d826372edd8 of volume 9ef796c5-6ccb-46a2-864e-09da554b6237 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 11:50:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-f78b4c42-23cd-4c16-a9c7-fc4eaa103156 tempest-SnapshotMetadataTestJSON-302612304 None] snapshot_file for this snap is: volume-9ef796c5-6ccb-46a2-864e-09da554b6237.5499f909-789c-4892-951c-5d826372edd8 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 11:50:22 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f9aaa7-1324-43c7-9068-2774f0bcd3d1]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:50:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f78b4c42-23cd-4c16-a9c7-fc4eaa103156 tempest-SnapshotMetadataTestJSON-302612304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9ef796c5-6ccb-46a2-864e-09da554b6237.5499f909-789c-4892-951c-5d826372edd8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:50:22 devstack sudo[93625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9ef796c5-6ccb-46a2-864e-09da554b6237.5499f909-789c-4892-951c-5d826372edd8 Sep 28 11:50:22 devstack sudo[93625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:50:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-db5f34b7-6efa-4e1a-be03-c7a09b72095d req-9d33b02b-544e-44f9-baf6-30d07cb858cf tempest-AttachVolumeNegativeTest-962283120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:50:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-db5f34b7-6efa-4e1a-be03-c7a09b72095d req-9d33b02b-544e-44f9-baf6-30d07cb858cf tempest-AttachVolumeNegativeTest-962283120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:50:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-db5f34b7-6efa-4e1a-be03-c7a09b72095d req-9d33b02b-544e-44f9-baf6-30d07cb858cf tempest-AttachVolumeNegativeTest-962283120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:50:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-db5f34b7-6efa-4e1a-be03-c7a09b72095d req-9d33b02b-544e-44f9-baf6-30d07cb858cf tempest-AttachVolumeNegativeTest-962283120 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0', 'name': 'volume-16b67192-a83e-4cd9-a29f-8106ce313696', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '47e39f2d-f0bf-4d82-8186-53edfb152a41', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 11:50:22 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-db5f34b7-6efa-4e1a-be03-c7a09b72095d req-9d33b02b-544e-44f9-baf6-30d07cb858cf tempest-AttachVolumeNegativeTest-962283120 None] attachment_update completed successfully. Sep 28 11:50:22 devstack sudo[93625]: pam_unix(sudo:session): session closed for user root Sep 28 11:50:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f78b4c42-23cd-4c16-a9c7-fc4eaa103156 tempest-SnapshotMetadataTestJSON-302612304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9ef796c5-6ccb-46a2-864e-09da554b6237.5499f909-789c-4892-951c-5d826372edd8" returned: 0 in 0.572s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:50:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-f78b4c42-23cd-4c16-a9c7-fc4eaa103156 tempest-SnapshotMetadataTestJSON-302612304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ef796c5-6ccb-46a2-864e-09da554b6237(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 11:50:22 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[39899027-6710-43d6-bcbd-63f103e199a4]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:50:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f78b4c42-23cd-4c16-a9c7-fc4eaa103156 tempest-SnapshotMetadataTestJSON-302612304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9ef796c5-6ccb-46a2-864e-09da554b6237 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:50:23 devstack sudo[93632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9ef796c5-6ccb-46a2-864e-09da554b6237 Sep 28 11:50:23 devstack sudo[93632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:50:23 devstack sudo[93632]: pam_unix(sudo:session): session closed for user root Sep 28 11:50:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f78b4c42-23cd-4c16-a9c7-fc4eaa103156 tempest-SnapshotMetadataTestJSON-302612304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9ef796c5-6ccb-46a2-864e-09da554b6237" returned: 0 in 0.705s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:50:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f78b4c42-23cd-4c16-a9c7-fc4eaa103156 tempest-SnapshotMetadataTestJSON-302612304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9ef796c5-6ccb-46a2-864e-09da554b6237.5499f909-789c-4892-951c-5d826372edd8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:50:23 devstack sudo[93641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9ef796c5-6ccb-46a2-864e-09da554b6237.5499f909-789c-4892-951c-5d826372edd8 Sep 28 11:50:23 devstack sudo[93641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:50:24 devstack sudo[93641]: pam_unix(sudo:session): session closed for user root Sep 28 11:50:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f78b4c42-23cd-4c16-a9c7-fc4eaa103156 tempest-SnapshotMetadataTestJSON-302612304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9ef796c5-6ccb-46a2-864e-09da554b6237.5499f909-789c-4892-951c-5d826372edd8" returned: 0 in 0.663s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:50:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f78b4c42-23cd-4c16-a9c7-fc4eaa103156 tempest-SnapshotMetadataTestJSON-302612304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9ef796c5-6ccb-46a2-864e-09da554b6237.5499f909-789c-4892-951c-5d826372edd8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:50:24 devstack sudo[93648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9ef796c5-6ccb-46a2-864e-09da554b6237.5499f909-789c-4892-951c-5d826372edd8 Sep 28 11:50:24 devstack sudo[93648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:50:24 devstack sudo[93648]: pam_unix(sudo:session): session closed for user root Sep 28 11:50:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f78b4c42-23cd-4c16-a9c7-fc4eaa103156 tempest-SnapshotMetadataTestJSON-302612304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9ef796c5-6ccb-46a2-864e-09da554b6237.5499f909-789c-4892-951c-5d826372edd8" returned: 0 in 0.355s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:50:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f78b4c42-23cd-4c16-a9c7-fc4eaa103156 tempest-SnapshotMetadataTestJSON-302612304 None] Lock "cinder-quobyte-5499f909-789c-4892-951c-5d826372edd8" released by "_delete_snapshot" :: held 2.522s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:50:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f78b4c42-23cd-4c16-a9c7-fc4eaa103156 tempest-SnapshotMetadataTestJSON-302612304 None] Lock "cinder-quobyte-9ef796c5-6ccb-46a2-864e-09da554b6237" released by "delete_snapshot" :: held 2.594s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:50:24 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-f78b4c42-23cd-4c16-a9c7-fc4eaa103156 tempest-SnapshotMetadataTestJSON-302612304 None] Created reservations ['673cab27-b7d1-4321-aac9-cb84f7e8bccf', 'b086f122-c568-4aff-8644-14004c0d040a', '823aaeb2-e556-47ca-a9a0-8327d7086f0c', '61f9b5ec-0552-40c5-a1de-f6ba8c978182'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:50:24 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-f78b4c42-23cd-4c16-a9c7-fc4eaa103156 tempest-SnapshotMetadataTestJSON-302612304 None] Delete snapshot completed successfully. Sep 28 11:50:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f78b4c42-23cd-4c16-a9c7-fc4eaa103156 tempest-SnapshotMetadataTestJSON-302612304 None] Lock "cinder-5499f909-789c-4892-951c-5d826372edd8-delete_snapshot" released by "delete_snapshot" :: held 2.893s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:50:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6135cb6c-0fe2-4636-abfe-37e33967edae tempest-SnapshotMetadataTestJSON-302612304 None] Acquiring lock "cinder-9ef796c5-6ccb-46a2-864e-09da554b6237-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:50:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6135cb6c-0fe2-4636-abfe-37e33967edae tempest-SnapshotMetadataTestJSON-302612304 None] Lock "cinder-9ef796c5-6ccb-46a2-864e-09da554b6237-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:50:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6135cb6c-0fe2-4636-abfe-37e33967edae tempest-SnapshotMetadataTestJSON-302612304 None] Acquiring lock "cinder-quobyte-9ef796c5-6ccb-46a2-864e-09da554b6237" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:50:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6135cb6c-0fe2-4636-abfe-37e33967edae tempest-SnapshotMetadataTestJSON-302612304 None] Lock "cinder-quobyte-9ef796c5-6ccb-46a2-864e-09da554b6237" acquired by "delete_volume" :: waited 0.043s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:50:25 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b50ef1-7304-40d7-9bbd-660190579c12]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:50:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6135cb6c-0fe2-4636-abfe-37e33967edae tempest-SnapshotMetadataTestJSON-302612304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9ef796c5-6ccb-46a2-864e-09da554b6237 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:50:25 devstack sudo[93656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9ef796c5-6ccb-46a2-864e-09da554b6237 Sep 28 11:50:25 devstack sudo[93656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:50:26 devstack sudo[93656]: pam_unix(sudo:session): session closed for user root Sep 28 11:50:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6135cb6c-0fe2-4636-abfe-37e33967edae tempest-SnapshotMetadataTestJSON-302612304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9ef796c5-6ccb-46a2-864e-09da554b6237" returned: 0 in 0.932s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:50:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6135cb6c-0fe2-4636-abfe-37e33967edae tempest-SnapshotMetadataTestJSON-302612304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9ef796c5-6ccb-46a2-864e-09da554b6237 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:50:26 devstack sudo[93661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9ef796c5-6ccb-46a2-864e-09da554b6237 Sep 28 11:50:26 devstack sudo[93661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:50:27 devstack sudo[93661]: pam_unix(sudo:session): session closed for user root Sep 28 11:50:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6135cb6c-0fe2-4636-abfe-37e33967edae tempest-SnapshotMetadataTestJSON-302612304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9ef796c5-6ccb-46a2-864e-09da554b6237" returned: 0 in 0.540s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:50:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6135cb6c-0fe2-4636-abfe-37e33967edae tempest-SnapshotMetadataTestJSON-302612304 None] Lock "cinder-quobyte-9ef796c5-6ccb-46a2-864e-09da554b6237" released by "delete_volume" :: held 1.648s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:50:27 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-6135cb6c-0fe2-4636-abfe-37e33967edae tempest-SnapshotMetadataTestJSON-302612304 None] Created reservations ['0d5ff858-4b12-482c-89af-039db96c4fb3', '5b682cf2-02a1-46d5-82cb-8f80f35a4d15', '2b02dc7b-f416-4939-900d-9e5a7664c8e4', '0a203a6e-4d85-4ad7-af38-71315338816d'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:50:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6135cb6c-0fe2-4636-abfe-37e33967edae tempest-SnapshotMetadataTestJSON-302612304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:50:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6135cb6c-0fe2-4636-abfe-37e33967edae tempest-SnapshotMetadataTestJSON-302612304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:50:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6135cb6c-0fe2-4636-abfe-37e33967edae tempest-SnapshotMetadataTestJSON-302612304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:50:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6135cb6c-0fe2-4636-abfe-37e33967edae tempest-SnapshotMetadataTestJSON-302612304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:50:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6135cb6c-0fe2-4636-abfe-37e33967edae tempest-SnapshotMetadataTestJSON-302612304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:50:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6135cb6c-0fe2-4636-abfe-37e33967edae tempest-SnapshotMetadataTestJSON-302612304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:50:27 devstack sudo[93665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:50:27 devstack sudo[93665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:50:28 devstack sudo[93665]: pam_unix(sudo:session): session closed for user root Sep 28 11:50:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6135cb6c-0fe2-4636-abfe-37e33967edae tempest-SnapshotMetadataTestJSON-302612304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.521s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:50:28 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-6135cb6c-0fe2-4636-abfe-37e33967edae tempest-SnapshotMetadataTestJSON-302612304 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:50:28 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-6135cb6c-0fe2-4636-abfe-37e33967edae tempest-SnapshotMetadataTestJSON-302612304 None] Deleted volume successfully. Sep 28 11:50:28 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6135cb6c-0fe2-4636-abfe-37e33967edae tempest-SnapshotMetadataTestJSON-302612304 None] Lock "cinder-9ef796c5-6ccb-46a2-864e-09da554b6237-delete_volume" released by "delete_volume" :: held 2.654s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:50:29 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-da3252f8-6145-4d6e-a060-b22a24b58803 req-c767ed85-2f97-41f9-b391-400be6cb0d2f tempest-ServerActionsTestOtherA-485250721 None] Terminate volume connection completed successfully. Sep 28 11:50:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-da3252f8-6145-4d6e-a060-b22a24b58803 req-c767ed85-2f97-41f9-b391-400be6cb0d2f tempest-ServerActionsTestOtherA-485250721 None] Deleting attachment 65f5f48d-62b1-44d9-ad93-a05ae03f363a. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 11:50:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-da3252f8-6145-4d6e-a060-b22a24b58803 req-79621168-bd9b-478b-93a6-8071e46e7fde tempest-ServerActionsTestOtherA-485250721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:50:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-da3252f8-6145-4d6e-a060-b22a24b58803 req-79621168-bd9b-478b-93a6-8071e46e7fde tempest-ServerActionsTestOtherA-485250721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:50:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-da3252f8-6145-4d6e-a060-b22a24b58803 req-79621168-bd9b-478b-93a6-8071e46e7fde tempest-ServerActionsTestOtherA-485250721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:50:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-da3252f8-6145-4d6e-a060-b22a24b58803 req-79621168-bd9b-478b-93a6-8071e46e7fde tempest-ServerActionsTestOtherA-485250721 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0', 'name': 'volume-cd9e0651-e181-4ea4-b214-7bb0653b528e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '045a5338-fa2e-4692-85f8-6b1bb1aa4a06', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 11:50:32 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-da3252f8-6145-4d6e-a060-b22a24b58803 req-79621168-bd9b-478b-93a6-8071e46e7fde tempest-ServerActionsTestOtherA-485250721 None] attachment_update completed successfully. Sep 28 11:50:38 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 11:50:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:50:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:50:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:50:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:50:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:50:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:50:38 devstack sudo[93904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:50:38 devstack sudo[93904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:50:39 devstack sudo[93904]: pam_unix(sudo:session): session closed for user root Sep 28 11:50:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.645s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:50:39 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:50:39 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 11:50:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] thread count: 28 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 11:50:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] thread info: [<_MainThread(MainThread, started 135408582168704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 11:50:42 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=66,cinder:UPDATE=60,cinder:INSERT=20,cinder:DELETE=7 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 11:50:42 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:UPDATE=67,cinder:DELETE=3,cinder:SELECT=71,cinder:INSERT=21 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 11:50:43 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eb2d07d-b14f-4213-8855-b2e28afa7001 tempest-VolumesDeleteCascade-1327545507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:50:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5eb2d07d-b14f-4213-8855-b2e28afa7001 tempest-VolumesDeleteCascade-1327545507 None] Flow 'volume_create_manager' (60b27040-3cf4-43de-8928-2ab83e6068d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:50:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5eb2d07d-b14f-4213-8855-b2e28afa7001 tempest-VolumesDeleteCascade-1327545507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92b690dc-9f2e-4f0b-87ce-26baf38fc7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:50:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5eb2d07d-b14f-4213-8855-b2e28afa7001 tempest-VolumesDeleteCascade-1327545507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92b690dc-9f2e-4f0b-87ce-26baf38fc7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:50:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1597832999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69456d47-fe79-4f1a-8736-fc433dc3ac3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be9b4aa4dda449d48945e146bebbace1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:50:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:50:43Z,use_quota=True,user_id='cb377f6b54ea4fe4b81997dda5ec5149',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:50:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5eb2d07d-b14f-4213-8855-b2e28afa7001 tempest-VolumesDeleteCascade-1327545507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a558d77c-cfa5-46a0-80ab-2997390c7bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:50:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5eb2d07d-b14f-4213-8855-b2e28afa7001 tempest-VolumesDeleteCascade-1327545507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a558d77c-cfa5-46a0-80ab-2997390c7bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:50:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5eb2d07d-b14f-4213-8855-b2e28afa7001 tempest-VolumesDeleteCascade-1327545507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (317e9a8b-d4f8-4938-9ab9-0735d0e51a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:50:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5eb2d07d-b14f-4213-8855-b2e28afa7001 tempest-VolumesDeleteCascade-1327545507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (317e9a8b-d4f8-4938-9ab9-0735d0e51a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69456d47-fe79-4f1a-8736-fc433dc3ac3c', 'volume_name': 'volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:50:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5eb2d07d-b14f-4213-8855-b2e28afa7001 tempest-VolumesDeleteCascade-1327545507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcba4809-85d4-4ab3-a0a9-368a5fe4fdc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:50:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5eb2d07d-b14f-4213-8855-b2e28afa7001 tempest-VolumesDeleteCascade-1327545507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcba4809-85d4-4ab3-a0a9-368a5fe4fdc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:50:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5eb2d07d-b14f-4213-8855-b2e28afa7001 tempest-VolumesDeleteCascade-1327545507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (428833e0-067c-4cfd-97f1-1d3f5ae0cda3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:50:43 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-5eb2d07d-b14f-4213-8855-b2e28afa7001 tempest-VolumesDeleteCascade-1327545507 None] Volume 69456d47-fe79-4f1a-8736-fc433dc3ac3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c', 'volume_size': 1} Sep 28 11:50:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5eb2d07d-b14f-4213-8855-b2e28afa7001 tempest-VolumesDeleteCascade-1327545507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:50:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5eb2d07d-b14f-4213-8855-b2e28afa7001 tempest-VolumesDeleteCascade-1327545507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:50:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5eb2d07d-b14f-4213-8855-b2e28afa7001 tempest-VolumesDeleteCascade-1327545507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:50:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1597832999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69456d47-fe79-4f1a-8736-fc433dc3ac3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be9b4aa4dda449d48945e146bebbace1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:50:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:50:43Z,use_quota=True,user_id='cb377f6b54ea4fe4b81997dda5ec5149',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:50:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-5eb2d07d-b14f-4213-8855-b2e28afa7001 tempest-VolumesDeleteCascade-1327545507 None] Creating volume 69456d47-fe79-4f1a-8736-fc433dc3ac3c {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:50:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5eb2d07d-b14f-4213-8855-b2e28afa7001 tempest-VolumesDeleteCascade-1327545507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:50:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5eb2d07d-b14f-4213-8855-b2e28afa7001 tempest-VolumesDeleteCascade-1327545507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:50:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5eb2d07d-b14f-4213-8855-b2e28afa7001 tempest-VolumesDeleteCascade-1327545507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:50:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5eb2d07d-b14f-4213-8855-b2e28afa7001 tempest-VolumesDeleteCascade-1327545507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:50:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5eb2d07d-b14f-4213-8855-b2e28afa7001 tempest-VolumesDeleteCascade-1327545507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:50:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5eb2d07d-b14f-4213-8855-b2e28afa7001 tempest-VolumesDeleteCascade-1327545507 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:50:43 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-5eb2d07d-b14f-4213-8855-b2e28afa7001 tempest-VolumesDeleteCascade-1327545507 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:50:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5eb2d07d-b14f-4213-8855-b2e28afa7001 tempest-VolumesDeleteCascade-1327545507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:50:43 devstack sudo[93968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c 1073741824 Sep 28 11:50:43 devstack sudo[93968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:50:44 devstack sudo[93968]: pam_unix(sudo:session): session closed for user root Sep 28 11:50:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5eb2d07d-b14f-4213-8855-b2e28afa7001 tempest-VolumesDeleteCascade-1327545507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c 1073741824" returned: 0 in 1.005s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:50:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5eb2d07d-b14f-4213-8855-b2e28afa7001 tempest-VolumesDeleteCascade-1327545507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:50:44 devstack sudo[93973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c Sep 28 11:50:44 devstack sudo[93973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:50:45 devstack sudo[93973]: pam_unix(sudo:session): session closed for user root Sep 28 11:50:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5eb2d07d-b14f-4213-8855-b2e28afa7001 tempest-VolumesDeleteCascade-1327545507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c" returned: 0 in 0.809s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:50:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5eb2d07d-b14f-4213-8855-b2e28afa7001 tempest-VolumesDeleteCascade-1327545507 None] <== create_volume: return (1937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:50:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5eb2d07d-b14f-4213-8855-b2e28afa7001 tempest-VolumesDeleteCascade-1327545507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.939s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:50:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5eb2d07d-b14f-4213-8855-b2e28afa7001 tempest-VolumesDeleteCascade-1327545507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (428833e0-067c-4cfd-97f1-1d3f5ae0cda3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:50:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5eb2d07d-b14f-4213-8855-b2e28afa7001 tempest-VolumesDeleteCascade-1327545507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fb9282c-e411-49ba-8f8e-397a6484d37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:50:45 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-5eb2d07d-b14f-4213-8855-b2e28afa7001 tempest-VolumesDeleteCascade-1327545507 None] Volume volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c (69456d47-fe79-4f1a-8736-fc433dc3ac3c): created successfully Sep 28 11:50:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5eb2d07d-b14f-4213-8855-b2e28afa7001 tempest-VolumesDeleteCascade-1327545507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fb9282c-e411-49ba-8f8e-397a6484d37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:50:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5eb2d07d-b14f-4213-8855-b2e28afa7001 tempest-VolumesDeleteCascade-1327545507 None] Flow 'volume_create_manager' (60b27040-3cf4-43de-8928-2ab83e6068d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:50:45 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-5eb2d07d-b14f-4213-8855-b2e28afa7001 tempest-VolumesDeleteCascade-1327545507 None] Created volume successfully. Sep 28 11:50:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-79b41b8a-f8c3-41e2-a822-e846e650bad7 tempest-VolumesDeleteCascade-1327545507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:50:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-79b41b8a-f8c3-41e2-a822-e846e650bad7 tempest-VolumesDeleteCascade-1327545507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:50:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-79b41b8a-f8c3-41e2-a822-e846e650bad7 tempest-VolumesDeleteCascade-1327545507 None] Creating offline snapshot 4a2b05d2-0abf-4864-becd-544665798b40 of volume 69456d47-fe79-4f1a-8736-fc433dc3ac3c {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 11:50:47 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e549942-be68-4484-9da3-eaf23b316410]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:50:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-79b41b8a-f8c3-41e2-a822-e846e650bad7 tempest-VolumesDeleteCascade-1327545507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:50:47 devstack sudo[93979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c Sep 28 11:50:47 devstack sudo[93979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:50:47 devstack sudo[93979]: pam_unix(sudo:session): session closed for user root Sep 28 11:50:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-79b41b8a-f8c3-41e2-a822-e846e650bad7 tempest-VolumesDeleteCascade-1327545507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c" returned: 0 in 0.748s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:50:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-79b41b8a-f8c3-41e2-a822-e846e650bad7 tempest-VolumesDeleteCascade-1327545507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c.4a2b05d2-0abf-4864-becd-544665798b40 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:50:47 devstack sudo[93984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c.4a2b05d2-0abf-4864-becd-544665798b40 1G Sep 28 11:50:47 devstack sudo[93984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:50:48 devstack sudo[93984]: pam_unix(sudo:session): session closed for user root Sep 28 11:50:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-79b41b8a-f8c3-41e2-a822-e846e650bad7 tempest-VolumesDeleteCascade-1327545507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c.4a2b05d2-0abf-4864-becd-544665798b40 1G" returned: 0 in 0.772s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:50:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-79b41b8a-f8c3-41e2-a822-e846e650bad7 tempest-VolumesDeleteCascade-1327545507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c.4a2b05d2-0abf-4864-becd-544665798b40 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:50:48 devstack sudo[93991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c.4a2b05d2-0abf-4864-becd-544665798b40 Sep 28 11:50:48 devstack sudo[93991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:50:49 devstack sudo[93991]: pam_unix(sudo:session): session closed for user root Sep 28 11:50:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-79b41b8a-f8c3-41e2-a822-e846e650bad7 tempest-VolumesDeleteCascade-1327545507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c.4a2b05d2-0abf-4864-becd-544665798b40" returned: 0 in 0.676s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:50:49 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-79b41b8a-f8c3-41e2-a822-e846e650bad7 tempest-VolumesDeleteCascade-1327545507 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c.4a2b05d2-0abf-4864-becd-544665798b40 is being set with open permissions: ugo+rw Sep 28 11:50:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-79b41b8a-f8c3-41e2-a822-e846e650bad7 tempest-VolumesDeleteCascade-1327545507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c.4a2b05d2-0abf-4864-becd-544665798b40 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:50:49 devstack sudo[93997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c.4a2b05d2-0abf-4864-becd-544665798b40 Sep 28 11:50:49 devstack sudo[93997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:50:49 devstack sudo[93997]: pam_unix(sudo:session): session closed for user root Sep 28 11:50:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-79b41b8a-f8c3-41e2-a822-e846e650bad7 tempest-VolumesDeleteCascade-1327545507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c.4a2b05d2-0abf-4864-becd-544665798b40" returned: 0 in 0.326s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:50:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-79b41b8a-f8c3-41e2-a822-e846e650bad7 tempest-VolumesDeleteCascade-1327545507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:50:49 devstack sudo[94002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c.info Sep 28 11:50:49 devstack sudo[94002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:50:50 devstack sudo[94002]: pam_unix(sudo:session): session closed for user root Sep 28 11:50:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-79b41b8a-f8c3-41e2-a822-e846e650bad7 tempest-VolumesDeleteCascade-1327545507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c.info" returned: 0 in 0.536s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:50:50 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-79b41b8a-f8c3-41e2-a822-e846e650bad7 tempest-VolumesDeleteCascade-1327545507 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c.info is being set with open permissions: ugo+rw Sep 28 11:50:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-79b41b8a-f8c3-41e2-a822-e846e650bad7 tempest-VolumesDeleteCascade-1327545507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:50:50 devstack sudo[94005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c.info Sep 28 11:50:50 devstack sudo[94005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:50:50 devstack sudo[94005]: pam_unix(sudo:session): session closed for user root Sep 28 11:50:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-79b41b8a-f8c3-41e2-a822-e846e650bad7 tempest-VolumesDeleteCascade-1327545507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c.info" returned: 0 in 0.366s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:50:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-79b41b8a-f8c3-41e2-a822-e846e650bad7 tempest-VolumesDeleteCascade-1327545507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.585s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:50:50 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-79b41b8a-f8c3-41e2-a822-e846e650bad7 tempest-VolumesDeleteCascade-1327545507 None] Create snapshot completed successfully Sep 28 11:50:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0f495c63-32fd-4922-b1f0-71a3eb14a7cb tempest-VolumesDeleteCascade-1327545507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:50:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0f495c63-32fd-4922-b1f0-71a3eb14a7cb tempest-VolumesDeleteCascade-1327545507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:50:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-0f495c63-32fd-4922-b1f0-71a3eb14a7cb tempest-VolumesDeleteCascade-1327545507 None] Creating offline snapshot 10eca301-8d6f-4197-99c4-5c226fa3626b of volume 69456d47-fe79-4f1a-8736-fc433dc3ac3c {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 11:50:51 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[dafd549d-bc0a-461a-9c5c-2e734de4f212]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:50:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0f495c63-32fd-4922-b1f0-71a3eb14a7cb tempest-VolumesDeleteCascade-1327545507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c.4a2b05d2-0abf-4864-becd-544665798b40 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:50:51 devstack sudo[94008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c.4a2b05d2-0abf-4864-becd-544665798b40 Sep 28 11:50:51 devstack sudo[94008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:50:51 devstack sudo[94008]: pam_unix(sudo:session): session closed for user root Sep 28 11:50:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0f495c63-32fd-4922-b1f0-71a3eb14a7cb tempest-VolumesDeleteCascade-1327545507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c.4a2b05d2-0abf-4864-becd-544665798b40" returned: 0 in 0.427s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:50:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-0f495c63-32fd-4922-b1f0-71a3eb14a7cb tempest-VolumesDeleteCascade-1327545507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 11:50:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0f495c63-32fd-4922-b1f0-71a3eb14a7cb tempest-VolumesDeleteCascade-1327545507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c.4a2b05d2-0abf-4864-becd-544665798b40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c.10eca301-8d6f-4197-99c4-5c226fa3626b 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:50:52 devstack sudo[94013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c.4a2b05d2-0abf-4864-becd-544665798b40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c.10eca301-8d6f-4197-99c4-5c226fa3626b 1G Sep 28 11:50:52 devstack sudo[94013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:50:52 devstack sudo[94013]: pam_unix(sudo:session): session closed for user root Sep 28 11:50:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0f495c63-32fd-4922-b1f0-71a3eb14a7cb tempest-VolumesDeleteCascade-1327545507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c.4a2b05d2-0abf-4864-becd-544665798b40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c.10eca301-8d6f-4197-99c4-5c226fa3626b 1G" returned: 0 in 0.583s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:50:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0f495c63-32fd-4922-b1f0-71a3eb14a7cb tempest-VolumesDeleteCascade-1327545507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c.4a2b05d2-0abf-4864-becd-544665798b40 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c.10eca301-8d6f-4197-99c4-5c226fa3626b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:50:52 devstack sudo[94018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c.4a2b05d2-0abf-4864-becd-544665798b40 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c.10eca301-8d6f-4197-99c4-5c226fa3626b Sep 28 11:50:52 devstack sudo[94018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:50:53 devstack sudo[94018]: pam_unix(sudo:session): session closed for user root Sep 28 11:50:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0f495c63-32fd-4922-b1f0-71a3eb14a7cb tempest-VolumesDeleteCascade-1327545507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c.4a2b05d2-0abf-4864-becd-544665798b40 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c.10eca301-8d6f-4197-99c4-5c226fa3626b" returned: 0 in 0.447s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:50:53 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-0f495c63-32fd-4922-b1f0-71a3eb14a7cb tempest-VolumesDeleteCascade-1327545507 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c.10eca301-8d6f-4197-99c4-5c226fa3626b is being set with open permissions: ugo+rw Sep 28 11:50:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0f495c63-32fd-4922-b1f0-71a3eb14a7cb tempest-VolumesDeleteCascade-1327545507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c.10eca301-8d6f-4197-99c4-5c226fa3626b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:50:53 devstack sudo[94025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c.10eca301-8d6f-4197-99c4-5c226fa3626b Sep 28 11:50:53 devstack sudo[94025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:50:53 devstack sudo[94025]: pam_unix(sudo:session): session closed for user root Sep 28 11:50:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0f495c63-32fd-4922-b1f0-71a3eb14a7cb tempest-VolumesDeleteCascade-1327545507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c.10eca301-8d6f-4197-99c4-5c226fa3626b" returned: 0 in 0.301s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:50:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0f495c63-32fd-4922-b1f0-71a3eb14a7cb tempest-VolumesDeleteCascade-1327545507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.875s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:50:53 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-0f495c63-32fd-4922-b1f0-71a3eb14a7cb tempest-VolumesDeleteCascade-1327545507 None] Create snapshot completed successfully Sep 28 11:50:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] Acquiring lock "cinder-69456d47-fe79-4f1a-8736-fc433dc3ac3c-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:50:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] Lock "cinder-69456d47-fe79-4f1a-8736-fc433dc3ac3c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:50:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] Performing cascade delete. {{(pid=86916) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 28 11:50:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] Acquiring lock "cinder-10eca301-8d6f-4197-99c4-5c226fa3626b-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:50:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] Lock "cinder-10eca301-8d6f-4197-99c4-5c226fa3626b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:50:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] Acquiring lock "cinder-quobyte-69456d47-fe79-4f1a-8736-fc433dc3ac3c" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:50:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] Lock "cinder-quobyte-69456d47-fe79-4f1a-8736-fc433dc3ac3c" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:50:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] Acquiring lock "cinder-quobyte-10eca301-8d6f-4197-99c4-5c226fa3626b" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:50:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] Lock "cinder-quobyte-10eca301-8d6f-4197-99c4-5c226fa3626b" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:50:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] Deleting offline snapshot 10eca301-8d6f-4197-99c4-5c226fa3626b of volume 69456d47-fe79-4f1a-8736-fc433dc3ac3c {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 11:50:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] snapshot_file for this snap is: volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c.10eca301-8d6f-4197-99c4-5c226fa3626b {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 11:50:54 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[55614e95-92cd-4f5d-8f55-f52ffedb22fa]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:50:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c.10eca301-8d6f-4197-99c4-5c226fa3626b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:50:54 devstack sudo[94055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c.10eca301-8d6f-4197-99c4-5c226fa3626b Sep 28 11:50:54 devstack sudo[94055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:50:54 devstack sudo[94055]: pam_unix(sudo:session): session closed for user root Sep 28 11:50:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c.10eca301-8d6f-4197-99c4-5c226fa3626b" returned: 0 in 0.368s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:50:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 11:50:54 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f75aea-739f-4f02-bd00-5940153314ef]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:50:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c.4a2b05d2-0abf-4864-becd-544665798b40 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:50:54 devstack sudo[94060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c.4a2b05d2-0abf-4864-becd-544665798b40 Sep 28 11:50:54 devstack sudo[94060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:50:54 devstack sudo[94060]: pam_unix(sudo:session): session closed for user root Sep 28 11:50:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c.4a2b05d2-0abf-4864-becd-544665798b40" returned: 0 in 0.406s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:50:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 11:50:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c.10eca301-8d6f-4197-99c4-5c226fa3626b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:50:54 devstack sudo[94066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c.10eca301-8d6f-4197-99c4-5c226fa3626b Sep 28 11:50:54 devstack sudo[94066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:50:55 devstack sudo[94066]: pam_unix(sudo:session): session closed for user root Sep 28 11:50:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c.10eca301-8d6f-4197-99c4-5c226fa3626b" returned: 0 in 0.404s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:50:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c.10eca301-8d6f-4197-99c4-5c226fa3626b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:50:55 devstack sudo[94071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c.10eca301-8d6f-4197-99c4-5c226fa3626b Sep 28 11:50:55 devstack sudo[94071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:50:55 devstack sudo[94071]: pam_unix(sudo:session): session closed for user root Sep 28 11:50:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c.10eca301-8d6f-4197-99c4-5c226fa3626b" returned: 0 in 0.274s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:50:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] Lock "cinder-quobyte-10eca301-8d6f-4197-99c4-5c226fa3626b" released by "_delete_snapshot" :: held 1.570s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:50:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] Lock "cinder-quobyte-69456d47-fe79-4f1a-8736-fc433dc3ac3c" released by "delete_snapshot" :: held 1.602s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:50:55 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] Created reservations ['03ce3961-84ea-4506-a05a-8e2acb6a59ef', 'bb8597c1-50f3-4d23-a39f-1452b719ed0b', 'a39d81f8-3603-4783-91ad-a87cc73274e9', '9ceee4dd-7ec8-4df1-b346-92138ba29319'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:50:55 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] Delete snapshot completed successfully. Sep 28 11:50:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] Lock "cinder-10eca301-8d6f-4197-99c4-5c226fa3626b-delete_snapshot" released by "delete_snapshot" :: held 1.789s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:50:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] Acquiring lock "cinder-4a2b05d2-0abf-4864-becd-544665798b40-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:50:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] Lock "cinder-4a2b05d2-0abf-4864-becd-544665798b40-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:50:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] Acquiring lock "cinder-quobyte-69456d47-fe79-4f1a-8736-fc433dc3ac3c" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:50:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] Lock "cinder-quobyte-69456d47-fe79-4f1a-8736-fc433dc3ac3c" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:50:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] Acquiring lock "cinder-quobyte-4a2b05d2-0abf-4864-becd-544665798b40" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:50:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] Lock "cinder-quobyte-4a2b05d2-0abf-4864-becd-544665798b40" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:50:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] Deleting offline snapshot 4a2b05d2-0abf-4864-becd-544665798b40 of volume 69456d47-fe79-4f1a-8736-fc433dc3ac3c {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 11:50:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] snapshot_file for this snap is: volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c.4a2b05d2-0abf-4864-becd-544665798b40 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 11:50:55 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e72fa3d-784d-45f5-b9d0-00097ff4439c]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:50:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c.4a2b05d2-0abf-4864-becd-544665798b40 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:50:55 devstack sudo[94074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c.4a2b05d2-0abf-4864-becd-544665798b40 Sep 28 11:50:55 devstack sudo[94074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:50:56 devstack sudo[94074]: pam_unix(sudo:session): session closed for user root Sep 28 11:50:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c.4a2b05d2-0abf-4864-becd-544665798b40" returned: 0 in 0.442s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:50:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 11:50:56 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ceb9ee-2220-42f4-a9f3-36d18ad607f9]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:50:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:50:56 devstack sudo[94082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c Sep 28 11:50:56 devstack sudo[94082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:50:56 devstack sudo[94082]: pam_unix(sudo:session): session closed for user root Sep 28 11:50:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c" returned: 0 in 0.393s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:50:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c.4a2b05d2-0abf-4864-becd-544665798b40 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:50:56 devstack sudo[94087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c.4a2b05d2-0abf-4864-becd-544665798b40 Sep 28 11:50:56 devstack sudo[94087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:50:57 devstack sudo[94087]: pam_unix(sudo:session): session closed for user root Sep 28 11:50:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c.4a2b05d2-0abf-4864-becd-544665798b40" returned: 0 in 0.346s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:50:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c.4a2b05d2-0abf-4864-becd-544665798b40 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:50:57 devstack sudo[94092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c.4a2b05d2-0abf-4864-becd-544665798b40 Sep 28 11:50:57 devstack sudo[94092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:50:57 devstack sudo[94092]: pam_unix(sudo:session): session closed for user root Sep 28 11:50:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c.4a2b05d2-0abf-4864-becd-544665798b40" returned: 0 in 0.292s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:50:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] Lock "cinder-quobyte-4a2b05d2-0abf-4864-becd-544665798b40" released by "_delete_snapshot" :: held 1.582s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:50:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] Lock "cinder-quobyte-69456d47-fe79-4f1a-8736-fc433dc3ac3c" released by "delete_snapshot" :: held 1.610s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:50:57 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] Created reservations ['6a5de2d1-6526-4898-8365-1eb5779dafa1', '0ea794f1-0966-495a-9151-217fc77274bd', '4d751b0e-5b4a-47cd-b414-755b0f3a0dc4', 'd0293ebe-966f-4137-be82-95ff553f2560'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:50:57 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] Delete snapshot completed successfully. Sep 28 11:50:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] Lock "cinder-4a2b05d2-0abf-4864-becd-544665798b40-delete_snapshot" released by "delete_snapshot" :: held 1.780s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:50:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] Snapshots deleted, issuing volume delete {{(pid=86916) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 28 11:50:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] Acquiring lock "cinder-quobyte-69456d47-fe79-4f1a-8736-fc433dc3ac3c" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:50:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] Lock "cinder-quobyte-69456d47-fe79-4f1a-8736-fc433dc3ac3c" acquired by "delete_volume" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:50:57 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e482e6-b759-4cb4-8525-17af303211d9]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:50:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:50:57 devstack sudo[94095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c Sep 28 11:50:57 devstack sudo[94095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:50:57 devstack sudo[94095]: pam_unix(sudo:session): session closed for user root Sep 28 11:50:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c" returned: 0 in 0.394s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:50:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:50:57 devstack sudo[94100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c Sep 28 11:50:57 devstack sudo[94100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:50:58 devstack sudo[94100]: pam_unix(sudo:session): session closed for user root Sep 28 11:50:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-69456d47-fe79-4f1a-8736-fc433dc3ac3c" returned: 0 in 0.252s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:50:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] Lock "cinder-quobyte-69456d47-fe79-4f1a-8736-fc433dc3ac3c" released by "delete_volume" :: held 0.719s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:50:58 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] Created reservations ['208008e1-46a1-404d-a2eb-9158f93a6720', '641b5656-de22-4407-85f1-eca74b517b1b', '8cadda42-87ca-4b0e-886f-1e391817408f', 'e920f578-9b4f-4c61-bd9e-6721b7cbfa85'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:50:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:50:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:50:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:50:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:50:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:50:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:50:58 devstack sudo[94103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:50:58 devstack sudo[94103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:50:58 devstack sudo[94103]: pam_unix(sudo:session): session closed for user root Sep 28 11:50:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.258s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:50:58 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:50:58 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] Deleted volume successfully. Sep 28 11:50:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-042cfdb8-d7f5-40f0-b830-3f443cd3d685 tempest-VolumesDeleteCascade-1327545507 None] Lock "cinder-69456d47-fe79-4f1a-8736-fc433dc3ac3c-delete_volume" released by "delete_volume" :: held 4.879s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:51:00 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-6436f98b-8d18-4c3e-9adf-742dcb04d94e tempest-VolumesDeleteCascade-1327545507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:51:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6436f98b-8d18-4c3e-9adf-742dcb04d94e tempest-VolumesDeleteCascade-1327545507 None] Flow 'volume_create_manager' (f96403c1-976a-4987-a6f4-92c50534a578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:51:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6436f98b-8d18-4c3e-9adf-742dcb04d94e tempest-VolumesDeleteCascade-1327545507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99989a97-6cd1-4f3b-9e7a-d8441d3bbcf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:51:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6436f98b-8d18-4c3e-9adf-742dcb04d94e tempest-VolumesDeleteCascade-1327545507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99989a97-6cd1-4f3b-9e7a-d8441d3bbcf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:51:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1986082203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84454ebd-52b1-44be-bd07-01b688bbfa80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be9b4aa4dda449d48945e146bebbace1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:51:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:51:00Z,use_quota=True,user_id='cb377f6b54ea4fe4b81997dda5ec5149',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:51:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6436f98b-8d18-4c3e-9adf-742dcb04d94e tempest-VolumesDeleteCascade-1327545507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5afeae8-c2bc-4931-bd72-f35add322fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:51:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6436f98b-8d18-4c3e-9adf-742dcb04d94e tempest-VolumesDeleteCascade-1327545507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5afeae8-c2bc-4931-bd72-f35add322fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:51:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6436f98b-8d18-4c3e-9adf-742dcb04d94e tempest-VolumesDeleteCascade-1327545507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6789d97c-c05c-4035-9d38-5bef1dfbd549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:51:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6436f98b-8d18-4c3e-9adf-742dcb04d94e tempest-VolumesDeleteCascade-1327545507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6789d97c-c05c-4035-9d38-5bef1dfbd549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84454ebd-52b1-44be-bd07-01b688bbfa80', 'volume_name': 'volume-84454ebd-52b1-44be-bd07-01b688bbfa80', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:51:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6436f98b-8d18-4c3e-9adf-742dcb04d94e tempest-VolumesDeleteCascade-1327545507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7a5ddea-f23e-446e-92b0-f6510c8bd40e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:51:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6436f98b-8d18-4c3e-9adf-742dcb04d94e tempest-VolumesDeleteCascade-1327545507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7a5ddea-f23e-446e-92b0-f6510c8bd40e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:51:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6436f98b-8d18-4c3e-9adf-742dcb04d94e tempest-VolumesDeleteCascade-1327545507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04951f60-2eab-428a-a9bb-8061af940a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:51:00 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-6436f98b-8d18-4c3e-9adf-742dcb04d94e tempest-VolumesDeleteCascade-1327545507 None] Volume 84454ebd-52b1-44be-bd07-01b688bbfa80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84454ebd-52b1-44be-bd07-01b688bbfa80', 'volume_size': 1} Sep 28 11:51:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6436f98b-8d18-4c3e-9adf-742dcb04d94e tempest-VolumesDeleteCascade-1327545507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:51:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6436f98b-8d18-4c3e-9adf-742dcb04d94e tempest-VolumesDeleteCascade-1327545507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:51:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6436f98b-8d18-4c3e-9adf-742dcb04d94e tempest-VolumesDeleteCascade-1327545507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:51:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1986082203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84454ebd-52b1-44be-bd07-01b688bbfa80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be9b4aa4dda449d48945e146bebbace1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:51:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:51:00Z,use_quota=True,user_id='cb377f6b54ea4fe4b81997dda5ec5149',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:51:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-6436f98b-8d18-4c3e-9adf-742dcb04d94e tempest-VolumesDeleteCascade-1327545507 None] Creating volume 84454ebd-52b1-44be-bd07-01b688bbfa80 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:51:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6436f98b-8d18-4c3e-9adf-742dcb04d94e tempest-VolumesDeleteCascade-1327545507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:51:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6436f98b-8d18-4c3e-9adf-742dcb04d94e tempest-VolumesDeleteCascade-1327545507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:51:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6436f98b-8d18-4c3e-9adf-742dcb04d94e tempest-VolumesDeleteCascade-1327545507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:51:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6436f98b-8d18-4c3e-9adf-742dcb04d94e tempest-VolumesDeleteCascade-1327545507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:51:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6436f98b-8d18-4c3e-9adf-742dcb04d94e tempest-VolumesDeleteCascade-1327545507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:51:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6436f98b-8d18-4c3e-9adf-742dcb04d94e tempest-VolumesDeleteCascade-1327545507 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:51:00 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-6436f98b-8d18-4c3e-9adf-742dcb04d94e tempest-VolumesDeleteCascade-1327545507 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:51:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6436f98b-8d18-4c3e-9adf-742dcb04d94e tempest-VolumesDeleteCascade-1327545507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-84454ebd-52b1-44be-bd07-01b688bbfa80 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:51:00 devstack sudo[94140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-84454ebd-52b1-44be-bd07-01b688bbfa80 1073741824 Sep 28 11:51:00 devstack sudo[94140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:51:00 devstack sudo[94140]: pam_unix(sudo:session): session closed for user root Sep 28 11:51:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6436f98b-8d18-4c3e-9adf-742dcb04d94e tempest-VolumesDeleteCascade-1327545507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-84454ebd-52b1-44be-bd07-01b688bbfa80 1073741824" returned: 0 in 0.533s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:51:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6436f98b-8d18-4c3e-9adf-742dcb04d94e tempest-VolumesDeleteCascade-1327545507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-84454ebd-52b1-44be-bd07-01b688bbfa80 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:51:00 devstack sudo[94152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-84454ebd-52b1-44be-bd07-01b688bbfa80 Sep 28 11:51:00 devstack sudo[94152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:51:01 devstack sudo[94152]: pam_unix(sudo:session): session closed for user root Sep 28 11:51:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6436f98b-8d18-4c3e-9adf-742dcb04d94e tempest-VolumesDeleteCascade-1327545507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-84454ebd-52b1-44be-bd07-01b688bbfa80" returned: 0 in 0.292s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:51:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6436f98b-8d18-4c3e-9adf-742dcb04d94e tempest-VolumesDeleteCascade-1327545507 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:51:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6436f98b-8d18-4c3e-9adf-742dcb04d94e tempest-VolumesDeleteCascade-1327545507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:51:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6436f98b-8d18-4c3e-9adf-742dcb04d94e tempest-VolumesDeleteCascade-1327545507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04951f60-2eab-428a-a9bb-8061af940a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84454ebd-52b1-44be-bd07-01b688bbfa80', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:51:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6436f98b-8d18-4c3e-9adf-742dcb04d94e tempest-VolumesDeleteCascade-1327545507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0963016b-fcf8-4bef-b0a6-f3a0d98160ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:51:01 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-6436f98b-8d18-4c3e-9adf-742dcb04d94e tempest-VolumesDeleteCascade-1327545507 None] Volume volume-84454ebd-52b1-44be-bd07-01b688bbfa80 (84454ebd-52b1-44be-bd07-01b688bbfa80): created successfully Sep 28 11:51:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6436f98b-8d18-4c3e-9adf-742dcb04d94e tempest-VolumesDeleteCascade-1327545507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0963016b-fcf8-4bef-b0a6-f3a0d98160ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:51:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6436f98b-8d18-4c3e-9adf-742dcb04d94e tempest-VolumesDeleteCascade-1327545507 None] Flow 'volume_create_manager' (f96403c1-976a-4987-a6f4-92c50534a578) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:51:01 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-6436f98b-8d18-4c3e-9adf-742dcb04d94e tempest-VolumesDeleteCascade-1327545507 None] Created volume successfully. Sep 28 11:51:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e63ec616-01cb-4504-b546-0c857a342ac9 tempest-VolumesDeleteCascade-1327545507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:51:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e63ec616-01cb-4504-b546-0c857a342ac9 tempest-VolumesDeleteCascade-1327545507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:51:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-e63ec616-01cb-4504-b546-0c857a342ac9 tempest-VolumesDeleteCascade-1327545507 None] Creating offline snapshot 6dd09bc5-4e45-42b7-8f5f-d8264eccbd2c of volume 84454ebd-52b1-44be-bd07-01b688bbfa80 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 11:51:02 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ef3917-fc5c-4427-b0f5-fc87523e4e0d]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:51:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e63ec616-01cb-4504-b546-0c857a342ac9 tempest-VolumesDeleteCascade-1327545507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-84454ebd-52b1-44be-bd07-01b688bbfa80 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:51:02 devstack sudo[94155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-84454ebd-52b1-44be-bd07-01b688bbfa80 Sep 28 11:51:02 devstack sudo[94155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:51:02 devstack sudo[94155]: pam_unix(sudo:session): session closed for user root Sep 28 11:51:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e63ec616-01cb-4504-b546-0c857a342ac9 tempest-VolumesDeleteCascade-1327545507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-84454ebd-52b1-44be-bd07-01b688bbfa80" returned: 0 in 0.403s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:51:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e63ec616-01cb-4504-b546-0c857a342ac9 tempest-VolumesDeleteCascade-1327545507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-84454ebd-52b1-44be-bd07-01b688bbfa80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-84454ebd-52b1-44be-bd07-01b688bbfa80.6dd09bc5-4e45-42b7-8f5f-d8264eccbd2c 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:51:02 devstack sudo[94194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-84454ebd-52b1-44be-bd07-01b688bbfa80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-84454ebd-52b1-44be-bd07-01b688bbfa80.6dd09bc5-4e45-42b7-8f5f-d8264eccbd2c 1G Sep 28 11:51:02 devstack sudo[94194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:51:03 devstack sudo[94194]: pam_unix(sudo:session): session closed for user root Sep 28 11:51:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e63ec616-01cb-4504-b546-0c857a342ac9 tempest-VolumesDeleteCascade-1327545507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-84454ebd-52b1-44be-bd07-01b688bbfa80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-84454ebd-52b1-44be-bd07-01b688bbfa80.6dd09bc5-4e45-42b7-8f5f-d8264eccbd2c 1G" returned: 0 in 0.482s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:51:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e63ec616-01cb-4504-b546-0c857a342ac9 tempest-VolumesDeleteCascade-1327545507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84454ebd-52b1-44be-bd07-01b688bbfa80 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-84454ebd-52b1-44be-bd07-01b688bbfa80.6dd09bc5-4e45-42b7-8f5f-d8264eccbd2c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:51:03 devstack sudo[94210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84454ebd-52b1-44be-bd07-01b688bbfa80 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-84454ebd-52b1-44be-bd07-01b688bbfa80.6dd09bc5-4e45-42b7-8f5f-d8264eccbd2c Sep 28 11:51:03 devstack sudo[94210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:51:03 devstack sudo[94210]: pam_unix(sudo:session): session closed for user root Sep 28 11:51:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e63ec616-01cb-4504-b546-0c857a342ac9 tempest-VolumesDeleteCascade-1327545507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84454ebd-52b1-44be-bd07-01b688bbfa80 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-84454ebd-52b1-44be-bd07-01b688bbfa80.6dd09bc5-4e45-42b7-8f5f-d8264eccbd2c" returned: 0 in 0.313s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:51:03 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-e63ec616-01cb-4504-b546-0c857a342ac9 tempest-VolumesDeleteCascade-1327545507 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-84454ebd-52b1-44be-bd07-01b688bbfa80.6dd09bc5-4e45-42b7-8f5f-d8264eccbd2c is being set with open permissions: ugo+rw Sep 28 11:51:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e63ec616-01cb-4504-b546-0c857a342ac9 tempest-VolumesDeleteCascade-1327545507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-84454ebd-52b1-44be-bd07-01b688bbfa80.6dd09bc5-4e45-42b7-8f5f-d8264eccbd2c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:51:03 devstack sudo[94222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-84454ebd-52b1-44be-bd07-01b688bbfa80.6dd09bc5-4e45-42b7-8f5f-d8264eccbd2c Sep 28 11:51:03 devstack sudo[94222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:51:03 devstack sudo[94222]: pam_unix(sudo:session): session closed for user root Sep 28 11:51:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e63ec616-01cb-4504-b546-0c857a342ac9 tempest-VolumesDeleteCascade-1327545507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-84454ebd-52b1-44be-bd07-01b688bbfa80.6dd09bc5-4e45-42b7-8f5f-d8264eccbd2c" returned: 0 in 0.249s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:51:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e63ec616-01cb-4504-b546-0c857a342ac9 tempest-VolumesDeleteCascade-1327545507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-84454ebd-52b1-44be-bd07-01b688bbfa80.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:51:04 devstack sudo[94231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-84454ebd-52b1-44be-bd07-01b688bbfa80.info Sep 28 11:51:04 devstack sudo[94231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:51:04 devstack sudo[94231]: pam_unix(sudo:session): session closed for user root Sep 28 11:51:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e63ec616-01cb-4504-b546-0c857a342ac9 tempest-VolumesDeleteCascade-1327545507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-84454ebd-52b1-44be-bd07-01b688bbfa80.info" returned: 0 in 0.297s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:51:04 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-e63ec616-01cb-4504-b546-0c857a342ac9 tempest-VolumesDeleteCascade-1327545507 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-84454ebd-52b1-44be-bd07-01b688bbfa80.info is being set with open permissions: ugo+rw Sep 28 11:51:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e63ec616-01cb-4504-b546-0c857a342ac9 tempest-VolumesDeleteCascade-1327545507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-84454ebd-52b1-44be-bd07-01b688bbfa80.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:51:04 devstack sudo[94240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-84454ebd-52b1-44be-bd07-01b688bbfa80.info Sep 28 11:51:04 devstack sudo[94240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:51:04 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c56b69c-4bdc-4926-9f01-0c44efc85743 tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:51:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6c56b69c-4bdc-4926-9f01-0c44efc85743 tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] Flow 'volume_create_manager' (a66541c3-b066-4373-a1c7-3ff8bb3afd3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:51:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6c56b69c-4bdc-4926-9f01-0c44efc85743 tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c24c4e5-028b-4e3c-b1f1-170d87cdba09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:51:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6c56b69c-4bdc-4926-9f01-0c44efc85743 tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c24c4e5-028b-4e3c-b1f1-170d87cdba09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-803056562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1997bb0-4029-4723-8f7e-a3148cf431eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2616f436eef4997ae6cd699160f9041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:51:04Z,use_quota=True,user_id='27f04fbb9e714c6088eee4b81777f058',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:51:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6c56b69c-4bdc-4926-9f01-0c44efc85743 tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9f5c048-2262-45fa-9758-926780ebf6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:51:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6c56b69c-4bdc-4926-9f01-0c44efc85743 tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9f5c048-2262-45fa-9758-926780ebf6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:51:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6c56b69c-4bdc-4926-9f01-0c44efc85743 tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (276ba04e-acb3-4cf3-8aa5-c6d8884acced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:51:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6c56b69c-4bdc-4926-9f01-0c44efc85743 tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (276ba04e-acb3-4cf3-8aa5-c6d8884acced) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1997bb0-4029-4723-8f7e-a3148cf431eb', 'volume_name': 'volume-f1997bb0-4029-4723-8f7e-a3148cf431eb', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:51:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6c56b69c-4bdc-4926-9f01-0c44efc85743 tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d83df002-892e-4f23-9d28-3f53b33948ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:51:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6c56b69c-4bdc-4926-9f01-0c44efc85743 tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d83df002-892e-4f23-9d28-3f53b33948ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:51:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6c56b69c-4bdc-4926-9f01-0c44efc85743 tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d332510-a1ed-479b-adac-85d42c56f066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:51:04 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-6c56b69c-4bdc-4926-9f01-0c44efc85743 tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] Volume f1997bb0-4029-4723-8f7e-a3148cf431eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1997bb0-4029-4723-8f7e-a3148cf431eb', 'volume_size': 1} Sep 28 11:51:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6c56b69c-4bdc-4926-9f01-0c44efc85743 tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:51:04 devstack sudo[94240]: pam_unix(sudo:session): session closed for user root Sep 28 11:51:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e63ec616-01cb-4504-b546-0c857a342ac9 tempest-VolumesDeleteCascade-1327545507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-84454ebd-52b1-44be-bd07-01b688bbfa80.info" returned: 0 in 0.263s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:51:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e63ec616-01cb-4504-b546-0c857a342ac9 tempest-VolumesDeleteCascade-1327545507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.121s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:51:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6c56b69c-4bdc-4926-9f01-0c44efc85743 tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.177s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:51:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6c56b69c-4bdc-4926-9f01-0c44efc85743 tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-803056562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1997bb0-4029-4723-8f7e-a3148cf431eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2616f436eef4997ae6cd699160f9041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:51:04Z,use_quota=True,user_id='27f04fbb9e714c6088eee4b81777f058',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:51:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-6c56b69c-4bdc-4926-9f01-0c44efc85743 tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] Creating volume f1997bb0-4029-4723-8f7e-a3148cf431eb {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:51:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6c56b69c-4bdc-4926-9f01-0c44efc85743 tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:51:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6c56b69c-4bdc-4926-9f01-0c44efc85743 tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:51:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6c56b69c-4bdc-4926-9f01-0c44efc85743 tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:51:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6c56b69c-4bdc-4926-9f01-0c44efc85743 tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:51:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6c56b69c-4bdc-4926-9f01-0c44efc85743 tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:51:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6c56b69c-4bdc-4926-9f01-0c44efc85743 tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:51:04 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-6c56b69c-4bdc-4926-9f01-0c44efc85743 tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:51:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6c56b69c-4bdc-4926-9f01-0c44efc85743 tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f1997bb0-4029-4723-8f7e-a3148cf431eb 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:51:04 devstack sudo[94249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f1997bb0-4029-4723-8f7e-a3148cf431eb 1073741824 Sep 28 11:51:04 devstack sudo[94249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:51:04 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e63ec616-01cb-4504-b546-0c857a342ac9 tempest-VolumesDeleteCascade-1327545507 None] Create snapshot completed successfully Sep 28 11:51:05 devstack sudo[94249]: pam_unix(sudo:session): session closed for user root Sep 28 11:51:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6c56b69c-4bdc-4926-9f01-0c44efc85743 tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f1997bb0-4029-4723-8f7e-a3148cf431eb 1073741824" returned: 0 in 0.448s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:51:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6c56b69c-4bdc-4926-9f01-0c44efc85743 tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f1997bb0-4029-4723-8f7e-a3148cf431eb {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:51:05 devstack sudo[94255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f1997bb0-4029-4723-8f7e-a3148cf431eb Sep 28 11:51:05 devstack sudo[94255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:51:05 devstack sudo[94255]: pam_unix(sudo:session): session closed for user root Sep 28 11:51:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6c56b69c-4bdc-4926-9f01-0c44efc85743 tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f1997bb0-4029-4723-8f7e-a3148cf431eb" returned: 0 in 0.250s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:51:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6c56b69c-4bdc-4926-9f01-0c44efc85743 tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:51:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6c56b69c-4bdc-4926-9f01-0c44efc85743 tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:51:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6c56b69c-4bdc-4926-9f01-0c44efc85743 tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d332510-a1ed-479b-adac-85d42c56f066) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1997bb0-4029-4723-8f7e-a3148cf431eb', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:51:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6c56b69c-4bdc-4926-9f01-0c44efc85743 tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (593419ec-31cb-4352-94c7-0c9d4ef43804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:51:05 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-6c56b69c-4bdc-4926-9f01-0c44efc85743 tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] Volume volume-f1997bb0-4029-4723-8f7e-a3148cf431eb (f1997bb0-4029-4723-8f7e-a3148cf431eb): created successfully Sep 28 11:51:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6c56b69c-4bdc-4926-9f01-0c44efc85743 tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (593419ec-31cb-4352-94c7-0c9d4ef43804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:51:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6c56b69c-4bdc-4926-9f01-0c44efc85743 tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] Flow 'volume_create_manager' (a66541c3-b066-4373-a1c7-3ff8bb3afd3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:51:05 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-6c56b69c-4bdc-4926-9f01-0c44efc85743 tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] Created volume successfully. Sep 28 11:51:06 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-d606aa7b-b53d-4547-a1be-afde133eeee4 tempest-VolumesDeleteCascade-1327545507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:51:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d606aa7b-b53d-4547-a1be-afde133eeee4 tempest-VolumesDeleteCascade-1327545507 None] Flow 'volume_create_manager' (d116030e-5521-41f5-ab44-b492864f6530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:51:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d606aa7b-b53d-4547-a1be-afde133eeee4 tempest-VolumesDeleteCascade-1327545507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcb058e9-6d3d-455d-8a43-3fa00128d770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:51:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d606aa7b-b53d-4547-a1be-afde133eeee4 tempest-VolumesDeleteCascade-1327545507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcb058e9-6d3d-455d-8a43-3fa00128d770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:51:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1577392122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c837ad4-855d-40ca-942b-ddbfa96f9cef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be9b4aa4dda449d48945e146bebbace1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:51:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6dd09bc5-4e45-42b7-8f5f-d8264eccbd2c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:51:06Z,use_quota=True,user_id='cb377f6b54ea4fe4b81997dda5ec5149',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:51:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d606aa7b-b53d-4547-a1be-afde133eeee4 tempest-VolumesDeleteCascade-1327545507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf851988-22fc-4747-8e66-fc5d76dfda46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:51:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d606aa7b-b53d-4547-a1be-afde133eeee4 tempest-VolumesDeleteCascade-1327545507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf851988-22fc-4747-8e66-fc5d76dfda46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:51:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d606aa7b-b53d-4547-a1be-afde133eeee4 tempest-VolumesDeleteCascade-1327545507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5c8248f-1b9e-4321-983a-f968d958cb29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:51:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d606aa7b-b53d-4547-a1be-afde133eeee4 tempest-VolumesDeleteCascade-1327545507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5c8248f-1b9e-4321-983a-f968d958cb29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0c837ad4-855d-40ca-942b-ddbfa96f9cef', 'volume_name': 'volume-0c837ad4-855d-40ca-942b-ddbfa96f9cef', 'volume_size': 1, 'snapshot_id': '6dd09bc5-4e45-42b7-8f5f-d8264eccbd2c'}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:51:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d606aa7b-b53d-4547-a1be-afde133eeee4 tempest-VolumesDeleteCascade-1327545507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e52cad38-c5dd-4a38-bbc8-10438cb25388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:51:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d606aa7b-b53d-4547-a1be-afde133eeee4 tempest-VolumesDeleteCascade-1327545507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e52cad38-c5dd-4a38-bbc8-10438cb25388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:51:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d606aa7b-b53d-4547-a1be-afde133eeee4 tempest-VolumesDeleteCascade-1327545507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57b36893-3ee2-4332-a2f3-577f0d9b2988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:51:06 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-d606aa7b-b53d-4547-a1be-afde133eeee4 tempest-VolumesDeleteCascade-1327545507 None] Volume 0c837ad4-855d-40ca-942b-ddbfa96f9cef: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0c837ad4-855d-40ca-942b-ddbfa96f9cef', 'volume_size': 1, 'snapshot_id': '6dd09bc5-4e45-42b7-8f5f-d8264eccbd2c'} Sep 28 11:51:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d606aa7b-b53d-4547-a1be-afde133eeee4 tempest-VolumesDeleteCascade-1327545507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:51:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d606aa7b-b53d-4547-a1be-afde133eeee4 tempest-VolumesDeleteCascade-1327545507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:51:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d606aa7b-b53d-4547-a1be-afde133eeee4 tempest-VolumesDeleteCascade-1327545507 None] Acquiring lock "cinder-quobyte-6dd09bc5-4e45-42b7-8f5f-d8264eccbd2c-0c837ad4-855d-40ca-942b-ddbfa96f9cef" by "_create_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:51:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d606aa7b-b53d-4547-a1be-afde133eeee4 tempest-VolumesDeleteCascade-1327545507 None] Lock "cinder-quobyte-6dd09bc5-4e45-42b7-8f5f-d8264eccbd2c-0c837ad4-855d-40ca-942b-ddbfa96f9cef" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:51:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d606aa7b-b53d-4547-a1be-afde133eeee4 tempest-VolumesDeleteCascade-1327545507 None] Creating volume 0c837ad4-855d-40ca-942b-ddbfa96f9cef from snapshot 6dd09bc5-4e45-42b7-8f5f-d8264eccbd2c {{(pid=86916) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 11:51:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d606aa7b-b53d-4547-a1be-afde133eeee4 tempest-VolumesDeleteCascade-1327545507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:51:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d606aa7b-b53d-4547-a1be-afde133eeee4 tempest-VolumesDeleteCascade-1327545507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:51:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d606aa7b-b53d-4547-a1be-afde133eeee4 tempest-VolumesDeleteCascade-1327545507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:51:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d606aa7b-b53d-4547-a1be-afde133eeee4 tempest-VolumesDeleteCascade-1327545507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:51:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d606aa7b-b53d-4547-a1be-afde133eeee4 tempest-VolumesDeleteCascade-1327545507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:51:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d606aa7b-b53d-4547-a1be-afde133eeee4 tempest-VolumesDeleteCascade-1327545507 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:51:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d606aa7b-b53d-4547-a1be-afde133eeee4 tempest-VolumesDeleteCascade-1327545507 None] Acquiring lock "cinder-quobyte-0c837ad4-855d-40ca-942b-ddbfa96f9cef" by "_copy_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:51:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d606aa7b-b53d-4547-a1be-afde133eeee4 tempest-VolumesDeleteCascade-1327545507 None] Lock "cinder-quobyte-0c837ad4-855d-40ca-942b-ddbfa96f9cef" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:51:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d606aa7b-b53d-4547-a1be-afde133eeee4 tempest-VolumesDeleteCascade-1327545507 None] snapshot: 6dd09bc5-4e45-42b7-8f5f-d8264eccbd2c, volume: 0c837ad4-855d-40ca-942b-ddbfa96f9cef, {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 11:51:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d606aa7b-b53d-4547-a1be-afde133eeee4 tempest-VolumesDeleteCascade-1327545507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:51:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d606aa7b-b53d-4547-a1be-afde133eeee4 tempest-VolumesDeleteCascade-1327545507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:51:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d606aa7b-b53d-4547-a1be-afde133eeee4 tempest-VolumesDeleteCascade-1327545507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:51:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d606aa7b-b53d-4547-a1be-afde133eeee4 tempest-VolumesDeleteCascade-1327545507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:51:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d606aa7b-b53d-4547-a1be-afde133eeee4 tempest-VolumesDeleteCascade-1327545507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:51:06 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac610143-a1fb-4b47-b07c-58eced321488]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:51:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d606aa7b-b53d-4547-a1be-afde133eeee4 tempest-VolumesDeleteCascade-1327545507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-84454ebd-52b1-44be-bd07-01b688bbfa80.6dd09bc5-4e45-42b7-8f5f-d8264eccbd2c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:51:06 devstack sudo[94258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-84454ebd-52b1-44be-bd07-01b688bbfa80.6dd09bc5-4e45-42b7-8f5f-d8264eccbd2c Sep 28 11:51:06 devstack sudo[94258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:51:06 devstack sudo[94258]: pam_unix(sudo:session): session closed for user root Sep 28 11:51:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d606aa7b-b53d-4547-a1be-afde133eeee4 tempest-VolumesDeleteCascade-1327545507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-84454ebd-52b1-44be-bd07-01b688bbfa80.6dd09bc5-4e45-42b7-8f5f-d8264eccbd2c" returned: 0 in 0.442s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:51:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-d606aa7b-b53d-4547-a1be-afde133eeee4 tempest-VolumesDeleteCascade-1327545507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84454ebd-52b1-44be-bd07-01b688bbfa80(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 11:51:06 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eeee2dc-43df-43fc-a8e7-2db1713369de]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:51:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d606aa7b-b53d-4547-a1be-afde133eeee4 tempest-VolumesDeleteCascade-1327545507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-84454ebd-52b1-44be-bd07-01b688bbfa80 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:51:07 devstack sudo[94269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-84454ebd-52b1-44be-bd07-01b688bbfa80 Sep 28 11:51:07 devstack sudo[94269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:51:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-478c4f51-4f9f-4c28-9fce-c667b18a9f46 req-2e7ae548-f036-452a-93ff-73b1809d62bb tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:51:07 devstack sudo[94269]: pam_unix(sudo:session): session closed for user root Sep 28 11:51:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d606aa7b-b53d-4547-a1be-afde133eeee4 tempest-VolumesDeleteCascade-1327545507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-84454ebd-52b1-44be-bd07-01b688bbfa80" returned: 0 in 0.555s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:51:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d606aa7b-b53d-4547-a1be-afde133eeee4 tempest-VolumesDeleteCascade-1327545507 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-84454ebd-52b1-44be-bd07-01b688bbfa80 {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 11:51:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d606aa7b-b53d-4547-a1be-afde133eeee4 tempest-VolumesDeleteCascade-1327545507 None] Creating direct copy from snapshot {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 11:51:07 devstack cinder-volume[86916]: DEBUG cinder.utils [None req-d606aa7b-b53d-4547-a1be-afde133eeee4 tempest-VolumesDeleteCascade-1327545507 None] Path /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-0c837ad4-855d-40ca-942b-ddbfa96f9cef not found in is_blk_device check {{(pid=86916) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 11:51:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d606aa7b-b53d-4547-a1be-afde133eeee4 tempest-VolumesDeleteCascade-1327545507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-84454ebd-52b1-44be-bd07-01b688bbfa80 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-0c837ad4-855d-40ca-942b-ddbfa96f9cef {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:51:07 devstack sudo[94282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-84454ebd-52b1-44be-bd07-01b688bbfa80 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-0c837ad4-855d-40ca-942b-ddbfa96f9cef Sep 28 11:51:07 devstack sudo[94282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:51:16 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-1f597c26-73e3-438f-a9a6-a19d34201a9e req-b44adb7f-d90c-4b4d-891f-919567e01ebd tempest-ServerActionsTestOtherA-485250721 None] Terminate volume connection completed successfully. Sep 28 11:51:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-1f597c26-73e3-438f-a9a6-a19d34201a9e req-b44adb7f-d90c-4b4d-891f-919567e01ebd tempest-ServerActionsTestOtherA-485250721 None] Deleting attachment 045a5338-fa2e-4692-85f8-6b1bb1aa4a06. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 11:51:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-1f597c26-73e3-438f-a9a6-a19d34201a9e req-4ed590ff-e068-4073-ac0a-a2762dfb49fc tempest-ServerActionsTestOtherA-485250721 None] Acquiring lock "cinder-cd9e0651-e181-4ea4-b214-7bb0653b528e-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:51:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-1f597c26-73e3-438f-a9a6-a19d34201a9e req-4ed590ff-e068-4073-ac0a-a2762dfb49fc tempest-ServerActionsTestOtherA-485250721 None] Lock "cinder-cd9e0651-e181-4ea4-b214-7bb0653b528e-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:51:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-1f597c26-73e3-438f-a9a6-a19d34201a9e req-4ed590ff-e068-4073-ac0a-a2762dfb49fc tempest-ServerActionsTestOtherA-485250721 None] Acquiring lock "cinder-quobyte-cd9e0651-e181-4ea4-b214-7bb0653b528e" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:51:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-1f597c26-73e3-438f-a9a6-a19d34201a9e req-4ed590ff-e068-4073-ac0a-a2762dfb49fc tempest-ServerActionsTestOtherA-485250721 None] Lock "cinder-quobyte-cd9e0651-e181-4ea4-b214-7bb0653b528e" acquired by "delete_volume" :: waited 0.030s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:51:16 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[9499de6e-2efa-41ab-9580-45c59ebe5fa8]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:51:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-1f597c26-73e3-438f-a9a6-a19d34201a9e req-4ed590ff-e068-4073-ac0a-a2762dfb49fc tempest-ServerActionsTestOtherA-485250721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cd9e0651-e181-4ea4-b214-7bb0653b528e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:51:16 devstack sudo[94282]: pam_unix(sudo:session): session closed for user root Sep 28 11:51:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d606aa7b-b53d-4547-a1be-afde133eeee4 tempest-VolumesDeleteCascade-1327545507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-84454ebd-52b1-44be-bd07-01b688bbfa80 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-0c837ad4-855d-40ca-942b-ddbfa96f9cef" returned: 0 in 9.468s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:51:16 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-d606aa7b-b53d-4547-a1be-afde133eeee4 tempest-VolumesDeleteCascade-1327545507 None] Image conversion details: src /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-84454ebd-52b1-44be-bd07-01b688bbfa80, size 1024.00 MB, duration 9.47 sec, destination /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-0c837ad4-855d-40ca-942b-ddbfa96f9cef {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 11:51:16 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-d606aa7b-b53d-4547-a1be-afde133eeee4 tempest-VolumesDeleteCascade-1327545507 None] Converted 1024.00 MB image at 108.13 MB/s Sep 28 11:51:16 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-d606aa7b-b53d-4547-a1be-afde133eeee4 tempest-VolumesDeleteCascade-1327545507 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-0c837ad4-855d-40ca-942b-ddbfa96f9cef is being set with open permissions: ugo+rw Sep 28 11:51:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d606aa7b-b53d-4547-a1be-afde133eeee4 tempest-VolumesDeleteCascade-1327545507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-0c837ad4-855d-40ca-942b-ddbfa96f9cef {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:51:16 devstack sudo[94378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-0c837ad4-855d-40ca-942b-ddbfa96f9cef Sep 28 11:51:16 devstack sudo[94378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:51:16 devstack sudo[94377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cd9e0651-e181-4ea4-b214-7bb0653b528e Sep 28 11:51:16 devstack sudo[94377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:51:17 devstack sudo[94378]: pam_unix(sudo:session): session closed for user root Sep 28 11:51:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d606aa7b-b53d-4547-a1be-afde133eeee4 tempest-VolumesDeleteCascade-1327545507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-0c837ad4-855d-40ca-942b-ddbfa96f9cef" returned: 0 in 0.302s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:51:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d606aa7b-b53d-4547-a1be-afde133eeee4 tempest-VolumesDeleteCascade-1327545507 None] Lock "cinder-quobyte-0c837ad4-855d-40ca-942b-ddbfa96f9cef" released by "_copy_volume_from_snapshot" :: held 10.883s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:51:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d606aa7b-b53d-4547-a1be-afde133eeee4 tempest-VolumesDeleteCascade-1327545507 None] Lock "cinder-quobyte-6dd09bc5-4e45-42b7-8f5f-d8264eccbd2c-0c837ad4-855d-40ca-942b-ddbfa96f9cef" released by "_create_volume_from_snapshot" :: held 10.973s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:51:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d606aa7b-b53d-4547-a1be-afde133eeee4 tempest-VolumesDeleteCascade-1327545507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.993s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:51:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-478c4f51-4f9f-4c28-9fce-c667b18a9f46 req-2e7ae548-f036-452a-93ff-73b1809d62bb tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 10.004s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:51:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-478c4f51-4f9f-4c28-9fce-c667b18a9f46 req-2e7ae548-f036-452a-93ff-73b1809d62bb tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:51:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d606aa7b-b53d-4547-a1be-afde133eeee4 tempest-VolumesDeleteCascade-1327545507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57b36893-3ee2-4332-a2f3-577f0d9b2988) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c837ad4-855d-40ca-942b-ddbfa96f9cef', 'volume_size': 1, 'snapshot_id': '6dd09bc5-4e45-42b7-8f5f-d8264eccbd2c'}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:51:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d606aa7b-b53d-4547-a1be-afde133eeee4 tempest-VolumesDeleteCascade-1327545507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3023eff2-70cc-45b7-922a-0e868deb3a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:51:17 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-d606aa7b-b53d-4547-a1be-afde133eeee4 tempest-VolumesDeleteCascade-1327545507 None] Volume volume-0c837ad4-855d-40ca-942b-ddbfa96f9cef (0c837ad4-855d-40ca-942b-ddbfa96f9cef): created successfully Sep 28 11:51:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d606aa7b-b53d-4547-a1be-afde133eeee4 tempest-VolumesDeleteCascade-1327545507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3023eff2-70cc-45b7-922a-0e868deb3a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:51:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d606aa7b-b53d-4547-a1be-afde133eeee4 tempest-VolumesDeleteCascade-1327545507 None] Flow 'volume_create_manager' (d116030e-5521-41f5-ab44-b492864f6530) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:51:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-478c4f51-4f9f-4c28-9fce-c667b18a9f46 req-2e7ae548-f036-452a-93ff-73b1809d62bb tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0', 'name': 'volume-f1997bb0-4029-4723-8f7e-a3148cf431eb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1a2897cc-9d5d-4d00-9f4c-25ac7fb601bf', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 11:51:17 devstack sudo[94377]: pam_unix(sudo:session): session closed for user root Sep 28 11:51:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-1f597c26-73e3-438f-a9a6-a19d34201a9e req-4ed590ff-e068-4073-ac0a-a2762dfb49fc tempest-ServerActionsTestOtherA-485250721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cd9e0651-e181-4ea4-b214-7bb0653b528e" returned: 0 in 0.559s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:51:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-1f597c26-73e3-438f-a9a6-a19d34201a9e req-4ed590ff-e068-4073-ac0a-a2762dfb49fc tempest-ServerActionsTestOtherA-485250721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cd9e0651-e181-4ea4-b214-7bb0653b528e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:51:17 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-d606aa7b-b53d-4547-a1be-afde133eeee4 tempest-VolumesDeleteCascade-1327545507 None] Created volume successfully. Sep 28 11:51:17 devstack sudo[94385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cd9e0651-e181-4ea4-b214-7bb0653b528e Sep 28 11:51:17 devstack sudo[94385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:51:17 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-478c4f51-4f9f-4c28-9fce-c667b18a9f46 req-2e7ae548-f036-452a-93ff-73b1809d62bb tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] attachment_update completed successfully. Sep 28 11:51:17 devstack sudo[94385]: pam_unix(sudo:session): session closed for user root Sep 28 11:51:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-1f597c26-73e3-438f-a9a6-a19d34201a9e req-4ed590ff-e068-4073-ac0a-a2762dfb49fc tempest-ServerActionsTestOtherA-485250721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cd9e0651-e181-4ea4-b214-7bb0653b528e" returned: 0 in 0.322s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:51:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-1f597c26-73e3-438f-a9a6-a19d34201a9e req-4ed590ff-e068-4073-ac0a-a2762dfb49fc tempest-ServerActionsTestOtherA-485250721 None] Lock "cinder-quobyte-cd9e0651-e181-4ea4-b214-7bb0653b528e" released by "delete_volume" :: held 0.979s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:51:17 devstack cinder-volume[86916]: DEBUG cinder.quota [req-1f597c26-73e3-438f-a9a6-a19d34201a9e req-4ed590ff-e068-4073-ac0a-a2762dfb49fc tempest-ServerActionsTestOtherA-485250721 None] Created reservations ['be247f67-d421-440e-be0e-ac5cb7698264', '6d8cdbed-2e30-4e82-80fa-f5581c6d115a', '234f5f53-e0ea-43e4-ab43-ec704e9ed0b8', 'b52ef664-8089-44c4-8acb-123f285a5339'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:51:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-1f597c26-73e3-438f-a9a6-a19d34201a9e req-4ed590ff-e068-4073-ac0a-a2762dfb49fc tempest-ServerActionsTestOtherA-485250721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:51:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-1f597c26-73e3-438f-a9a6-a19d34201a9e req-4ed590ff-e068-4073-ac0a-a2762dfb49fc tempest-ServerActionsTestOtherA-485250721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:51:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [req-1f597c26-73e3-438f-a9a6-a19d34201a9e req-4ed590ff-e068-4073-ac0a-a2762dfb49fc tempest-ServerActionsTestOtherA-485250721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:51:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [req-1f597c26-73e3-438f-a9a6-a19d34201a9e req-4ed590ff-e068-4073-ac0a-a2762dfb49fc tempest-ServerActionsTestOtherA-485250721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:51:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-1f597c26-73e3-438f-a9a6-a19d34201a9e req-4ed590ff-e068-4073-ac0a-a2762dfb49fc tempest-ServerActionsTestOtherA-485250721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:51:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-1f597c26-73e3-438f-a9a6-a19d34201a9e req-4ed590ff-e068-4073-ac0a-a2762dfb49fc tempest-ServerActionsTestOtherA-485250721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:51:17 devstack sudo[94394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:51:17 devstack sudo[94394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:51:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-96f5d20d-e997-41f7-a3e7-d612d148b824 tempest-VolumesDeleteCascade-1327545507 None] Acquiring lock "cinder-84454ebd-52b1-44be-bd07-01b688bbfa80-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:51:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-96f5d20d-e997-41f7-a3e7-d612d148b824 tempest-VolumesDeleteCascade-1327545507 None] Lock "cinder-84454ebd-52b1-44be-bd07-01b688bbfa80-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:51:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-96f5d20d-e997-41f7-a3e7-d612d148b824 tempest-VolumesDeleteCascade-1327545507 None] Performing cascade delete. {{(pid=86916) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 28 11:51:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-96f5d20d-e997-41f7-a3e7-d612d148b824 tempest-VolumesDeleteCascade-1327545507 None] Acquiring lock "cinder-6dd09bc5-4e45-42b7-8f5f-d8264eccbd2c-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:51:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-96f5d20d-e997-41f7-a3e7-d612d148b824 tempest-VolumesDeleteCascade-1327545507 None] Lock "cinder-6dd09bc5-4e45-42b7-8f5f-d8264eccbd2c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:51:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-96f5d20d-e997-41f7-a3e7-d612d148b824 tempest-VolumesDeleteCascade-1327545507 None] Acquiring lock "cinder-quobyte-84454ebd-52b1-44be-bd07-01b688bbfa80" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:51:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-96f5d20d-e997-41f7-a3e7-d612d148b824 tempest-VolumesDeleteCascade-1327545507 None] Lock "cinder-quobyte-84454ebd-52b1-44be-bd07-01b688bbfa80" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:51:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-96f5d20d-e997-41f7-a3e7-d612d148b824 tempest-VolumesDeleteCascade-1327545507 None] Acquiring lock "cinder-quobyte-6dd09bc5-4e45-42b7-8f5f-d8264eccbd2c" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:51:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-96f5d20d-e997-41f7-a3e7-d612d148b824 tempest-VolumesDeleteCascade-1327545507 None] Lock "cinder-quobyte-6dd09bc5-4e45-42b7-8f5f-d8264eccbd2c" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:51:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-96f5d20d-e997-41f7-a3e7-d612d148b824 tempest-VolumesDeleteCascade-1327545507 None] Deleting offline snapshot 6dd09bc5-4e45-42b7-8f5f-d8264eccbd2c of volume 84454ebd-52b1-44be-bd07-01b688bbfa80 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 11:51:18 devstack sudo[94394]: pam_unix(sudo:session): session closed for user root Sep 28 11:51:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-96f5d20d-e997-41f7-a3e7-d612d148b824 tempest-VolumesDeleteCascade-1327545507 None] snapshot_file for this snap is: volume-84454ebd-52b1-44be-bd07-01b688bbfa80.6dd09bc5-4e45-42b7-8f5f-d8264eccbd2c {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 11:51:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-1f597c26-73e3-438f-a9a6-a19d34201a9e req-4ed590ff-e068-4073-ac0a-a2762dfb49fc tempest-ServerActionsTestOtherA-485250721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.370s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:51:18 devstack cinder-volume[86916]: DEBUG cinder.manager [req-1f597c26-73e3-438f-a9a6-a19d34201a9e req-4ed590ff-e068-4073-ac0a-a2762dfb49fc tempest-ServerActionsTestOtherA-485250721 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:51:18 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0bd7984-5fc1-41ca-a685-e764361893d9]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:51:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-96f5d20d-e997-41f7-a3e7-d612d148b824 tempest-VolumesDeleteCascade-1327545507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-84454ebd-52b1-44be-bd07-01b688bbfa80.6dd09bc5-4e45-42b7-8f5f-d8264eccbd2c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:51:18 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-1f597c26-73e3-438f-a9a6-a19d34201a9e req-4ed590ff-e068-4073-ac0a-a2762dfb49fc tempest-ServerActionsTestOtherA-485250721 None] Deleted volume successfully. Sep 28 11:51:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-1f597c26-73e3-438f-a9a6-a19d34201a9e req-4ed590ff-e068-4073-ac0a-a2762dfb49fc tempest-ServerActionsTestOtherA-485250721 None] Lock "cinder-cd9e0651-e181-4ea4-b214-7bb0653b528e-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:51:18 devstack sudo[94400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-84454ebd-52b1-44be-bd07-01b688bbfa80.6dd09bc5-4e45-42b7-8f5f-d8264eccbd2c Sep 28 11:51:18 devstack sudo[94400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:51:18 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-c231ded4-fd45-4660-a83f-c03651f45571 req-38442b67-8305-4eaa-9cbd-7391536f805e tempest-AttachVolumeNegativeTest-962283120 None] Terminate volume connection completed successfully. Sep 28 11:51:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-c231ded4-fd45-4660-a83f-c03651f45571 req-38442b67-8305-4eaa-9cbd-7391536f805e tempest-AttachVolumeNegativeTest-962283120 None] Deleting attachment 47e39f2d-f0bf-4d82-8186-53edfb152a41. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 11:51:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-42c3e01f-0f39-4d86-be4b-7e406bdb3d3a tempest-ServerActionsTestOtherA-485250721 None] Acquiring lock "cinder-cd501413-3795-4aa7-bdee-881ab67dd5f7-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:51:18 devstack sudo[94400]: pam_unix(sudo:session): session closed for user root Sep 28 11:51:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-42c3e01f-0f39-4d86-be4b-7e406bdb3d3a tempest-ServerActionsTestOtherA-485250721 None] Lock "cinder-cd501413-3795-4aa7-bdee-881ab67dd5f7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:51:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-96f5d20d-e997-41f7-a3e7-d612d148b824 tempest-VolumesDeleteCascade-1327545507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-84454ebd-52b1-44be-bd07-01b688bbfa80.6dd09bc5-4e45-42b7-8f5f-d8264eccbd2c" returned: 0 in 0.518s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:51:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-96f5d20d-e997-41f7-a3e7-d612d148b824 tempest-VolumesDeleteCascade-1327545507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84454ebd-52b1-44be-bd07-01b688bbfa80(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 11:51:18 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72f9045-4656-4221-87c5-6eff413584cb]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:51:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-96f5d20d-e997-41f7-a3e7-d612d148b824 tempest-VolumesDeleteCascade-1327545507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-84454ebd-52b1-44be-bd07-01b688bbfa80 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:51:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-42c3e01f-0f39-4d86-be4b-7e406bdb3d3a tempest-ServerActionsTestOtherA-485250721 None] Acquiring lock "cinder-quobyte-cd501413-3795-4aa7-bdee-881ab67dd5f7" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:51:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-42c3e01f-0f39-4d86-be4b-7e406bdb3d3a tempest-ServerActionsTestOtherA-485250721 None] Lock "cinder-quobyte-cd501413-3795-4aa7-bdee-881ab67dd5f7" acquired by "delete_volume" :: waited 0.036s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:51:19 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[81730717-9ef2-4510-8db0-e2bae14cd92d]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:51:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-42c3e01f-0f39-4d86-be4b-7e406bdb3d3a tempest-ServerActionsTestOtherA-485250721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cd501413-3795-4aa7-bdee-881ab67dd5f7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:51:19 devstack sudo[94407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-84454ebd-52b1-44be-bd07-01b688bbfa80 Sep 28 11:51:19 devstack sudo[94407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:51:19 devstack sudo[94408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cd501413-3795-4aa7-bdee-881ab67dd5f7 Sep 28 11:51:19 devstack sudo[94408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:51:19 devstack sudo[94408]: pam_unix(sudo:session): session closed for user root Sep 28 11:51:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-42c3e01f-0f39-4d86-be4b-7e406bdb3d3a tempest-ServerActionsTestOtherA-485250721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cd501413-3795-4aa7-bdee-881ab67dd5f7" returned: 0 in 0.508s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:51:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-42c3e01f-0f39-4d86-be4b-7e406bdb3d3a tempest-ServerActionsTestOtherA-485250721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cd501413-3795-4aa7-bdee-881ab67dd5f7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:51:19 devstack sudo[94420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cd501413-3795-4aa7-bdee-881ab67dd5f7 Sep 28 11:51:19 devstack sudo[94420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:51:19 devstack sudo[94407]: pam_unix(sudo:session): session closed for user root Sep 28 11:51:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-96f5d20d-e997-41f7-a3e7-d612d148b824 tempest-VolumesDeleteCascade-1327545507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-84454ebd-52b1-44be-bd07-01b688bbfa80" returned: 0 in 0.691s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:51:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-96f5d20d-e997-41f7-a3e7-d612d148b824 tempest-VolumesDeleteCascade-1327545507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-84454ebd-52b1-44be-bd07-01b688bbfa80.6dd09bc5-4e45-42b7-8f5f-d8264eccbd2c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:51:19 devstack sudo[94425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-84454ebd-52b1-44be-bd07-01b688bbfa80.6dd09bc5-4e45-42b7-8f5f-d8264eccbd2c Sep 28 11:51:19 devstack sudo[94425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:51:19 devstack sudo[94420]: pam_unix(sudo:session): session closed for user root Sep 28 11:51:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-42c3e01f-0f39-4d86-be4b-7e406bdb3d3a tempest-ServerActionsTestOtherA-485250721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cd501413-3795-4aa7-bdee-881ab67dd5f7" returned: 0 in 0.315s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:51:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-42c3e01f-0f39-4d86-be4b-7e406bdb3d3a tempest-ServerActionsTestOtherA-485250721 None] Lock "cinder-quobyte-cd501413-3795-4aa7-bdee-881ab67dd5f7" released by "delete_volume" :: held 0.917s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:51:20 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-42c3e01f-0f39-4d86-be4b-7e406bdb3d3a tempest-ServerActionsTestOtherA-485250721 None] Created reservations ['b5ea5847-e7bf-4b05-9d98-d8c1ccfdd039', 'e759ecdf-e6f0-4896-b7a3-1a5f32b15cd5', 'c963ca92-3ccf-430b-911c-c6e5bc7ebac8', 'faab8baa-77e1-4e1d-84c4-dadc73ac2c41'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:51:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-42c3e01f-0f39-4d86-be4b-7e406bdb3d3a tempest-ServerActionsTestOtherA-485250721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:51:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-42c3e01f-0f39-4d86-be4b-7e406bdb3d3a tempest-ServerActionsTestOtherA-485250721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:51:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-42c3e01f-0f39-4d86-be4b-7e406bdb3d3a tempest-ServerActionsTestOtherA-485250721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:51:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-42c3e01f-0f39-4d86-be4b-7e406bdb3d3a tempest-ServerActionsTestOtherA-485250721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:51:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-42c3e01f-0f39-4d86-be4b-7e406bdb3d3a tempest-ServerActionsTestOtherA-485250721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:51:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-42c3e01f-0f39-4d86-be4b-7e406bdb3d3a tempest-ServerActionsTestOtherA-485250721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:51:20 devstack sudo[94425]: pam_unix(sudo:session): session closed for user root Sep 28 11:51:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-96f5d20d-e997-41f7-a3e7-d612d148b824 tempest-VolumesDeleteCascade-1327545507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-84454ebd-52b1-44be-bd07-01b688bbfa80.6dd09bc5-4e45-42b7-8f5f-d8264eccbd2c" returned: 0 in 0.616s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:51:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-96f5d20d-e997-41f7-a3e7-d612d148b824 tempest-VolumesDeleteCascade-1327545507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-84454ebd-52b1-44be-bd07-01b688bbfa80.6dd09bc5-4e45-42b7-8f5f-d8264eccbd2c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:51:20 devstack sudo[94452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:51:20 devstack sudo[94452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:51:20 devstack sudo[94455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-84454ebd-52b1-44be-bd07-01b688bbfa80.6dd09bc5-4e45-42b7-8f5f-d8264eccbd2c Sep 28 11:51:20 devstack sudo[94455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:51:20 devstack sudo[94452]: pam_unix(sudo:session): session closed for user root Sep 28 11:51:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-42c3e01f-0f39-4d86-be4b-7e406bdb3d3a tempest-ServerActionsTestOtherA-485250721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.460s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:51:20 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-42c3e01f-0f39-4d86-be4b-7e406bdb3d3a tempest-ServerActionsTestOtherA-485250721 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:51:20 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-42c3e01f-0f39-4d86-be4b-7e406bdb3d3a tempest-ServerActionsTestOtherA-485250721 None] Deleted volume successfully. Sep 28 11:51:20 devstack sudo[94455]: pam_unix(sudo:session): session closed for user root Sep 28 11:51:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-96f5d20d-e997-41f7-a3e7-d612d148b824 tempest-VolumesDeleteCascade-1327545507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-84454ebd-52b1-44be-bd07-01b688bbfa80.6dd09bc5-4e45-42b7-8f5f-d8264eccbd2c" returned: 0 in 0.486s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:51:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-96f5d20d-e997-41f7-a3e7-d612d148b824 tempest-VolumesDeleteCascade-1327545507 None] Lock "cinder-quobyte-6dd09bc5-4e45-42b7-8f5f-d8264eccbd2c" released by "_delete_snapshot" :: held 2.484s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:51:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-96f5d20d-e997-41f7-a3e7-d612d148b824 tempest-VolumesDeleteCascade-1327545507 None] Lock "cinder-quobyte-84454ebd-52b1-44be-bd07-01b688bbfa80" released by "delete_snapshot" :: held 2.528s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:51:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-42c3e01f-0f39-4d86-be4b-7e406bdb3d3a tempest-ServerActionsTestOtherA-485250721 None] Lock "cinder-cd501413-3795-4aa7-bdee-881ab67dd5f7-delete_volume" released by "delete_volume" :: held 1.971s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:51:20 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-96f5d20d-e997-41f7-a3e7-d612d148b824 tempest-VolumesDeleteCascade-1327545507 None] Created reservations ['7a9f8c37-ac6d-43a1-8a7a-ee1d4901b245', 'f99ed026-650e-4c2a-8a15-1f3d85db45dc', 'd894cf6c-39d1-44f5-bd54-3726b05276b2', 'fc19de45-9fe1-481e-917d-5fc821537fe4'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:51:21 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-96f5d20d-e997-41f7-a3e7-d612d148b824 tempest-VolumesDeleteCascade-1327545507 None] Delete snapshot completed successfully. Sep 28 11:51:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-96f5d20d-e997-41f7-a3e7-d612d148b824 tempest-VolumesDeleteCascade-1327545507 None] Lock "cinder-6dd09bc5-4e45-42b7-8f5f-d8264eccbd2c-delete_snapshot" released by "delete_snapshot" :: held 2.917s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:51:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-96f5d20d-e997-41f7-a3e7-d612d148b824 tempest-VolumesDeleteCascade-1327545507 None] Snapshots deleted, issuing volume delete {{(pid=86916) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 28 11:51:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-96f5d20d-e997-41f7-a3e7-d612d148b824 tempest-VolumesDeleteCascade-1327545507 None] Acquiring lock "cinder-quobyte-84454ebd-52b1-44be-bd07-01b688bbfa80" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:51:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-96f5d20d-e997-41f7-a3e7-d612d148b824 tempest-VolumesDeleteCascade-1327545507 None] Lock "cinder-quobyte-84454ebd-52b1-44be-bd07-01b688bbfa80" acquired by "delete_volume" :: waited 0.029s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:51:21 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d23d92-7098-488b-917c-4c104cfaeac6]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:51:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-96f5d20d-e997-41f7-a3e7-d612d148b824 tempest-VolumesDeleteCascade-1327545507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-84454ebd-52b1-44be-bd07-01b688bbfa80 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:51:21 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-9f31a60f-aaa1-411c-9819-94343c08111d req-ba673e0a-5637-492a-bd04-f9ca3e0c4b85 tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] Terminate volume connection completed successfully. Sep 28 11:51:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-9f31a60f-aaa1-411c-9819-94343c08111d req-ba673e0a-5637-492a-bd04-f9ca3e0c4b85 tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] Deleting attachment 1a2897cc-9d5d-4d00-9f4c-25ac7fb601bf. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 11:51:21 devstack sudo[94474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-84454ebd-52b1-44be-bd07-01b688bbfa80 Sep 28 11:51:21 devstack sudo[94474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:51:21 devstack sudo[94474]: pam_unix(sudo:session): session closed for user root Sep 28 11:51:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-96f5d20d-e997-41f7-a3e7-d612d148b824 tempest-VolumesDeleteCascade-1327545507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-84454ebd-52b1-44be-bd07-01b688bbfa80" returned: 0 in 0.658s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:51:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-96f5d20d-e997-41f7-a3e7-d612d148b824 tempest-VolumesDeleteCascade-1327545507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-84454ebd-52b1-44be-bd07-01b688bbfa80 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:51:21 devstack sudo[94497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-84454ebd-52b1-44be-bd07-01b688bbfa80 Sep 28 11:51:21 devstack sudo[94497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:51:22 devstack sudo[94497]: pam_unix(sudo:session): session closed for user root Sep 28 11:51:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-96f5d20d-e997-41f7-a3e7-d612d148b824 tempest-VolumesDeleteCascade-1327545507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-84454ebd-52b1-44be-bd07-01b688bbfa80" returned: 0 in 0.272s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:51:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-96f5d20d-e997-41f7-a3e7-d612d148b824 tempest-VolumesDeleteCascade-1327545507 None] Lock "cinder-quobyte-84454ebd-52b1-44be-bd07-01b688bbfa80" released by "delete_volume" :: held 1.050s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:51:22 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-96f5d20d-e997-41f7-a3e7-d612d148b824 tempest-VolumesDeleteCascade-1327545507 None] Created reservations ['2970cb6c-cb42-488d-8a7f-a6539e05a96e', '1f17e063-5ea1-47cf-9438-5fdd6f48d415', 'cef153f2-9203-46d3-ad8a-a2c37ea45cac', '1c2f4389-996f-4eef-ba8b-69bfc8c27441'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:51:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-96f5d20d-e997-41f7-a3e7-d612d148b824 tempest-VolumesDeleteCascade-1327545507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:51:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-96f5d20d-e997-41f7-a3e7-d612d148b824 tempest-VolumesDeleteCascade-1327545507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:51:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-96f5d20d-e997-41f7-a3e7-d612d148b824 tempest-VolumesDeleteCascade-1327545507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:51:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-96f5d20d-e997-41f7-a3e7-d612d148b824 tempest-VolumesDeleteCascade-1327545507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:51:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-96f5d20d-e997-41f7-a3e7-d612d148b824 tempest-VolumesDeleteCascade-1327545507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:51:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-96f5d20d-e997-41f7-a3e7-d612d148b824 tempest-VolumesDeleteCascade-1327545507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:51:22 devstack sudo[94502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:51:22 devstack sudo[94502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:51:22 devstack sudo[94502]: pam_unix(sudo:session): session closed for user root Sep 28 11:51:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-96f5d20d-e997-41f7-a3e7-d612d148b824 tempest-VolumesDeleteCascade-1327545507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.315s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:51:22 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-96f5d20d-e997-41f7-a3e7-d612d148b824 tempest-VolumesDeleteCascade-1327545507 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:51:22 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-96f5d20d-e997-41f7-a3e7-d612d148b824 tempest-VolumesDeleteCascade-1327545507 None] Deleted volume successfully. Sep 28 11:51:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-96f5d20d-e997-41f7-a3e7-d612d148b824 tempest-VolumesDeleteCascade-1327545507 None] Lock "cinder-84454ebd-52b1-44be-bd07-01b688bbfa80-delete_volume" released by "delete_volume" :: held 4.616s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:51:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-80ffcbcd-e06b-4c22-8c20-6e40625bb0f0 tempest-VolumesDeleteCascade-1327545507 None] Acquiring lock "cinder-0c837ad4-855d-40ca-942b-ddbfa96f9cef-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:51:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-80ffcbcd-e06b-4c22-8c20-6e40625bb0f0 tempest-VolumesDeleteCascade-1327545507 None] Lock "cinder-0c837ad4-855d-40ca-942b-ddbfa96f9cef-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:51:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-80ffcbcd-e06b-4c22-8c20-6e40625bb0f0 tempest-VolumesDeleteCascade-1327545507 None] Acquiring lock "cinder-quobyte-0c837ad4-855d-40ca-942b-ddbfa96f9cef" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:51:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-80ffcbcd-e06b-4c22-8c20-6e40625bb0f0 tempest-VolumesDeleteCascade-1327545507 None] Lock "cinder-quobyte-0c837ad4-855d-40ca-942b-ddbfa96f9cef" acquired by "delete_volume" :: waited 0.021s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:51:23 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa37da7-bbbf-4f8c-82e0-f134417fe4f3]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:51:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-80ffcbcd-e06b-4c22-8c20-6e40625bb0f0 tempest-VolumesDeleteCascade-1327545507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-0c837ad4-855d-40ca-942b-ddbfa96f9cef {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:51:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-34c84762-530a-4aa5-aa7e-afecce6aa83b tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] Acquiring lock "cinder-f1997bb0-4029-4723-8f7e-a3148cf431eb-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:51:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-34c84762-530a-4aa5-aa7e-afecce6aa83b tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] Lock "cinder-f1997bb0-4029-4723-8f7e-a3148cf431eb-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:51:23 devstack sudo[94508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-0c837ad4-855d-40ca-942b-ddbfa96f9cef Sep 28 11:51:23 devstack sudo[94508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:51:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-34c84762-530a-4aa5-aa7e-afecce6aa83b tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] Acquiring lock "cinder-quobyte-f1997bb0-4029-4723-8f7e-a3148cf431eb" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:51:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-34c84762-530a-4aa5-aa7e-afecce6aa83b tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] Lock "cinder-quobyte-f1997bb0-4029-4723-8f7e-a3148cf431eb" acquired by "delete_volume" :: waited 0.024s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:51:23 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[225e0030-e9e4-4039-b2ac-b7cf23c808ba]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:51:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-34c84762-530a-4aa5-aa7e-afecce6aa83b tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f1997bb0-4029-4723-8f7e-a3148cf431eb {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:51:23 devstack sudo[94510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f1997bb0-4029-4723-8f7e-a3148cf431eb Sep 28 11:51:23 devstack sudo[94510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:51:23 devstack sudo[94508]: pam_unix(sudo:session): session closed for user root Sep 28 11:51:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-80ffcbcd-e06b-4c22-8c20-6e40625bb0f0 tempest-VolumesDeleteCascade-1327545507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-0c837ad4-855d-40ca-942b-ddbfa96f9cef" returned: 0 in 0.490s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:51:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-80ffcbcd-e06b-4c22-8c20-6e40625bb0f0 tempest-VolumesDeleteCascade-1327545507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-0c837ad4-855d-40ca-942b-ddbfa96f9cef {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:51:23 devstack sudo[94516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-0c837ad4-855d-40ca-942b-ddbfa96f9cef Sep 28 11:51:23 devstack sudo[94516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:51:23 devstack sudo[94510]: pam_unix(sudo:session): session closed for user root Sep 28 11:51:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-34c84762-530a-4aa5-aa7e-afecce6aa83b tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f1997bb0-4029-4723-8f7e-a3148cf431eb" returned: 0 in 0.378s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:51:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-34c84762-530a-4aa5-aa7e-afecce6aa83b tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f1997bb0-4029-4723-8f7e-a3148cf431eb {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:51:23 devstack sudo[94521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f1997bb0-4029-4723-8f7e-a3148cf431eb Sep 28 11:51:23 devstack sudo[94521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:51:23 devstack sudo[94516]: pam_unix(sudo:session): session closed for user root Sep 28 11:51:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-80ffcbcd-e06b-4c22-8c20-6e40625bb0f0 tempest-VolumesDeleteCascade-1327545507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-0c837ad4-855d-40ca-942b-ddbfa96f9cef" returned: 0 in 0.300s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:51:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-80ffcbcd-e06b-4c22-8c20-6e40625bb0f0 tempest-VolumesDeleteCascade-1327545507 None] Lock "cinder-quobyte-0c837ad4-855d-40ca-942b-ddbfa96f9cef" released by "delete_volume" :: held 0.864s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:51:24 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-80ffcbcd-e06b-4c22-8c20-6e40625bb0f0 tempest-VolumesDeleteCascade-1327545507 None] Created reservations ['f4a6d734-8a33-4446-9a20-cdd4be22dabb', 'bd295094-a33e-406f-aa25-08ee9aea80b0', '4cad5ff7-aeb0-4c14-a54b-ddd3c8ed1e8a', '27e5eef7-29a7-46e0-bea3-3c79ee8efbaf'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:51:24 devstack sudo[94521]: pam_unix(sudo:session): session closed for user root Sep 28 11:51:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-34c84762-530a-4aa5-aa7e-afecce6aa83b tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f1997bb0-4029-4723-8f7e-a3148cf431eb" returned: 0 in 0.291s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:51:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-34c84762-530a-4aa5-aa7e-afecce6aa83b tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] Lock "cinder-quobyte-f1997bb0-4029-4723-8f7e-a3148cf431eb" released by "delete_volume" :: held 0.731s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:51:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-80ffcbcd-e06b-4c22-8c20-6e40625bb0f0 tempest-VolumesDeleteCascade-1327545507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:51:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-80ffcbcd-e06b-4c22-8c20-6e40625bb0f0 tempest-VolumesDeleteCascade-1327545507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:51:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-80ffcbcd-e06b-4c22-8c20-6e40625bb0f0 tempest-VolumesDeleteCascade-1327545507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:51:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-80ffcbcd-e06b-4c22-8c20-6e40625bb0f0 tempest-VolumesDeleteCascade-1327545507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:51:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-80ffcbcd-e06b-4c22-8c20-6e40625bb0f0 tempest-VolumesDeleteCascade-1327545507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:51:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-80ffcbcd-e06b-4c22-8c20-6e40625bb0f0 tempest-VolumesDeleteCascade-1327545507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:51:24 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-34c84762-530a-4aa5-aa7e-afecce6aa83b tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] Created reservations ['01bca5cb-4876-4b00-8844-6b2103431207', 'cf50b8cc-4d11-4ed9-8f28-172489e7b41a', 'ddeb647c-be9e-4cd7-900e-111381d7b295', 'f6e8347b-b25a-48f5-a8ce-038694250672'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:51:24 devstack sudo[94525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:51:24 devstack sudo[94525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:51:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-34c84762-530a-4aa5-aa7e-afecce6aa83b tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:51:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-34c84762-530a-4aa5-aa7e-afecce6aa83b tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:51:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-34c84762-530a-4aa5-aa7e-afecce6aa83b tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:51:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-34c84762-530a-4aa5-aa7e-afecce6aa83b tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:51:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-34c84762-530a-4aa5-aa7e-afecce6aa83b tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:51:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-34c84762-530a-4aa5-aa7e-afecce6aa83b tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:51:24 devstack sudo[94527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:51:24 devstack sudo[94527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:51:24 devstack sudo[94525]: pam_unix(sudo:session): session closed for user root Sep 28 11:51:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-80ffcbcd-e06b-4c22-8c20-6e40625bb0f0 tempest-VolumesDeleteCascade-1327545507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.444s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:51:24 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-80ffcbcd-e06b-4c22-8c20-6e40625bb0f0 tempest-VolumesDeleteCascade-1327545507 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:51:24 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-80ffcbcd-e06b-4c22-8c20-6e40625bb0f0 tempest-VolumesDeleteCascade-1327545507 None] Deleted volume successfully. Sep 28 11:51:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-80ffcbcd-e06b-4c22-8c20-6e40625bb0f0 tempest-VolumesDeleteCascade-1327545507 None] Lock "cinder-0c837ad4-855d-40ca-942b-ddbfa96f9cef-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:51:24 devstack sudo[94527]: pam_unix(sudo:session): session closed for user root Sep 28 11:51:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-34c84762-530a-4aa5-aa7e-afecce6aa83b tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.407s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:51:24 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-34c84762-530a-4aa5-aa7e-afecce6aa83b tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:51:24 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-34c84762-530a-4aa5-aa7e-afecce6aa83b tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] Deleted volume successfully. Sep 28 11:51:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-34c84762-530a-4aa5-aa7e-afecce6aa83b tempest-TestServerVolumeAttachScenarioOldVersion-1606084999 None] Lock "cinder-f1997bb0-4029-4723-8f7e-a3148cf431eb-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:51:34 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=78,cinder:UPDATE=83,cinder:INSERT=22,cinder:DELETE=9 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 11:51:34 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:UPDATE=81,cinder:SELECT=71,cinder:INSERT=20,cinder:DELETE=4 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 11:51:38 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 11:51:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:51:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:51:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:51:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:51:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:51:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:51:38 devstack sudo[94566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:51:38 devstack sudo[94566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:51:39 devstack sudo[94566]: pam_unix(sudo:session): session closed for user root Sep 28 11:51:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.510s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:51:39 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:51:39 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 11:51:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] thread count: 28 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 11:51:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] thread info: [<_MainThread(MainThread, started 135408582168704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 11:51:39 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-89aa6faf-c238-46d7-afa5-52183bc65e81 tempest-VolumesActionsTest-858037443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:51:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-89aa6faf-c238-46d7-afa5-52183bc65e81 tempest-VolumesActionsTest-858037443 None] Flow 'volume_create_manager' (26c5a7b4-e872-486e-a20a-4733436d49b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:51:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-89aa6faf-c238-46d7-afa5-52183bc65e81 tempest-VolumesActionsTest-858037443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7c8ae37-4f65-4b43-a5d2-9d7e5552e74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:51:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-89aa6faf-c238-46d7-afa5-52183bc65e81 tempest-VolumesActionsTest-858037443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7c8ae37-4f65-4b43-a5d2-9d7e5552e74d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:51:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-564385869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05b91ca5-7286-418f-96d1-c353cc38c535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1665ff9790694625876888932dec73a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:51:40Z,use_quota=True,user_id='e95cef1338f146539769d1b06e3cb5f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:51:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-89aa6faf-c238-46d7-afa5-52183bc65e81 tempest-VolumesActionsTest-858037443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f51bc23-61d5-4fbd-8832-adcb0bc3f422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:51:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-89aa6faf-c238-46d7-afa5-52183bc65e81 tempest-VolumesActionsTest-858037443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f51bc23-61d5-4fbd-8832-adcb0bc3f422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:51:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-89aa6faf-c238-46d7-afa5-52183bc65e81 tempest-VolumesActionsTest-858037443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35859bca-2e03-4039-8909-0c841b904392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:51:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-89aa6faf-c238-46d7-afa5-52183bc65e81 tempest-VolumesActionsTest-858037443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35859bca-2e03-4039-8909-0c841b904392) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05b91ca5-7286-418f-96d1-c353cc38c535', 'volume_name': 'volume-05b91ca5-7286-418f-96d1-c353cc38c535', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:51:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-89aa6faf-c238-46d7-afa5-52183bc65e81 tempest-VolumesActionsTest-858037443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e2104e6-d681-4075-96e1-0cdbc0eed0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:51:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-89aa6faf-c238-46d7-afa5-52183bc65e81 tempest-VolumesActionsTest-858037443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e2104e6-d681-4075-96e1-0cdbc0eed0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:51:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-89aa6faf-c238-46d7-afa5-52183bc65e81 tempest-VolumesActionsTest-858037443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (423332b7-bf78-4925-993c-5f04f510f984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:51:39 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-89aa6faf-c238-46d7-afa5-52183bc65e81 tempest-VolumesActionsTest-858037443 None] Volume 05b91ca5-7286-418f-96d1-c353cc38c535: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05b91ca5-7286-418f-96d1-c353cc38c535', 'volume_size': 1} Sep 28 11:51:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-89aa6faf-c238-46d7-afa5-52183bc65e81 tempest-VolumesActionsTest-858037443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:51:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-89aa6faf-c238-46d7-afa5-52183bc65e81 tempest-VolumesActionsTest-858037443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:51:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-89aa6faf-c238-46d7-afa5-52183bc65e81 tempest-VolumesActionsTest-858037443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:51:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-564385869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05b91ca5-7286-418f-96d1-c353cc38c535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1665ff9790694625876888932dec73a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:51:40Z,use_quota=True,user_id='e95cef1338f146539769d1b06e3cb5f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:51:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-89aa6faf-c238-46d7-afa5-52183bc65e81 tempest-VolumesActionsTest-858037443 None] Creating volume 05b91ca5-7286-418f-96d1-c353cc38c535 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:51:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-89aa6faf-c238-46d7-afa5-52183bc65e81 tempest-VolumesActionsTest-858037443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:51:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-89aa6faf-c238-46d7-afa5-52183bc65e81 tempest-VolumesActionsTest-858037443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:51:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-89aa6faf-c238-46d7-afa5-52183bc65e81 tempest-VolumesActionsTest-858037443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:51:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-89aa6faf-c238-46d7-afa5-52183bc65e81 tempest-VolumesActionsTest-858037443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:51:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-89aa6faf-c238-46d7-afa5-52183bc65e81 tempest-VolumesActionsTest-858037443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:51:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-89aa6faf-c238-46d7-afa5-52183bc65e81 tempest-VolumesActionsTest-858037443 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:51:39 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-89aa6faf-c238-46d7-afa5-52183bc65e81 tempest-VolumesActionsTest-858037443 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:51:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-89aa6faf-c238-46d7-afa5-52183bc65e81 tempest-VolumesActionsTest-858037443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-05b91ca5-7286-418f-96d1-c353cc38c535 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:51:39 devstack sudo[94572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-05b91ca5-7286-418f-96d1-c353cc38c535 1073741824 Sep 28 11:51:39 devstack sudo[94572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:51:40 devstack sudo[94572]: pam_unix(sudo:session): session closed for user root Sep 28 11:51:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-89aa6faf-c238-46d7-afa5-52183bc65e81 tempest-VolumesActionsTest-858037443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-05b91ca5-7286-418f-96d1-c353cc38c535 1073741824" returned: 0 in 0.562s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:51:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-89aa6faf-c238-46d7-afa5-52183bc65e81 tempest-VolumesActionsTest-858037443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-05b91ca5-7286-418f-96d1-c353cc38c535 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:51:40 devstack sudo[94592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-05b91ca5-7286-418f-96d1-c353cc38c535 Sep 28 11:51:40 devstack sudo[94592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:51:40 devstack sudo[94592]: pam_unix(sudo:session): session closed for user root Sep 28 11:51:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-89aa6faf-c238-46d7-afa5-52183bc65e81 tempest-VolumesActionsTest-858037443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-05b91ca5-7286-418f-96d1-c353cc38c535" returned: 0 in 0.301s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:51:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-89aa6faf-c238-46d7-afa5-52183bc65e81 tempest-VolumesActionsTest-858037443 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:51:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-89aa6faf-c238-46d7-afa5-52183bc65e81 tempest-VolumesActionsTest-858037443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:51:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-89aa6faf-c238-46d7-afa5-52183bc65e81 tempest-VolumesActionsTest-858037443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (423332b7-bf78-4925-993c-5f04f510f984) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05b91ca5-7286-418f-96d1-c353cc38c535', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:51:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-89aa6faf-c238-46d7-afa5-52183bc65e81 tempest-VolumesActionsTest-858037443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (573c1cf8-2cc3-486e-9e17-033866316e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:51:40 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-89aa6faf-c238-46d7-afa5-52183bc65e81 tempest-VolumesActionsTest-858037443 None] Volume volume-05b91ca5-7286-418f-96d1-c353cc38c535 (05b91ca5-7286-418f-96d1-c353cc38c535): created successfully Sep 28 11:51:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-89aa6faf-c238-46d7-afa5-52183bc65e81 tempest-VolumesActionsTest-858037443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (573c1cf8-2cc3-486e-9e17-033866316e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:51:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-89aa6faf-c238-46d7-afa5-52183bc65e81 tempest-VolumesActionsTest-858037443 None] Flow 'volume_create_manager' (26c5a7b4-e872-486e-a20a-4733436d49b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:51:40 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-89aa6faf-c238-46d7-afa5-52183bc65e81 tempest-VolumesActionsTest-858037443 None] Created volume successfully. Sep 28 11:51:50 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 11:51:50 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1,cinder:DELETE=1 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 11:51:59 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ea8d308-04c2-432f-9c6a-4ed4e607fd2e tempest-CinderUnicodeTest-983566173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:51:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8ea8d308-04c2-432f-9c6a-4ed4e607fd2e tempest-CinderUnicodeTest-983566173 None] Flow 'volume_create_manager' (78193bed-4a63-48ac-b327-1f98b6fe5584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:51:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8ea8d308-04c2-432f-9c6a-4ed4e607fd2e tempest-CinderUnicodeTest-983566173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36ef77df-fadc-4015-ae03-a4d5209de179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:51:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8ea8d308-04c2-432f-9c6a-4ed4e607fd2e tempest-CinderUnicodeTest-983566173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36ef77df-fadc-4015-ae03-a4d5209de179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1cd5bda-0c5f-4caf-a303-16ab60fd0af0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e52802e651b74e45a2de83c9b2ca0935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:51:59Z,use_quota=True,user_id='01c13a1699e74098b00262546bf035ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:51:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8ea8d308-04c2-432f-9c6a-4ed4e607fd2e tempest-CinderUnicodeTest-983566173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfdd21fd-c634-4c01-afdb-9011ad178eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:51:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8ea8d308-04c2-432f-9c6a-4ed4e607fd2e tempest-CinderUnicodeTest-983566173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfdd21fd-c634-4c01-afdb-9011ad178eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:51:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8ea8d308-04c2-432f-9c6a-4ed4e607fd2e tempest-CinderUnicodeTest-983566173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf8290a5-329c-4233-9501-eb83501567ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:51:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8ea8d308-04c2-432f-9c6a-4ed4e607fd2e tempest-CinderUnicodeTest-983566173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf8290a5-329c-4233-9501-eb83501567ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1cd5bda-0c5f-4caf-a303-16ab60fd0af0', 'volume_name': 'volume-f1cd5bda-0c5f-4caf-a303-16ab60fd0af0', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:51:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8ea8d308-04c2-432f-9c6a-4ed4e607fd2e tempest-CinderUnicodeTest-983566173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a82efe13-0f5d-4f53-b9a8-ff442dd0182c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:51:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8ea8d308-04c2-432f-9c6a-4ed4e607fd2e tempest-CinderUnicodeTest-983566173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a82efe13-0f5d-4f53-b9a8-ff442dd0182c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:51:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8ea8d308-04c2-432f-9c6a-4ed4e607fd2e tempest-CinderUnicodeTest-983566173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfd8922b-ccbb-4925-83f1-96c14ef6f93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:51:59 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-8ea8d308-04c2-432f-9c6a-4ed4e607fd2e tempest-CinderUnicodeTest-983566173 None] Volume f1cd5bda-0c5f-4caf-a303-16ab60fd0af0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1cd5bda-0c5f-4caf-a303-16ab60fd0af0', 'volume_size': 1} Sep 28 11:51:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8ea8d308-04c2-432f-9c6a-4ed4e607fd2e tempest-CinderUnicodeTest-983566173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:51:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8ea8d308-04c2-432f-9c6a-4ed4e607fd2e tempest-CinderUnicodeTest-983566173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:51:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8ea8d308-04c2-432f-9c6a-4ed4e607fd2e tempest-CinderUnicodeTest-983566173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1cd5bda-0c5f-4caf-a303-16ab60fd0af0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e52802e651b74e45a2de83c9b2ca0935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:51:59Z,use_quota=True,user_id='01c13a1699e74098b00262546bf035ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:51:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-8ea8d308-04c2-432f-9c6a-4ed4e607fd2e tempest-CinderUnicodeTest-983566173 None] Creating volume f1cd5bda-0c5f-4caf-a303-16ab60fd0af0 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:51:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8ea8d308-04c2-432f-9c6a-4ed4e607fd2e tempest-CinderUnicodeTest-983566173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:51:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8ea8d308-04c2-432f-9c6a-4ed4e607fd2e tempest-CinderUnicodeTest-983566173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:51:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8ea8d308-04c2-432f-9c6a-4ed4e607fd2e tempest-CinderUnicodeTest-983566173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:51:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8ea8d308-04c2-432f-9c6a-4ed4e607fd2e tempest-CinderUnicodeTest-983566173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:51:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8ea8d308-04c2-432f-9c6a-4ed4e607fd2e tempest-CinderUnicodeTest-983566173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:51:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8ea8d308-04c2-432f-9c6a-4ed4e607fd2e tempest-CinderUnicodeTest-983566173 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:51:59 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-8ea8d308-04c2-432f-9c6a-4ed4e607fd2e tempest-CinderUnicodeTest-983566173 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:51:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8ea8d308-04c2-432f-9c6a-4ed4e607fd2e tempest-CinderUnicodeTest-983566173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f1cd5bda-0c5f-4caf-a303-16ab60fd0af0 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:51:59 devstack sudo[94799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f1cd5bda-0c5f-4caf-a303-16ab60fd0af0 1073741824 Sep 28 11:51:59 devstack sudo[94799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:52:00 devstack sudo[94799]: pam_unix(sudo:session): session closed for user root Sep 28 11:52:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8ea8d308-04c2-432f-9c6a-4ed4e607fd2e tempest-CinderUnicodeTest-983566173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f1cd5bda-0c5f-4caf-a303-16ab60fd0af0 1073741824" returned: 0 in 0.898s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:52:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8ea8d308-04c2-432f-9c6a-4ed4e607fd2e tempest-CinderUnicodeTest-983566173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f1cd5bda-0c5f-4caf-a303-16ab60fd0af0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:52:00 devstack sudo[94806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f1cd5bda-0c5f-4caf-a303-16ab60fd0af0 Sep 28 11:52:00 devstack sudo[94806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:52:01 devstack sudo[94806]: pam_unix(sudo:session): session closed for user root Sep 28 11:52:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8ea8d308-04c2-432f-9c6a-4ed4e607fd2e tempest-CinderUnicodeTest-983566173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f1cd5bda-0c5f-4caf-a303-16ab60fd0af0" returned: 0 in 0.422s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:52:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8ea8d308-04c2-432f-9c6a-4ed4e607fd2e tempest-CinderUnicodeTest-983566173 None] <== create_volume: return (1421ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:52:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8ea8d308-04c2-432f-9c6a-4ed4e607fd2e tempest-CinderUnicodeTest-983566173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.425s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:52:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8ea8d308-04c2-432f-9c6a-4ed4e607fd2e tempest-CinderUnicodeTest-983566173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfd8922b-ccbb-4925-83f1-96c14ef6f93a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1cd5bda-0c5f-4caf-a303-16ab60fd0af0', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:52:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8ea8d308-04c2-432f-9c6a-4ed4e607fd2e tempest-CinderUnicodeTest-983566173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e17488c-9419-416e-989f-aa9749bbe6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:52:01 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-8ea8d308-04c2-432f-9c6a-4ed4e607fd2e tempest-CinderUnicodeTest-983566173 None] Volume volume-f1cd5bda-0c5f-4caf-a303-16ab60fd0af0 (f1cd5bda-0c5f-4caf-a303-16ab60fd0af0): created successfully Sep 28 11:52:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8ea8d308-04c2-432f-9c6a-4ed4e607fd2e tempest-CinderUnicodeTest-983566173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e17488c-9419-416e-989f-aa9749bbe6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:52:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8ea8d308-04c2-432f-9c6a-4ed4e607fd2e tempest-CinderUnicodeTest-983566173 None] Flow 'volume_create_manager' (78193bed-4a63-48ac-b327-1f98b6fe5584) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:52:01 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-8ea8d308-04c2-432f-9c6a-4ed4e607fd2e tempest-CinderUnicodeTest-983566173 None] Created volume successfully. Sep 28 11:52:02 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4500d1a-61f1-4c7d-a19a-a65c5169fd28 tempest-CinderUnicodeTest-983566173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:52:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b4500d1a-61f1-4c7d-a19a-a65c5169fd28 tempest-CinderUnicodeTest-983566173 None] Flow 'volume_create_manager' (ddafbc9c-4b38-4622-b246-3f29cb5f1764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:52:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b4500d1a-61f1-4c7d-a19a-a65c5169fd28 tempest-CinderUnicodeTest-983566173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (706377c7-b458-4de1-8695-644e8cf6aeca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:52:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b4500d1a-61f1-4c7d-a19a-a65c5169fd28 tempest-CinderUnicodeTest-983566173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (706377c7-b458-4de1-8695-644e8cf6aeca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:52:02Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1482315472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1532b589-006d-476c-93c3-9433ab297fd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e52802e651b74e45a2de83c9b2ca0935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:52:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:52:03Z,use_quota=True,user_id='01c13a1699e74098b00262546bf035ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:52:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b4500d1a-61f1-4c7d-a19a-a65c5169fd28 tempest-CinderUnicodeTest-983566173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6834d64e-c5be-4fdc-b520-fb5f231b66c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:52:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b4500d1a-61f1-4c7d-a19a-a65c5169fd28 tempest-CinderUnicodeTest-983566173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6834d64e-c5be-4fdc-b520-fb5f231b66c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:52:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b4500d1a-61f1-4c7d-a19a-a65c5169fd28 tempest-CinderUnicodeTest-983566173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb8f866a-8eb0-4502-a615-3a17ef52917a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:52:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b4500d1a-61f1-4c7d-a19a-a65c5169fd28 tempest-CinderUnicodeTest-983566173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb8f866a-8eb0-4502-a615-3a17ef52917a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1532b589-006d-476c-93c3-9433ab297fd0', 'volume_name': 'volume-1532b589-006d-476c-93c3-9433ab297fd0', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:52:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b4500d1a-61f1-4c7d-a19a-a65c5169fd28 tempest-CinderUnicodeTest-983566173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bd15ca1-9128-42f4-a6a5-eb9e6831f44f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:52:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b4500d1a-61f1-4c7d-a19a-a65c5169fd28 tempest-CinderUnicodeTest-983566173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bd15ca1-9128-42f4-a6a5-eb9e6831f44f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:52:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b4500d1a-61f1-4c7d-a19a-a65c5169fd28 tempest-CinderUnicodeTest-983566173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c6b2ffe-d1cc-45a9-b021-47fd2e89af03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:52:03 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-b4500d1a-61f1-4c7d-a19a-a65c5169fd28 tempest-CinderUnicodeTest-983566173 None] Volume 1532b589-006d-476c-93c3-9433ab297fd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1532b589-006d-476c-93c3-9433ab297fd0', 'volume_size': 1} Sep 28 11:52:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b4500d1a-61f1-4c7d-a19a-a65c5169fd28 tempest-CinderUnicodeTest-983566173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:52:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b4500d1a-61f1-4c7d-a19a-a65c5169fd28 tempest-CinderUnicodeTest-983566173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:52:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b4500d1a-61f1-4c7d-a19a-a65c5169fd28 tempest-CinderUnicodeTest-983566173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:52:02Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1482315472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1532b589-006d-476c-93c3-9433ab297fd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e52802e651b74e45a2de83c9b2ca0935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:52:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:52:03Z,use_quota=True,user_id='01c13a1699e74098b00262546bf035ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:52:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-b4500d1a-61f1-4c7d-a19a-a65c5169fd28 tempest-CinderUnicodeTest-983566173 None] Creating volume 1532b589-006d-476c-93c3-9433ab297fd0 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:52:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b4500d1a-61f1-4c7d-a19a-a65c5169fd28 tempest-CinderUnicodeTest-983566173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:52:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b4500d1a-61f1-4c7d-a19a-a65c5169fd28 tempest-CinderUnicodeTest-983566173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:52:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b4500d1a-61f1-4c7d-a19a-a65c5169fd28 tempest-CinderUnicodeTest-983566173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:52:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b4500d1a-61f1-4c7d-a19a-a65c5169fd28 tempest-CinderUnicodeTest-983566173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:52:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b4500d1a-61f1-4c7d-a19a-a65c5169fd28 tempest-CinderUnicodeTest-983566173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:52:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b4500d1a-61f1-4c7d-a19a-a65c5169fd28 tempest-CinderUnicodeTest-983566173 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:52:03 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-b4500d1a-61f1-4c7d-a19a-a65c5169fd28 tempest-CinderUnicodeTest-983566173 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:52:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b4500d1a-61f1-4c7d-a19a-a65c5169fd28 tempest-CinderUnicodeTest-983566173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1532b589-006d-476c-93c3-9433ab297fd0 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:52:03 devstack sudo[94841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1532b589-006d-476c-93c3-9433ab297fd0 1073741824 Sep 28 11:52:03 devstack sudo[94841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:52:04 devstack sudo[94841]: pam_unix(sudo:session): session closed for user root Sep 28 11:52:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b4500d1a-61f1-4c7d-a19a-a65c5169fd28 tempest-CinderUnicodeTest-983566173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1532b589-006d-476c-93c3-9433ab297fd0 1073741824" returned: 0 in 1.160s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:52:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b4500d1a-61f1-4c7d-a19a-a65c5169fd28 tempest-CinderUnicodeTest-983566173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1532b589-006d-476c-93c3-9433ab297fd0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:52:04 devstack sudo[94875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1532b589-006d-476c-93c3-9433ab297fd0 Sep 28 11:52:04 devstack sudo[94875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:52:04 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e927dc7e-30f0-4b0a-a3a1-973edab845c0 tempest-VolumesActionsTest-858037443 None] Acquiring lock "cinder-05b91ca5-7286-418f-96d1-c353cc38c535" by "attach_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:52:04 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e927dc7e-30f0-4b0a-a3a1-973edab845c0 tempest-VolumesActionsTest-858037443 None] Lock "cinder-05b91ca5-7286-418f-96d1-c353cc38c535" acquired by "attach_volume" :: waited 0.034s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:52:04 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e927dc7e-30f0-4b0a-a3a1-973edab845c0 tempest-VolumesActionsTest-858037443 None] Attaching volume 05b91ca5-7286-418f-96d1-c353cc38c535 to instance c3331652-1b23-461c-b31a-6539e43793cf at mountpoint /dev/vdb on host None. Sep 28 11:52:04 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e927dc7e-30f0-4b0a-a3a1-973edab845c0 tempest-VolumesActionsTest-858037443 None] Attach volume completed successfully. Sep 28 11:52:04 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e927dc7e-30f0-4b0a-a3a1-973edab845c0 tempest-VolumesActionsTest-858037443 None] Lock "cinder-05b91ca5-7286-418f-96d1-c353cc38c535" released by "attach_volume" :: held 0.217s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:52:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5bb6a966-f85b-4735-b674-1c76bbc82f29 tempest-VolumesActionsTest-858037443 None] Acquiring lock "cinder-05b91ca5-7286-418f-96d1-c353cc38c535-detach_volume" by "detach_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:52:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5bb6a966-f85b-4735-b674-1c76bbc82f29 tempest-VolumesActionsTest-858037443 None] Lock "cinder-05b91ca5-7286-418f-96d1-c353cc38c535-detach_volume" acquired by "detach_volume" :: waited 0.045s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:52:05 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-5bb6a966-f85b-4735-b674-1c76bbc82f29 tempest-VolumesActionsTest-858037443 None] Detaching volume 05b91ca5-7286-418f-96d1-c353cc38c535 from instance c3331652-1b23-461c-b31a-6539e43793cf. Sep 28 11:52:05 devstack sudo[94875]: pam_unix(sudo:session): session closed for user root Sep 28 11:52:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b4500d1a-61f1-4c7d-a19a-a65c5169fd28 tempest-CinderUnicodeTest-983566173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1532b589-006d-476c-93c3-9433ab297fd0" returned: 0 in 0.758s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:52:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b4500d1a-61f1-4c7d-a19a-a65c5169fd28 tempest-CinderUnicodeTest-983566173 None] <== create_volume: return (2051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:52:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b4500d1a-61f1-4c7d-a19a-a65c5169fd28 tempest-CinderUnicodeTest-983566173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.060s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:52:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b4500d1a-61f1-4c7d-a19a-a65c5169fd28 tempest-CinderUnicodeTest-983566173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c6b2ffe-d1cc-45a9-b021-47fd2e89af03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1532b589-006d-476c-93c3-9433ab297fd0', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:52:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b4500d1a-61f1-4c7d-a19a-a65c5169fd28 tempest-CinderUnicodeTest-983566173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39d92823-762e-4886-8fe5-2b71180bd1c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:52:05 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-5bb6a966-f85b-4735-b674-1c76bbc82f29 tempest-VolumesActionsTest-858037443 None] Detach volume completed successfully. Sep 28 11:52:05 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-b4500d1a-61f1-4c7d-a19a-a65c5169fd28 tempest-CinderUnicodeTest-983566173 None] Volume volume-1532b589-006d-476c-93c3-9433ab297fd0 (1532b589-006d-476c-93c3-9433ab297fd0): created successfully Sep 28 11:52:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b4500d1a-61f1-4c7d-a19a-a65c5169fd28 tempest-CinderUnicodeTest-983566173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39d92823-762e-4886-8fe5-2b71180bd1c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:52:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b4500d1a-61f1-4c7d-a19a-a65c5169fd28 tempest-CinderUnicodeTest-983566173 None] Flow 'volume_create_manager' (ddafbc9c-4b38-4622-b246-3f29cb5f1764) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:52:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5bb6a966-f85b-4735-b674-1c76bbc82f29 tempest-VolumesActionsTest-858037443 None] Lock "cinder-05b91ca5-7286-418f-96d1-c353cc38c535-detach_volume" released by "detach_volume" :: held 0.179s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:52:05 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b4500d1a-61f1-4c7d-a19a-a65c5169fd28 tempest-CinderUnicodeTest-983566173 None] Created volume successfully. Sep 28 11:52:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-73f85a89-9404-4282-b0fe-4a93f075de96 tempest-CinderUnicodeTest-983566173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:52:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-73f85a89-9404-4282-b0fe-4a93f075de96 tempest-CinderUnicodeTest-983566173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:52:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-73f85a89-9404-4282-b0fe-4a93f075de96 tempest-CinderUnicodeTest-983566173 None] Creating offline snapshot 13569f32-e6a7-455f-a6ee-9b78c44fe130 of volume 1532b589-006d-476c-93c3-9433ab297fd0 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 11:52:06 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[997f2f99-2a48-4e3a-9fc5-e337db7a4f77]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:52:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-73f85a89-9404-4282-b0fe-4a93f075de96 tempest-CinderUnicodeTest-983566173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1532b589-006d-476c-93c3-9433ab297fd0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:52:06 devstack sudo[94924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1532b589-006d-476c-93c3-9433ab297fd0 Sep 28 11:52:06 devstack sudo[94924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:52:07 devstack sudo[94924]: pam_unix(sudo:session): session closed for user root Sep 28 11:52:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-73f85a89-9404-4282-b0fe-4a93f075de96 tempest-CinderUnicodeTest-983566173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1532b589-006d-476c-93c3-9433ab297fd0" returned: 0 in 0.509s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:52:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-73f85a89-9404-4282-b0fe-4a93f075de96 tempest-CinderUnicodeTest-983566173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1532b589-006d-476c-93c3-9433ab297fd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1532b589-006d-476c-93c3-9433ab297fd0.13569f32-e6a7-455f-a6ee-9b78c44fe130 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:52:07 devstack sudo[94944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1532b589-006d-476c-93c3-9433ab297fd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1532b589-006d-476c-93c3-9433ab297fd0.13569f32-e6a7-455f-a6ee-9b78c44fe130 1G Sep 28 11:52:07 devstack sudo[94944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:52:07 devstack sudo[94944]: pam_unix(sudo:session): session closed for user root Sep 28 11:52:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-73f85a89-9404-4282-b0fe-4a93f075de96 tempest-CinderUnicodeTest-983566173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1532b589-006d-476c-93c3-9433ab297fd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1532b589-006d-476c-93c3-9433ab297fd0.13569f32-e6a7-455f-a6ee-9b78c44fe130 1G" returned: 0 in 0.500s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:52:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-73f85a89-9404-4282-b0fe-4a93f075de96 tempest-CinderUnicodeTest-983566173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1532b589-006d-476c-93c3-9433ab297fd0 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1532b589-006d-476c-93c3-9433ab297fd0.13569f32-e6a7-455f-a6ee-9b78c44fe130 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:52:07 devstack sudo[94951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1532b589-006d-476c-93c3-9433ab297fd0 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1532b589-006d-476c-93c3-9433ab297fd0.13569f32-e6a7-455f-a6ee-9b78c44fe130 Sep 28 11:52:07 devstack sudo[94951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:52:07 devstack sudo[94951]: pam_unix(sudo:session): session closed for user root Sep 28 11:52:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-73f85a89-9404-4282-b0fe-4a93f075de96 tempest-CinderUnicodeTest-983566173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1532b589-006d-476c-93c3-9433ab297fd0 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1532b589-006d-476c-93c3-9433ab297fd0.13569f32-e6a7-455f-a6ee-9b78c44fe130" returned: 0 in 0.352s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:52:07 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-73f85a89-9404-4282-b0fe-4a93f075de96 tempest-CinderUnicodeTest-983566173 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1532b589-006d-476c-93c3-9433ab297fd0.13569f32-e6a7-455f-a6ee-9b78c44fe130 is being set with open permissions: ugo+rw Sep 28 11:52:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-73f85a89-9404-4282-b0fe-4a93f075de96 tempest-CinderUnicodeTest-983566173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1532b589-006d-476c-93c3-9433ab297fd0.13569f32-e6a7-455f-a6ee-9b78c44fe130 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:52:08 devstack sudo[94958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1532b589-006d-476c-93c3-9433ab297fd0.13569f32-e6a7-455f-a6ee-9b78c44fe130 Sep 28 11:52:08 devstack sudo[94958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:52:08 devstack sudo[94958]: pam_unix(sudo:session): session closed for user root Sep 28 11:52:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-73f85a89-9404-4282-b0fe-4a93f075de96 tempest-CinderUnicodeTest-983566173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1532b589-006d-476c-93c3-9433ab297fd0.13569f32-e6a7-455f-a6ee-9b78c44fe130" returned: 0 in 0.357s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:52:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-73f85a89-9404-4282-b0fe-4a93f075de96 tempest-CinderUnicodeTest-983566173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1532b589-006d-476c-93c3-9433ab297fd0.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:52:08 devstack sudo[94972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1532b589-006d-476c-93c3-9433ab297fd0.info Sep 28 11:52:08 devstack sudo[94972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:52:08 devstack sudo[94972]: pam_unix(sudo:session): session closed for user root Sep 28 11:52:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-73f85a89-9404-4282-b0fe-4a93f075de96 tempest-CinderUnicodeTest-983566173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1532b589-006d-476c-93c3-9433ab297fd0.info" returned: 0 in 0.420s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:52:08 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-73f85a89-9404-4282-b0fe-4a93f075de96 tempest-CinderUnicodeTest-983566173 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1532b589-006d-476c-93c3-9433ab297fd0.info is being set with open permissions: ugo+rw Sep 28 11:52:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-73f85a89-9404-4282-b0fe-4a93f075de96 tempest-CinderUnicodeTest-983566173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1532b589-006d-476c-93c3-9433ab297fd0.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:52:08 devstack sudo[95001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1532b589-006d-476c-93c3-9433ab297fd0.info Sep 28 11:52:08 devstack sudo[95001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:52:09 devstack sudo[95001]: pam_unix(sudo:session): session closed for user root Sep 28 11:52:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-73f85a89-9404-4282-b0fe-4a93f075de96 tempest-CinderUnicodeTest-983566173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1532b589-006d-476c-93c3-9433ab297fd0.info" returned: 0 in 0.433s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:52:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-73f85a89-9404-4282-b0fe-4a93f075de96 tempest-CinderUnicodeTest-983566173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.768s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:52:09 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-73f85a89-9404-4282-b0fe-4a93f075de96 tempest-CinderUnicodeTest-983566173 None] Create snapshot completed successfully Sep 28 11:52:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-348efdc7-651e-48af-ae02-b5d980f4b707 tempest-CinderUnicodeTest-983566173 None] Acquiring lock "cinder-13569f32-e6a7-455f-a6ee-9b78c44fe130-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:52:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-348efdc7-651e-48af-ae02-b5d980f4b707 tempest-CinderUnicodeTest-983566173 None] Lock "cinder-13569f32-e6a7-455f-a6ee-9b78c44fe130-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:52:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-348efdc7-651e-48af-ae02-b5d980f4b707 tempest-CinderUnicodeTest-983566173 None] Acquiring lock "cinder-quobyte-1532b589-006d-476c-93c3-9433ab297fd0" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:52:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-348efdc7-651e-48af-ae02-b5d980f4b707 tempest-CinderUnicodeTest-983566173 None] Lock "cinder-quobyte-1532b589-006d-476c-93c3-9433ab297fd0" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:52:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-348efdc7-651e-48af-ae02-b5d980f4b707 tempest-CinderUnicodeTest-983566173 None] Acquiring lock "cinder-quobyte-13569f32-e6a7-455f-a6ee-9b78c44fe130" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:52:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-348efdc7-651e-48af-ae02-b5d980f4b707 tempest-CinderUnicodeTest-983566173 None] Lock "cinder-quobyte-13569f32-e6a7-455f-a6ee-9b78c44fe130" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:52:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-348efdc7-651e-48af-ae02-b5d980f4b707 tempest-CinderUnicodeTest-983566173 None] Deleting offline snapshot 13569f32-e6a7-455f-a6ee-9b78c44fe130 of volume 1532b589-006d-476c-93c3-9433ab297fd0 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 11:52:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-348efdc7-651e-48af-ae02-b5d980f4b707 tempest-CinderUnicodeTest-983566173 None] snapshot_file for this snap is: volume-1532b589-006d-476c-93c3-9433ab297fd0.13569f32-e6a7-455f-a6ee-9b78c44fe130 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 11:52:09 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[51230e63-fc89-4f67-a0c3-1ed75965c508]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:52:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-348efdc7-651e-48af-ae02-b5d980f4b707 tempest-CinderUnicodeTest-983566173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1532b589-006d-476c-93c3-9433ab297fd0.13569f32-e6a7-455f-a6ee-9b78c44fe130 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:52:09 devstack sudo[95050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1532b589-006d-476c-93c3-9433ab297fd0.13569f32-e6a7-455f-a6ee-9b78c44fe130 Sep 28 11:52:09 devstack sudo[95050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:52:10 devstack sudo[95050]: pam_unix(sudo:session): session closed for user root Sep 28 11:52:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-348efdc7-651e-48af-ae02-b5d980f4b707 tempest-CinderUnicodeTest-983566173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1532b589-006d-476c-93c3-9433ab297fd0.13569f32-e6a7-455f-a6ee-9b78c44fe130" returned: 0 in 0.385s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:52:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-348efdc7-651e-48af-ae02-b5d980f4b707 tempest-CinderUnicodeTest-983566173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1532b589-006d-476c-93c3-9433ab297fd0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 11:52:10 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb60122d-6bd8-45c6-9d67-cc36d523f2fc]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:52:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-348efdc7-651e-48af-ae02-b5d980f4b707 tempest-CinderUnicodeTest-983566173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1532b589-006d-476c-93c3-9433ab297fd0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:52:10 devstack sudo[95055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1532b589-006d-476c-93c3-9433ab297fd0 Sep 28 11:52:10 devstack sudo[95055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:52:10 devstack sudo[95055]: pam_unix(sudo:session): session closed for user root Sep 28 11:52:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-348efdc7-651e-48af-ae02-b5d980f4b707 tempest-CinderUnicodeTest-983566173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1532b589-006d-476c-93c3-9433ab297fd0" returned: 0 in 0.454s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:52:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-348efdc7-651e-48af-ae02-b5d980f4b707 tempest-CinderUnicodeTest-983566173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1532b589-006d-476c-93c3-9433ab297fd0.13569f32-e6a7-455f-a6ee-9b78c44fe130 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:52:10 devstack sudo[95062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1532b589-006d-476c-93c3-9433ab297fd0.13569f32-e6a7-455f-a6ee-9b78c44fe130 Sep 28 11:52:10 devstack sudo[95062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:52:11 devstack sudo[95062]: pam_unix(sudo:session): session closed for user root Sep 28 11:52:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-348efdc7-651e-48af-ae02-b5d980f4b707 tempest-CinderUnicodeTest-983566173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1532b589-006d-476c-93c3-9433ab297fd0.13569f32-e6a7-455f-a6ee-9b78c44fe130" returned: 0 in 0.510s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:52:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-348efdc7-651e-48af-ae02-b5d980f4b707 tempest-CinderUnicodeTest-983566173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1532b589-006d-476c-93c3-9433ab297fd0.13569f32-e6a7-455f-a6ee-9b78c44fe130 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:52:11 devstack sudo[95067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1532b589-006d-476c-93c3-9433ab297fd0.13569f32-e6a7-455f-a6ee-9b78c44fe130 Sep 28 11:52:11 devstack sudo[95067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:52:11 devstack sudo[95067]: pam_unix(sudo:session): session closed for user root Sep 28 11:52:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-348efdc7-651e-48af-ae02-b5d980f4b707 tempest-CinderUnicodeTest-983566173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1532b589-006d-476c-93c3-9433ab297fd0.13569f32-e6a7-455f-a6ee-9b78c44fe130" returned: 0 in 0.339s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:52:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-348efdc7-651e-48af-ae02-b5d980f4b707 tempest-CinderUnicodeTest-983566173 None] Lock "cinder-quobyte-13569f32-e6a7-455f-a6ee-9b78c44fe130" released by "_delete_snapshot" :: held 1.879s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:52:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-348efdc7-651e-48af-ae02-b5d980f4b707 tempest-CinderUnicodeTest-983566173 None] Lock "cinder-quobyte-1532b589-006d-476c-93c3-9433ab297fd0" released by "delete_snapshot" :: held 1.906s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:52:11 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-348efdc7-651e-48af-ae02-b5d980f4b707 tempest-CinderUnicodeTest-983566173 None] Created reservations ['60b2ac15-1a13-46d5-ba3d-525a0c5ba35d', 'c553247f-2215-46de-8a95-9cb2cbc8de8f', 'bd15b513-5b07-49eb-b529-2b083d9ce367', 'c63e5743-cbc7-43e4-987d-9e08538158d6'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:52:11 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-348efdc7-651e-48af-ae02-b5d980f4b707 tempest-CinderUnicodeTest-983566173 None] Delete snapshot completed successfully. Sep 28 11:52:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-348efdc7-651e-48af-ae02-b5d980f4b707 tempest-CinderUnicodeTest-983566173 None] Lock "cinder-13569f32-e6a7-455f-a6ee-9b78c44fe130-delete_snapshot" released by "delete_snapshot" :: held 2.145s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:52:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e3c4a529-7a85-4246-a992-0ee17dc34b5d tempest-CinderUnicodeTest-983566173 None] Acquiring lock "cinder-1532b589-006d-476c-93c3-9433ab297fd0-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:52:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e3c4a529-7a85-4246-a992-0ee17dc34b5d tempest-CinderUnicodeTest-983566173 None] Lock "cinder-1532b589-006d-476c-93c3-9433ab297fd0-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:52:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e3c4a529-7a85-4246-a992-0ee17dc34b5d tempest-CinderUnicodeTest-983566173 None] Acquiring lock "cinder-quobyte-1532b589-006d-476c-93c3-9433ab297fd0" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:52:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e3c4a529-7a85-4246-a992-0ee17dc34b5d tempest-CinderUnicodeTest-983566173 None] Lock "cinder-quobyte-1532b589-006d-476c-93c3-9433ab297fd0" acquired by "delete_volume" :: waited 0.029s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:52:12 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac519e7-fb5f-4f61-bf02-d34ce116e1a2]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:52:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e3c4a529-7a85-4246-a992-0ee17dc34b5d tempest-CinderUnicodeTest-983566173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1532b589-006d-476c-93c3-9433ab297fd0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:52:12 devstack sudo[95074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1532b589-006d-476c-93c3-9433ab297fd0 Sep 28 11:52:12 devstack sudo[95074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:52:12 devstack sudo[95074]: pam_unix(sudo:session): session closed for user root Sep 28 11:52:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e3c4a529-7a85-4246-a992-0ee17dc34b5d tempest-CinderUnicodeTest-983566173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1532b589-006d-476c-93c3-9433ab297fd0" returned: 0 in 0.607s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:52:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e3c4a529-7a85-4246-a992-0ee17dc34b5d tempest-CinderUnicodeTest-983566173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1532b589-006d-476c-93c3-9433ab297fd0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:52:13 devstack sudo[95079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1532b589-006d-476c-93c3-9433ab297fd0 Sep 28 11:52:13 devstack sudo[95079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:52:13 devstack sudo[95079]: pam_unix(sudo:session): session closed for user root Sep 28 11:52:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e3c4a529-7a85-4246-a992-0ee17dc34b5d tempest-CinderUnicodeTest-983566173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1532b589-006d-476c-93c3-9433ab297fd0" returned: 0 in 0.685s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:52:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e3c4a529-7a85-4246-a992-0ee17dc34b5d tempest-CinderUnicodeTest-983566173 None] Lock "cinder-quobyte-1532b589-006d-476c-93c3-9433ab297fd0" released by "delete_volume" :: held 1.447s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:52:13 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-e3c4a529-7a85-4246-a992-0ee17dc34b5d tempest-CinderUnicodeTest-983566173 None] Created reservations ['8262784a-4363-4496-9b31-6edc231587f8', '24ede8cd-7d8d-4bf0-859d-91974149abd5', '1a8504a1-07e6-4c6d-abf9-89e6dc9fbd5b', 'a408d9d1-9dce-4b73-8aff-07a870441c16'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:52:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e3c4a529-7a85-4246-a992-0ee17dc34b5d tempest-CinderUnicodeTest-983566173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:52:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e3c4a529-7a85-4246-a992-0ee17dc34b5d tempest-CinderUnicodeTest-983566173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:52:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e3c4a529-7a85-4246-a992-0ee17dc34b5d tempest-CinderUnicodeTest-983566173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:52:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e3c4a529-7a85-4246-a992-0ee17dc34b5d tempest-CinderUnicodeTest-983566173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:52:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e3c4a529-7a85-4246-a992-0ee17dc34b5d tempest-CinderUnicodeTest-983566173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:52:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e3c4a529-7a85-4246-a992-0ee17dc34b5d tempest-CinderUnicodeTest-983566173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:52:14 devstack sudo[95084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:52:14 devstack sudo[95084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:52:14 devstack sudo[95084]: pam_unix(sudo:session): session closed for user root Sep 28 11:52:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e3c4a529-7a85-4246-a992-0ee17dc34b5d tempest-CinderUnicodeTest-983566173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.517s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:52:14 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-e3c4a529-7a85-4246-a992-0ee17dc34b5d tempest-CinderUnicodeTest-983566173 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:52:14 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e3c4a529-7a85-4246-a992-0ee17dc34b5d tempest-CinderUnicodeTest-983566173 None] Deleted volume successfully. Sep 28 11:52:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8adf3598-b441-42be-a6e3-cb04d768fd64 tempest-CinderUnicodeTest-983566173 None] Acquiring lock "cinder-f1cd5bda-0c5f-4caf-a303-16ab60fd0af0-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:52:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e3c4a529-7a85-4246-a992-0ee17dc34b5d tempest-CinderUnicodeTest-983566173 None] Lock "cinder-1532b589-006d-476c-93c3-9433ab297fd0-delete_volume" released by "delete_volume" :: held 2.553s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:52:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8adf3598-b441-42be-a6e3-cb04d768fd64 tempest-CinderUnicodeTest-983566173 None] Lock "cinder-f1cd5bda-0c5f-4caf-a303-16ab60fd0af0-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:52:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8adf3598-b441-42be-a6e3-cb04d768fd64 tempest-CinderUnicodeTest-983566173 None] Acquiring lock "cinder-quobyte-f1cd5bda-0c5f-4caf-a303-16ab60fd0af0" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:52:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8adf3598-b441-42be-a6e3-cb04d768fd64 tempest-CinderUnicodeTest-983566173 None] Lock "cinder-quobyte-f1cd5bda-0c5f-4caf-a303-16ab60fd0af0" acquired by "delete_volume" :: waited 0.027s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:52:14 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d594d1-3627-4f0c-aade-27ee419fbbfc]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:52:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8adf3598-b441-42be-a6e3-cb04d768fd64 tempest-CinderUnicodeTest-983566173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f1cd5bda-0c5f-4caf-a303-16ab60fd0af0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:52:15 devstack sudo[95097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f1cd5bda-0c5f-4caf-a303-16ab60fd0af0 Sep 28 11:52:15 devstack sudo[95097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:52:15 devstack sudo[95097]: pam_unix(sudo:session): session closed for user root Sep 28 11:52:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8adf3598-b441-42be-a6e3-cb04d768fd64 tempest-CinderUnicodeTest-983566173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f1cd5bda-0c5f-4caf-a303-16ab60fd0af0" returned: 0 in 0.828s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:52:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8adf3598-b441-42be-a6e3-cb04d768fd64 tempest-CinderUnicodeTest-983566173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f1cd5bda-0c5f-4caf-a303-16ab60fd0af0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:52:15 devstack sudo[95113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f1cd5bda-0c5f-4caf-a303-16ab60fd0af0 Sep 28 11:52:15 devstack sudo[95113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:52:15 devstack sudo[95113]: pam_unix(sudo:session): session closed for user root Sep 28 11:52:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8adf3598-b441-42be-a6e3-cb04d768fd64 tempest-CinderUnicodeTest-983566173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f1cd5bda-0c5f-4caf-a303-16ab60fd0af0" returned: 0 in 0.295s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:52:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8adf3598-b441-42be-a6e3-cb04d768fd64 tempest-CinderUnicodeTest-983566173 None] Lock "cinder-quobyte-f1cd5bda-0c5f-4caf-a303-16ab60fd0af0" released by "delete_volume" :: held 1.194s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:52:16 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-8adf3598-b441-42be-a6e3-cb04d768fd64 tempest-CinderUnicodeTest-983566173 None] Created reservations ['90fc0be0-d6cb-47f8-a609-e3462cf15223', '0fb15566-00ed-4935-b4c3-56a903491372', 'c822f1f8-82d4-408e-965c-fcb400f0facd', 'a8b033be-11ec-4c4d-bbfc-6cfb9bf83f04'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:52:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8adf3598-b441-42be-a6e3-cb04d768fd64 tempest-CinderUnicodeTest-983566173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:52:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8adf3598-b441-42be-a6e3-cb04d768fd64 tempest-CinderUnicodeTest-983566173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:52:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8adf3598-b441-42be-a6e3-cb04d768fd64 tempest-CinderUnicodeTest-983566173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:52:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8adf3598-b441-42be-a6e3-cb04d768fd64 tempest-CinderUnicodeTest-983566173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:52:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8adf3598-b441-42be-a6e3-cb04d768fd64 tempest-CinderUnicodeTest-983566173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:52:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8adf3598-b441-42be-a6e3-cb04d768fd64 tempest-CinderUnicodeTest-983566173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:52:16 devstack sudo[95116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:52:16 devstack sudo[95116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:52:16 devstack sudo[95116]: pam_unix(sudo:session): session closed for user root Sep 28 11:52:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8adf3598-b441-42be-a6e3-cb04d768fd64 tempest-CinderUnicodeTest-983566173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.257s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:52:16 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-8adf3598-b441-42be-a6e3-cb04d768fd64 tempest-CinderUnicodeTest-983566173 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:52:16 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-8adf3598-b441-42be-a6e3-cb04d768fd64 tempest-CinderUnicodeTest-983566173 None] Deleted volume successfully. Sep 28 11:52:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8adf3598-b441-42be-a6e3-cb04d768fd64 tempest-CinderUnicodeTest-983566173 None] Lock "cinder-f1cd5bda-0c5f-4caf-a303-16ab60fd0af0-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:52:18 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d9f0b51-84a5-48af-aa7d-3c30ad38930b tempest-AttachVolumeNegativeTest-962283120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:52:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9d9f0b51-84a5-48af-aa7d-3c30ad38930b tempest-AttachVolumeNegativeTest-962283120 None] Flow 'volume_create_manager' (e022d3f2-0dfa-4414-8081-1fb8664ed337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:52:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9d9f0b51-84a5-48af-aa7d-3c30ad38930b tempest-AttachVolumeNegativeTest-962283120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a7da857-0e12-4a56-9667-437269b11bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:52:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9d9f0b51-84a5-48af-aa7d-3c30ad38930b tempest-AttachVolumeNegativeTest-962283120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a7da857-0e12-4a56-9667-437269b11bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:52:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1621500237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b49bcb3-720e-4f02-9f54-4db301a94e5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81ba3469bda8465fb145a233aec61f60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:52:19Z,use_quota=True,user_id='482c85c2bda54ca5a179eca038a733ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:52:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9d9f0b51-84a5-48af-aa7d-3c30ad38930b tempest-AttachVolumeNegativeTest-962283120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e3b40a3-8bea-4584-84dd-d5b38fba9ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:52:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9d9f0b51-84a5-48af-aa7d-3c30ad38930b tempest-AttachVolumeNegativeTest-962283120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e3b40a3-8bea-4584-84dd-d5b38fba9ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:52:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9d9f0b51-84a5-48af-aa7d-3c30ad38930b tempest-AttachVolumeNegativeTest-962283120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84f25059-f8ab-45e3-b770-72905dc52c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:52:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9d9f0b51-84a5-48af-aa7d-3c30ad38930b tempest-AttachVolumeNegativeTest-962283120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84f25059-f8ab-45e3-b770-72905dc52c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b49bcb3-720e-4f02-9f54-4db301a94e5f', 'volume_name': 'volume-4b49bcb3-720e-4f02-9f54-4db301a94e5f', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:52:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9d9f0b51-84a5-48af-aa7d-3c30ad38930b tempest-AttachVolumeNegativeTest-962283120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d04f86d-f6db-42b3-a960-c50a142d674e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:52:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9d9f0b51-84a5-48af-aa7d-3c30ad38930b tempest-AttachVolumeNegativeTest-962283120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d04f86d-f6db-42b3-a960-c50a142d674e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:52:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9d9f0b51-84a5-48af-aa7d-3c30ad38930b tempest-AttachVolumeNegativeTest-962283120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4dd4e18-bfc0-4ef2-b3b1-8cd8af712200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:52:19 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-9d9f0b51-84a5-48af-aa7d-3c30ad38930b tempest-AttachVolumeNegativeTest-962283120 None] Volume 4b49bcb3-720e-4f02-9f54-4db301a94e5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b49bcb3-720e-4f02-9f54-4db301a94e5f', 'volume_size': 1} Sep 28 11:52:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9d9f0b51-84a5-48af-aa7d-3c30ad38930b tempest-AttachVolumeNegativeTest-962283120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:52:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9d9f0b51-84a5-48af-aa7d-3c30ad38930b tempest-AttachVolumeNegativeTest-962283120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:52:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9d9f0b51-84a5-48af-aa7d-3c30ad38930b tempest-AttachVolumeNegativeTest-962283120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:52:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1621500237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b49bcb3-720e-4f02-9f54-4db301a94e5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81ba3469bda8465fb145a233aec61f60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:52:19Z,use_quota=True,user_id='482c85c2bda54ca5a179eca038a733ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:52:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-9d9f0b51-84a5-48af-aa7d-3c30ad38930b tempest-AttachVolumeNegativeTest-962283120 None] Creating volume 4b49bcb3-720e-4f02-9f54-4db301a94e5f {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:52:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9d9f0b51-84a5-48af-aa7d-3c30ad38930b tempest-AttachVolumeNegativeTest-962283120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:52:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9d9f0b51-84a5-48af-aa7d-3c30ad38930b tempest-AttachVolumeNegativeTest-962283120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:52:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9d9f0b51-84a5-48af-aa7d-3c30ad38930b tempest-AttachVolumeNegativeTest-962283120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:52:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9d9f0b51-84a5-48af-aa7d-3c30ad38930b tempest-AttachVolumeNegativeTest-962283120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:52:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9d9f0b51-84a5-48af-aa7d-3c30ad38930b tempest-AttachVolumeNegativeTest-962283120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:52:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9d9f0b51-84a5-48af-aa7d-3c30ad38930b tempest-AttachVolumeNegativeTest-962283120 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:52:19 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-9d9f0b51-84a5-48af-aa7d-3c30ad38930b tempest-AttachVolumeNegativeTest-962283120 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:52:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9d9f0b51-84a5-48af-aa7d-3c30ad38930b tempest-AttachVolumeNegativeTest-962283120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4b49bcb3-720e-4f02-9f54-4db301a94e5f 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:52:19 devstack sudo[95182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4b49bcb3-720e-4f02-9f54-4db301a94e5f 1073741824 Sep 28 11:52:19 devstack sudo[95182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:52:19 devstack sudo[95182]: pam_unix(sudo:session): session closed for user root Sep 28 11:52:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9d9f0b51-84a5-48af-aa7d-3c30ad38930b tempest-AttachVolumeNegativeTest-962283120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4b49bcb3-720e-4f02-9f54-4db301a94e5f 1073741824" returned: 0 in 0.634s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:52:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9d9f0b51-84a5-48af-aa7d-3c30ad38930b tempest-AttachVolumeNegativeTest-962283120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4b49bcb3-720e-4f02-9f54-4db301a94e5f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:52:19 devstack sudo[95211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4b49bcb3-720e-4f02-9f54-4db301a94e5f Sep 28 11:52:19 devstack sudo[95211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:52:20 devstack sudo[95211]: pam_unix(sudo:session): session closed for user root Sep 28 11:52:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9d9f0b51-84a5-48af-aa7d-3c30ad38930b tempest-AttachVolumeNegativeTest-962283120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4b49bcb3-720e-4f02-9f54-4db301a94e5f" returned: 0 in 0.378s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:52:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9d9f0b51-84a5-48af-aa7d-3c30ad38930b tempest-AttachVolumeNegativeTest-962283120 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:52:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9d9f0b51-84a5-48af-aa7d-3c30ad38930b tempest-AttachVolumeNegativeTest-962283120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:52:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9d9f0b51-84a5-48af-aa7d-3c30ad38930b tempest-AttachVolumeNegativeTest-962283120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4dd4e18-bfc0-4ef2-b3b1-8cd8af712200) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b49bcb3-720e-4f02-9f54-4db301a94e5f', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:52:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9d9f0b51-84a5-48af-aa7d-3c30ad38930b tempest-AttachVolumeNegativeTest-962283120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (852b7324-2f14-4ed5-9cea-8076f046cee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:52:20 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-9d9f0b51-84a5-48af-aa7d-3c30ad38930b tempest-AttachVolumeNegativeTest-962283120 None] Volume volume-4b49bcb3-720e-4f02-9f54-4db301a94e5f (4b49bcb3-720e-4f02-9f54-4db301a94e5f): created successfully Sep 28 11:52:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9d9f0b51-84a5-48af-aa7d-3c30ad38930b tempest-AttachVolumeNegativeTest-962283120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (852b7324-2f14-4ed5-9cea-8076f046cee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:52:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9d9f0b51-84a5-48af-aa7d-3c30ad38930b tempest-AttachVolumeNegativeTest-962283120 None] Flow 'volume_create_manager' (e022d3f2-0dfa-4414-8081-1fb8664ed337) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:52:20 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-9d9f0b51-84a5-48af-aa7d-3c30ad38930b tempest-AttachVolumeNegativeTest-962283120 None] Created volume successfully. Sep 28 11:52:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d806b7b2-7f79-4944-8629-81f637cfc055 tempest-VolumesActionsTest-858037443 None] Acquiring lock "cinder-05b91ca5-7286-418f-96d1-c353cc38c535" by "attach_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:52:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d806b7b2-7f79-4944-8629-81f637cfc055 tempest-VolumesActionsTest-858037443 None] Lock "cinder-05b91ca5-7286-418f-96d1-c353cc38c535" acquired by "attach_volume" :: waited 0.032s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:52:22 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-d806b7b2-7f79-4944-8629-81f637cfc055 tempest-VolumesActionsTest-858037443 None] Attaching volume 05b91ca5-7286-418f-96d1-c353cc38c535 to instance ba81cff6-4fa6-48f7-8336-d3e8d9f05db6 at mountpoint /dev/vdb on host None. Sep 28 11:52:22 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-d806b7b2-7f79-4944-8629-81f637cfc055 tempest-VolumesActionsTest-858037443 None] Attach volume completed successfully. Sep 28 11:52:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d806b7b2-7f79-4944-8629-81f637cfc055 tempest-VolumesActionsTest-858037443 None] Lock "cinder-05b91ca5-7286-418f-96d1-c353cc38c535" released by "attach_volume" :: held 0.331s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:52:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-2e75c999-d683-457c-ba10-4cbdc4358e84 req-75d65f64-1fc2-41ad-ad1c-8e989a777086 tempest-AttachVolumeNegativeTest-962283120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:52:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-2e75c999-d683-457c-ba10-4cbdc4358e84 req-75d65f64-1fc2-41ad-ad1c-8e989a777086 tempest-AttachVolumeNegativeTest-962283120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:52:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-2e75c999-d683-457c-ba10-4cbdc4358e84 req-75d65f64-1fc2-41ad-ad1c-8e989a777086 tempest-AttachVolumeNegativeTest-962283120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:52:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-2e75c999-d683-457c-ba10-4cbdc4358e84 req-75d65f64-1fc2-41ad-ad1c-8e989a777086 tempest-AttachVolumeNegativeTest-962283120 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0', 'name': 'volume-4b49bcb3-720e-4f02-9f54-4db301a94e5f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4392f17e-eeab-4eac-8aa2-f30f8db8fc9d', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 11:52:22 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-2e75c999-d683-457c-ba10-4cbdc4358e84 req-75d65f64-1fc2-41ad-ad1c-8e989a777086 tempest-AttachVolumeNegativeTest-962283120 None] attachment_update completed successfully. Sep 28 11:52:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a7fa4da7-8f85-44e0-a2d9-55add34ef495 tempest-VolumesActionsTest-858037443 None] Acquiring lock "cinder-05b91ca5-7286-418f-96d1-c353cc38c535-detach_volume" by "detach_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:52:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a7fa4da7-8f85-44e0-a2d9-55add34ef495 tempest-VolumesActionsTest-858037443 None] Lock "cinder-05b91ca5-7286-418f-96d1-c353cc38c535-detach_volume" acquired by "detach_volume" :: waited 0.046s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:52:23 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-a7fa4da7-8f85-44e0-a2d9-55add34ef495 tempest-VolumesActionsTest-858037443 None] Detaching volume 05b91ca5-7286-418f-96d1-c353cc38c535 from instance ba81cff6-4fa6-48f7-8336-d3e8d9f05db6. Sep 28 11:52:23 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-a7fa4da7-8f85-44e0-a2d9-55add34ef495 tempest-VolumesActionsTest-858037443 None] Detach volume completed successfully. Sep 28 11:52:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a7fa4da7-8f85-44e0-a2d9-55add34ef495 tempest-VolumesActionsTest-858037443 None] Lock "cinder-05b91ca5-7286-418f-96d1-c353cc38c535-detach_volume" released by "detach_volume" :: held 0.134s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:52:23 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2f214b3-d6af-4fdb-bf9a-bc2c502b990c tempest-ProjectReaderTests-2136417288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:52:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f2f214b3-d6af-4fdb-bf9a-bc2c502b990c tempest-ProjectReaderTests-2136417288 None] Flow 'volume_create_manager' (2947faf1-4c74-4590-93e1-08cdd4b9be5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:52:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f2f214b3-d6af-4fdb-bf9a-bc2c502b990c tempest-ProjectReaderTests-2136417288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef43ceca-79e0-4ce6-978f-32909ddc122d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:52:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f2f214b3-d6af-4fdb-bf9a-bc2c502b990c tempest-ProjectReaderTests-2136417288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef43ceca-79e0-4ce6-978f-32909ddc122d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:52:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-207767645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8964f648-a5a9-45f4-8673-5a2726f9ace3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b4328601524c73a7a836600ee6f0e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:52:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:52:24Z,use_quota=True,user_id='14e9261ad0a049ffa433ba56a6cf8aa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:52:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f2f214b3-d6af-4fdb-bf9a-bc2c502b990c tempest-ProjectReaderTests-2136417288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24c024fb-2589-4c34-8289-2d1bd01cd53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:52:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f2f214b3-d6af-4fdb-bf9a-bc2c502b990c tempest-ProjectReaderTests-2136417288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24c024fb-2589-4c34-8289-2d1bd01cd53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:52:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f2f214b3-d6af-4fdb-bf9a-bc2c502b990c tempest-ProjectReaderTests-2136417288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc16fecf-c55c-4eb7-9ae8-1e21ac376e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:52:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f2f214b3-d6af-4fdb-bf9a-bc2c502b990c tempest-ProjectReaderTests-2136417288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc16fecf-c55c-4eb7-9ae8-1e21ac376e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8964f648-a5a9-45f4-8673-5a2726f9ace3', 'volume_name': 'volume-8964f648-a5a9-45f4-8673-5a2726f9ace3', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:52:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f2f214b3-d6af-4fdb-bf9a-bc2c502b990c tempest-ProjectReaderTests-2136417288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b3a51c6-4005-41ae-8b45-5158990c1c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:52:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f2f214b3-d6af-4fdb-bf9a-bc2c502b990c tempest-ProjectReaderTests-2136417288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b3a51c6-4005-41ae-8b45-5158990c1c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:52:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f2f214b3-d6af-4fdb-bf9a-bc2c502b990c tempest-ProjectReaderTests-2136417288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f97ab71b-4080-449c-9c5e-ecbce6abd1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:52:24 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-f2f214b3-d6af-4fdb-bf9a-bc2c502b990c tempest-ProjectReaderTests-2136417288 None] Volume 8964f648-a5a9-45f4-8673-5a2726f9ace3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8964f648-a5a9-45f4-8673-5a2726f9ace3', 'volume_size': 1} Sep 28 11:52:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f2f214b3-d6af-4fdb-bf9a-bc2c502b990c tempest-ProjectReaderTests-2136417288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:52:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f2f214b3-d6af-4fdb-bf9a-bc2c502b990c tempest-ProjectReaderTests-2136417288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:52:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f2f214b3-d6af-4fdb-bf9a-bc2c502b990c tempest-ProjectReaderTests-2136417288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:52:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-207767645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8964f648-a5a9-45f4-8673-5a2726f9ace3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b4328601524c73a7a836600ee6f0e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:52:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:52:24Z,use_quota=True,user_id='14e9261ad0a049ffa433ba56a6cf8aa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:52:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-f2f214b3-d6af-4fdb-bf9a-bc2c502b990c tempest-ProjectReaderTests-2136417288 None] Creating volume 8964f648-a5a9-45f4-8673-5a2726f9ace3 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:52:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f2f214b3-d6af-4fdb-bf9a-bc2c502b990c tempest-ProjectReaderTests-2136417288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:52:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f2f214b3-d6af-4fdb-bf9a-bc2c502b990c tempest-ProjectReaderTests-2136417288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:52:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f2f214b3-d6af-4fdb-bf9a-bc2c502b990c tempest-ProjectReaderTests-2136417288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:52:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f2f214b3-d6af-4fdb-bf9a-bc2c502b990c tempest-ProjectReaderTests-2136417288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:52:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f2f214b3-d6af-4fdb-bf9a-bc2c502b990c tempest-ProjectReaderTests-2136417288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:52:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f2f214b3-d6af-4fdb-bf9a-bc2c502b990c tempest-ProjectReaderTests-2136417288 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:52:24 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-f2f214b3-d6af-4fdb-bf9a-bc2c502b990c tempest-ProjectReaderTests-2136417288 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:52:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f2f214b3-d6af-4fdb-bf9a-bc2c502b990c tempest-ProjectReaderTests-2136417288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8964f648-a5a9-45f4-8673-5a2726f9ace3 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:52:24 devstack sudo[95643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8964f648-a5a9-45f4-8673-5a2726f9ace3 1073741824 Sep 28 11:52:24 devstack sudo[95643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:52:25 devstack sudo[95643]: pam_unix(sudo:session): session closed for user root Sep 28 11:52:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f2f214b3-d6af-4fdb-bf9a-bc2c502b990c tempest-ProjectReaderTests-2136417288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8964f648-a5a9-45f4-8673-5a2726f9ace3 1073741824" returned: 0 in 1.004s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:52:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f2f214b3-d6af-4fdb-bf9a-bc2c502b990c tempest-ProjectReaderTests-2136417288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8964f648-a5a9-45f4-8673-5a2726f9ace3 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:52:25 devstack sudo[95713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8964f648-a5a9-45f4-8673-5a2726f9ace3 Sep 28 11:52:25 devstack sudo[95713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:52:25 devstack sudo[95713]: pam_unix(sudo:session): session closed for user root Sep 28 11:52:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f2f214b3-d6af-4fdb-bf9a-bc2c502b990c tempest-ProjectReaderTests-2136417288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8964f648-a5a9-45f4-8673-5a2726f9ace3" returned: 0 in 0.258s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:52:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f2f214b3-d6af-4fdb-bf9a-bc2c502b990c tempest-ProjectReaderTests-2136417288 None] <== create_volume: return (1369ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:52:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f2f214b3-d6af-4fdb-bf9a-bc2c502b990c tempest-ProjectReaderTests-2136417288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.372s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:52:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f2f214b3-d6af-4fdb-bf9a-bc2c502b990c tempest-ProjectReaderTests-2136417288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f97ab71b-4080-449c-9c5e-ecbce6abd1e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8964f648-a5a9-45f4-8673-5a2726f9ace3', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:52:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f2f214b3-d6af-4fdb-bf9a-bc2c502b990c tempest-ProjectReaderTests-2136417288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e09d166b-344a-4393-85ee-7bd5eeb6aa61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:52:25 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-f2f214b3-d6af-4fdb-bf9a-bc2c502b990c tempest-ProjectReaderTests-2136417288 None] Volume volume-8964f648-a5a9-45f4-8673-5a2726f9ace3 (8964f648-a5a9-45f4-8673-5a2726f9ace3): created successfully Sep 28 11:52:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f2f214b3-d6af-4fdb-bf9a-bc2c502b990c tempest-ProjectReaderTests-2136417288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e09d166b-344a-4393-85ee-7bd5eeb6aa61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:52:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f2f214b3-d6af-4fdb-bf9a-bc2c502b990c tempest-ProjectReaderTests-2136417288 None] Flow 'volume_create_manager' (2947faf1-4c74-4590-93e1-08cdd4b9be5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:52:25 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-f2f214b3-d6af-4fdb-bf9a-bc2c502b990c tempest-ProjectReaderTests-2136417288 None] Created volume successfully. Sep 28 11:52:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d4623350-7b0e-4cb7-ae70-a6e1a216cb63 tempest-ProjectReaderTests-2136417288 None] Acquiring lock "cinder-8964f648-a5a9-45f4-8673-5a2726f9ace3-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:52:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d4623350-7b0e-4cb7-ae70-a6e1a216cb63 tempest-ProjectReaderTests-2136417288 None] Lock "cinder-8964f648-a5a9-45f4-8673-5a2726f9ace3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:52:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d4623350-7b0e-4cb7-ae70-a6e1a216cb63 tempest-ProjectReaderTests-2136417288 None] Acquiring lock "cinder-quobyte-8964f648-a5a9-45f4-8673-5a2726f9ace3" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:52:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d4623350-7b0e-4cb7-ae70-a6e1a216cb63 tempest-ProjectReaderTests-2136417288 None] Lock "cinder-quobyte-8964f648-a5a9-45f4-8673-5a2726f9ace3" acquired by "delete_volume" :: waited 0.029s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:52:26 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4fa5f8-8cff-458e-abd3-12159e5fa887]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:52:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d4623350-7b0e-4cb7-ae70-a6e1a216cb63 tempest-ProjectReaderTests-2136417288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8964f648-a5a9-45f4-8673-5a2726f9ace3 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:52:26 devstack sudo[95724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8964f648-a5a9-45f4-8673-5a2726f9ace3 Sep 28 11:52:26 devstack sudo[95724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:52:26 devstack sudo[95724]: pam_unix(sudo:session): session closed for user root Sep 28 11:52:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d4623350-7b0e-4cb7-ae70-a6e1a216cb63 tempest-ProjectReaderTests-2136417288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8964f648-a5a9-45f4-8673-5a2726f9ace3" returned: 0 in 0.398s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:52:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d4623350-7b0e-4cb7-ae70-a6e1a216cb63 tempest-ProjectReaderTests-2136417288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8964f648-a5a9-45f4-8673-5a2726f9ace3 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:52:26 devstack sudo[95731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8964f648-a5a9-45f4-8673-5a2726f9ace3 Sep 28 11:52:26 devstack sudo[95731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:52:26 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-f12fc929-4925-4989-9528-6275a8c037ca req-c470d2a4-09be-45b5-93c1-a59e02af58ef tempest-AttachVolumeNegativeTest-962283120 None] Terminate volume connection completed successfully. Sep 28 11:52:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-f12fc929-4925-4989-9528-6275a8c037ca req-c470d2a4-09be-45b5-93c1-a59e02af58ef tempest-AttachVolumeNegativeTest-962283120 None] Deleting attachment 4392f17e-eeab-4eac-8aa2-f30f8db8fc9d. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 11:52:26 devstack sudo[95731]: pam_unix(sudo:session): session closed for user root Sep 28 11:52:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d4623350-7b0e-4cb7-ae70-a6e1a216cb63 tempest-ProjectReaderTests-2136417288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8964f648-a5a9-45f4-8673-5a2726f9ace3" returned: 0 in 0.298s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:52:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d4623350-7b0e-4cb7-ae70-a6e1a216cb63 tempest-ProjectReaderTests-2136417288 None] Lock "cinder-quobyte-8964f648-a5a9-45f4-8673-5a2726f9ace3" released by "delete_volume" :: held 0.751s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:52:27 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-d4623350-7b0e-4cb7-ae70-a6e1a216cb63 tempest-ProjectReaderTests-2136417288 None] Created reservations ['34cab6b2-0d94-41b0-8e47-2574d564c77f', '6ae848a3-fe7d-47e6-ba6e-64822cd0e3a6', 'a3941acf-6376-4282-92bd-1dad018d05d8', '9b15f14e-515e-4f1c-b562-52a2af02411c'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:52:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d4623350-7b0e-4cb7-ae70-a6e1a216cb63 tempest-ProjectReaderTests-2136417288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:52:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d4623350-7b0e-4cb7-ae70-a6e1a216cb63 tempest-ProjectReaderTests-2136417288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:52:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d4623350-7b0e-4cb7-ae70-a6e1a216cb63 tempest-ProjectReaderTests-2136417288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:52:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d4623350-7b0e-4cb7-ae70-a6e1a216cb63 tempest-ProjectReaderTests-2136417288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:52:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d4623350-7b0e-4cb7-ae70-a6e1a216cb63 tempest-ProjectReaderTests-2136417288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:52:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d4623350-7b0e-4cb7-ae70-a6e1a216cb63 tempest-ProjectReaderTests-2136417288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:52:27 devstack sudo[95762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:52:27 devstack sudo[95762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:52:27 devstack sudo[95762]: pam_unix(sudo:session): session closed for user root Sep 28 11:52:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d4623350-7b0e-4cb7-ae70-a6e1a216cb63 tempest-ProjectReaderTests-2136417288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.312s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:52:27 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-d4623350-7b0e-4cb7-ae70-a6e1a216cb63 tempest-ProjectReaderTests-2136417288 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:52:27 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-d4623350-7b0e-4cb7-ae70-a6e1a216cb63 tempest-ProjectReaderTests-2136417288 None] Deleted volume successfully. Sep 28 11:52:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d4623350-7b0e-4cb7-ae70-a6e1a216cb63 tempest-ProjectReaderTests-2136417288 None] Lock "cinder-8964f648-a5a9-45f4-8673-5a2726f9ace3-delete_volume" released by "delete_volume" :: held 1.330s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:52:27 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-0039f6a1-f815-42f7-9f6e-93d2b5dbe0d1 tempest-ProjectReaderTests-2136417288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:52:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0039f6a1-f815-42f7-9f6e-93d2b5dbe0d1 tempest-ProjectReaderTests-2136417288 None] Flow 'volume_create_manager' (ad8d1198-a5d0-45e0-9d10-2281fbfe81aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:52:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0039f6a1-f815-42f7-9f6e-93d2b5dbe0d1 tempest-ProjectReaderTests-2136417288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66523a4d-f86a-4bca-a0e5-748e17fccf35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:52:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0039f6a1-f815-42f7-9f6e-93d2b5dbe0d1 tempest-ProjectReaderTests-2136417288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66523a4d-f86a-4bca-a0e5-748e17fccf35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:52:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-229806080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e592e589-0822-497a-a641-b11b6c0ded1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b4328601524c73a7a836600ee6f0e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:52:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:52:28Z,use_quota=True,user_id='14e9261ad0a049ffa433ba56a6cf8aa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:52:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0039f6a1-f815-42f7-9f6e-93d2b5dbe0d1 tempest-ProjectReaderTests-2136417288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (006ee179-6efa-4156-8bae-2d8758bdeab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:52:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0039f6a1-f815-42f7-9f6e-93d2b5dbe0d1 tempest-ProjectReaderTests-2136417288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (006ee179-6efa-4156-8bae-2d8758bdeab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:52:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0039f6a1-f815-42f7-9f6e-93d2b5dbe0d1 tempest-ProjectReaderTests-2136417288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bef39c67-9cd6-4a16-9c93-eeabaf8ec296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:52:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0039f6a1-f815-42f7-9f6e-93d2b5dbe0d1 tempest-ProjectReaderTests-2136417288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bef39c67-9cd6-4a16-9c93-eeabaf8ec296) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e592e589-0822-497a-a641-b11b6c0ded1b', 'volume_name': 'volume-e592e589-0822-497a-a641-b11b6c0ded1b', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:52:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0039f6a1-f815-42f7-9f6e-93d2b5dbe0d1 tempest-ProjectReaderTests-2136417288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (337fa387-e5f6-4445-a4f3-16491cfda006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:52:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0039f6a1-f815-42f7-9f6e-93d2b5dbe0d1 tempest-ProjectReaderTests-2136417288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (337fa387-e5f6-4445-a4f3-16491cfda006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:52:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0039f6a1-f815-42f7-9f6e-93d2b5dbe0d1 tempest-ProjectReaderTests-2136417288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d89cab7-8940-431d-b15e-32547bbe3727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:52:28 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-0039f6a1-f815-42f7-9f6e-93d2b5dbe0d1 tempest-ProjectReaderTests-2136417288 None] Volume e592e589-0822-497a-a641-b11b6c0ded1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e592e589-0822-497a-a641-b11b6c0ded1b', 'volume_size': 1} Sep 28 11:52:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0039f6a1-f815-42f7-9f6e-93d2b5dbe0d1 tempest-ProjectReaderTests-2136417288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:52:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0039f6a1-f815-42f7-9f6e-93d2b5dbe0d1 tempest-ProjectReaderTests-2136417288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:52:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0039f6a1-f815-42f7-9f6e-93d2b5dbe0d1 tempest-ProjectReaderTests-2136417288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:52:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-229806080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e592e589-0822-497a-a641-b11b6c0ded1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b4328601524c73a7a836600ee6f0e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:52:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:52:28Z,use_quota=True,user_id='14e9261ad0a049ffa433ba56a6cf8aa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:52:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-0039f6a1-f815-42f7-9f6e-93d2b5dbe0d1 tempest-ProjectReaderTests-2136417288 None] Creating volume e592e589-0822-497a-a641-b11b6c0ded1b {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:52:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0039f6a1-f815-42f7-9f6e-93d2b5dbe0d1 tempest-ProjectReaderTests-2136417288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:52:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0039f6a1-f815-42f7-9f6e-93d2b5dbe0d1 tempest-ProjectReaderTests-2136417288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:52:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0039f6a1-f815-42f7-9f6e-93d2b5dbe0d1 tempest-ProjectReaderTests-2136417288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:52:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0039f6a1-f815-42f7-9f6e-93d2b5dbe0d1 tempest-ProjectReaderTests-2136417288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:52:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0039f6a1-f815-42f7-9f6e-93d2b5dbe0d1 tempest-ProjectReaderTests-2136417288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:52:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0039f6a1-f815-42f7-9f6e-93d2b5dbe0d1 tempest-ProjectReaderTests-2136417288 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:52:28 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-0039f6a1-f815-42f7-9f6e-93d2b5dbe0d1 tempest-ProjectReaderTests-2136417288 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:52:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0039f6a1-f815-42f7-9f6e-93d2b5dbe0d1 tempest-ProjectReaderTests-2136417288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e592e589-0822-497a-a641-b11b6c0ded1b 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:52:28 devstack sudo[95769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e592e589-0822-497a-a641-b11b6c0ded1b 1073741824 Sep 28 11:52:28 devstack sudo[95769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:52:28 devstack sudo[95769]: pam_unix(sudo:session): session closed for user root Sep 28 11:52:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0039f6a1-f815-42f7-9f6e-93d2b5dbe0d1 tempest-ProjectReaderTests-2136417288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e592e589-0822-497a-a641-b11b6c0ded1b 1073741824" returned: 0 in 0.631s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:52:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0039f6a1-f815-42f7-9f6e-93d2b5dbe0d1 tempest-ProjectReaderTests-2136417288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e592e589-0822-497a-a641-b11b6c0ded1b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:52:28 devstack sudo[95796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e592e589-0822-497a-a641-b11b6c0ded1b Sep 28 11:52:28 devstack sudo[95796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:52:29 devstack sudo[95796]: pam_unix(sudo:session): session closed for user root Sep 28 11:52:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0039f6a1-f815-42f7-9f6e-93d2b5dbe0d1 tempest-ProjectReaderTests-2136417288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e592e589-0822-497a-a641-b11b6c0ded1b" returned: 0 in 0.294s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:52:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0039f6a1-f815-42f7-9f6e-93d2b5dbe0d1 tempest-ProjectReaderTests-2136417288 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:52:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0039f6a1-f815-42f7-9f6e-93d2b5dbe0d1 tempest-ProjectReaderTests-2136417288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:52:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0039f6a1-f815-42f7-9f6e-93d2b5dbe0d1 tempest-ProjectReaderTests-2136417288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d89cab7-8940-431d-b15e-32547bbe3727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e592e589-0822-497a-a641-b11b6c0ded1b', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:52:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0039f6a1-f815-42f7-9f6e-93d2b5dbe0d1 tempest-ProjectReaderTests-2136417288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd1369b1-094d-4bd2-82fa-54a7a7c7033b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:52:29 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-0039f6a1-f815-42f7-9f6e-93d2b5dbe0d1 tempest-ProjectReaderTests-2136417288 None] Volume volume-e592e589-0822-497a-a641-b11b6c0ded1b (e592e589-0822-497a-a641-b11b6c0ded1b): created successfully Sep 28 11:52:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0039f6a1-f815-42f7-9f6e-93d2b5dbe0d1 tempest-ProjectReaderTests-2136417288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd1369b1-094d-4bd2-82fa-54a7a7c7033b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:52:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0039f6a1-f815-42f7-9f6e-93d2b5dbe0d1 tempest-ProjectReaderTests-2136417288 None] Flow 'volume_create_manager' (ad8d1198-a5d0-45e0-9d10-2281fbfe81aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:52:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2eafd515-0ab9-441a-99ad-df82e0074b40 tempest-VolumesActionsTest-858037443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:52:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2eafd515-0ab9-441a-99ad-df82e0074b40 tempest-VolumesActionsTest-858037443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:52:29 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-0039f6a1-f815-42f7-9f6e-93d2b5dbe0d1 tempest-ProjectReaderTests-2136417288 None] Created volume successfully. Sep 28 11:52:29 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db7d2db-6788-4537-840c-de02a4ca62f7]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:52:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2eafd515-0ab9-441a-99ad-df82e0074b40 tempest-VolumesActionsTest-858037443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-05b91ca5-7286-418f-96d1-c353cc38c535 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:52:29 devstack sudo[95799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-05b91ca5-7286-418f-96d1-c353cc38c535 Sep 28 11:52:29 devstack sudo[95799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:52:29 devstack sudo[95799]: pam_unix(sudo:session): session closed for user root Sep 28 11:52:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2eafd515-0ab9-441a-99ad-df82e0074b40 tempest-VolumesActionsTest-858037443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-05b91ca5-7286-418f-96d1-c353cc38c535" returned: 0 in 0.439s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:52:29 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6c2205-94bd-4720-afad-656eba736118]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:52:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2eafd515-0ab9-441a-99ad-df82e0074b40 tempest-VolumesActionsTest-858037443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-05b91ca5-7286-418f-96d1-c353cc38c535 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:52:29 devstack sudo[95807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-05b91ca5-7286-418f-96d1-c353cc38c535 Sep 28 11:52:29 devstack sudo[95807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:52:30 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0698c418-51cb-4054-9cbc-5a65f244dd91 tempest-ProjectReaderTests-2136417288 None] Acquiring lock "cinder-e592e589-0822-497a-a641-b11b6c0ded1b-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:52:30 devstack sudo[95807]: pam_unix(sudo:session): session closed for user root Sep 28 11:52:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2eafd515-0ab9-441a-99ad-df82e0074b40 tempest-VolumesActionsTest-858037443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-05b91ca5-7286-418f-96d1-c353cc38c535" returned: 0 in 0.430s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:52:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2eafd515-0ab9-441a-99ad-df82e0074b40 tempest-VolumesActionsTest-858037443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-05b91ca5-7286-418f-96d1-c353cc38c535 /opt/stack/data/cinder/conversion/05b91ca5-7286-418f-96d1-c353cc38c535.temp_image.9b516422-fc60-4d15-ad9a-4551fd6f8863rf_uodgl.img {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:52:30 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0698c418-51cb-4054-9cbc-5a65f244dd91 tempest-ProjectReaderTests-2136417288 None] Lock "cinder-e592e589-0822-497a-a641-b11b6c0ded1b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:52:30 devstack sudo[95813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-05b91ca5-7286-418f-96d1-c353cc38c535 /opt/stack/data/cinder/conversion/05b91ca5-7286-418f-96d1-c353cc38c535.temp_image.9b516422-fc60-4d15-ad9a-4551fd6f8863rf_uodgl.img Sep 28 11:52:30 devstack sudo[95813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:52:30 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0698c418-51cb-4054-9cbc-5a65f244dd91 tempest-ProjectReaderTests-2136417288 None] Acquiring lock "cinder-quobyte-e592e589-0822-497a-a641-b11b6c0ded1b" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:52:30 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0698c418-51cb-4054-9cbc-5a65f244dd91 tempest-ProjectReaderTests-2136417288 None] Lock "cinder-quobyte-e592e589-0822-497a-a641-b11b6c0ded1b" acquired by "delete_volume" :: waited 0.032s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:52:30 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f557e3-14cd-4e8a-a8bb-bcda555dd1c8]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:52:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0698c418-51cb-4054-9cbc-5a65f244dd91 tempest-ProjectReaderTests-2136417288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e592e589-0822-497a-a641-b11b6c0ded1b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:52:30 devstack sudo[95815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e592e589-0822-497a-a641-b11b6c0ded1b Sep 28 11:52:30 devstack sudo[95815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:52:31 devstack sudo[95815]: pam_unix(sudo:session): session closed for user root Sep 28 11:52:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0698c418-51cb-4054-9cbc-5a65f244dd91 tempest-ProjectReaderTests-2136417288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e592e589-0822-497a-a641-b11b6c0ded1b" returned: 0 in 0.789s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:52:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0698c418-51cb-4054-9cbc-5a65f244dd91 tempest-ProjectReaderTests-2136417288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e592e589-0822-497a-a641-b11b6c0ded1b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:52:31 devstack sudo[95831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e592e589-0822-497a-a641-b11b6c0ded1b Sep 28 11:52:31 devstack sudo[95831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:52:31 devstack sudo[95831]: pam_unix(sudo:session): session closed for user root Sep 28 11:52:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0698c418-51cb-4054-9cbc-5a65f244dd91 tempest-ProjectReaderTests-2136417288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e592e589-0822-497a-a641-b11b6c0ded1b" returned: 0 in 0.432s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:52:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0698c418-51cb-4054-9cbc-5a65f244dd91 tempest-ProjectReaderTests-2136417288 None] Lock "cinder-quobyte-e592e589-0822-497a-a641-b11b6c0ded1b" released by "delete_volume" :: held 1.294s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:52:31 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-0698c418-51cb-4054-9cbc-5a65f244dd91 tempest-ProjectReaderTests-2136417288 None] Created reservations ['d3a328c6-f1c2-4cdd-a1b9-aa354c27c260', '2f5311f8-8b73-4c9d-a0a3-2a344028c9fb', 'd2cc753a-cc92-499b-92b0-26d0dd0b0560', '32884fd5-c986-444c-b109-b6b00e0bd95c'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:52:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0698c418-51cb-4054-9cbc-5a65f244dd91 tempest-ProjectReaderTests-2136417288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:52:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0698c418-51cb-4054-9cbc-5a65f244dd91 tempest-ProjectReaderTests-2136417288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:52:31 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0698c418-51cb-4054-9cbc-5a65f244dd91 tempest-ProjectReaderTests-2136417288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:52:31 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0698c418-51cb-4054-9cbc-5a65f244dd91 tempest-ProjectReaderTests-2136417288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:52:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0698c418-51cb-4054-9cbc-5a65f244dd91 tempest-ProjectReaderTests-2136417288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:52:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0698c418-51cb-4054-9cbc-5a65f244dd91 tempest-ProjectReaderTests-2136417288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:52:31 devstack sudo[95834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:52:31 devstack sudo[95834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:52:32 devstack sudo[95834]: pam_unix(sudo:session): session closed for user root Sep 28 11:52:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0698c418-51cb-4054-9cbc-5a65f244dd91 tempest-ProjectReaderTests-2136417288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.400s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:52:32 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-0698c418-51cb-4054-9cbc-5a65f244dd91 tempest-ProjectReaderTests-2136417288 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:52:32 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-0698c418-51cb-4054-9cbc-5a65f244dd91 tempest-ProjectReaderTests-2136417288 None] Deleted volume successfully. Sep 28 11:52:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0698c418-51cb-4054-9cbc-5a65f244dd91 tempest-ProjectReaderTests-2136417288 None] Lock "cinder-e592e589-0822-497a-a641-b11b6c0ded1b-delete_volume" released by "delete_volume" :: held 2.194s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:52:37 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bbb03d9-eb44-44cc-8eae-b53fb3296896 tempest-AttachVolumeTestJSON-1340154457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:52:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7bbb03d9-eb44-44cc-8eae-b53fb3296896 tempest-AttachVolumeTestJSON-1340154457 None] Flow 'volume_create_manager' (f1ac8c06-21d6-440c-ba4b-05d3ade21b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:52:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7bbb03d9-eb44-44cc-8eae-b53fb3296896 tempest-AttachVolumeTestJSON-1340154457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa91ca7b-cf11-4b33-8787-39a86a74a8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:52:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7bbb03d9-eb44-44cc-8eae-b53fb3296896 tempest-AttachVolumeTestJSON-1340154457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa91ca7b-cf11-4b33-8787-39a86a74a8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:52:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-17384439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=834a030d-15df-4cf0-b8c7-1f809e9d9333,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='593a37e7b16141da90cbf6cf071519ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:52:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:52:37Z,use_quota=True,user_id='813df1ee376742609bf91a672cfd6306',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:52:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7bbb03d9-eb44-44cc-8eae-b53fb3296896 tempest-AttachVolumeTestJSON-1340154457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (479dd8ee-b0b4-4f0d-a0f8-d76ec13dd596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:52:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7bbb03d9-eb44-44cc-8eae-b53fb3296896 tempest-AttachVolumeTestJSON-1340154457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (479dd8ee-b0b4-4f0d-a0f8-d76ec13dd596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:52:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7bbb03d9-eb44-44cc-8eae-b53fb3296896 tempest-AttachVolumeTestJSON-1340154457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54804865-8cad-470c-8606-f420268776be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:52:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7bbb03d9-eb44-44cc-8eae-b53fb3296896 tempest-AttachVolumeTestJSON-1340154457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54804865-8cad-470c-8606-f420268776be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '834a030d-15df-4cf0-b8c7-1f809e9d9333', 'volume_name': 'volume-834a030d-15df-4cf0-b8c7-1f809e9d9333', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:52:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7bbb03d9-eb44-44cc-8eae-b53fb3296896 tempest-AttachVolumeTestJSON-1340154457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fb86470-e831-4231-b125-37274eb11b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:52:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7bbb03d9-eb44-44cc-8eae-b53fb3296896 tempest-AttachVolumeTestJSON-1340154457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fb86470-e831-4231-b125-37274eb11b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:52:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7bbb03d9-eb44-44cc-8eae-b53fb3296896 tempest-AttachVolumeTestJSON-1340154457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af49be70-5457-4b9a-9bc5-6d1c48b2daf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:52:37 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-7bbb03d9-eb44-44cc-8eae-b53fb3296896 tempest-AttachVolumeTestJSON-1340154457 None] Volume 834a030d-15df-4cf0-b8c7-1f809e9d9333: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-834a030d-15df-4cf0-b8c7-1f809e9d9333', 'volume_size': 1} Sep 28 11:52:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7bbb03d9-eb44-44cc-8eae-b53fb3296896 tempest-AttachVolumeTestJSON-1340154457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:52:38 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 11:52:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:52:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:52:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:52:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:52:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:52:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:52:38 devstack sudo[95844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:52:38 devstack sudo[95844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:52:39 devstack sudo[95844]: pam_unix(sudo:session): session closed for user root Sep 28 11:52:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.418s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:52:39 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:52:39 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 11:52:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] thread count: 28 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 11:52:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] thread info: [<_MainThread(MainThread, started 135408582168704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 11:52:39 devstack sudo[95813]: pam_unix(sudo:session): session closed for user root Sep 28 11:52:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2eafd515-0ab9-441a-99ad-df82e0074b40 tempest-VolumesActionsTest-858037443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-05b91ca5-7286-418f-96d1-c353cc38c535 /opt/stack/data/cinder/conversion/05b91ca5-7286-418f-96d1-c353cc38c535.temp_image.9b516422-fc60-4d15-ad9a-4551fd6f8863rf_uodgl.img" returned: 0 in 8.996s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:52:39 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[456972d7-a67f-4dde-b74e-fd150689a7c5]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:52:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2eafd515-0ab9-441a-99ad-df82e0074b40 tempest-VolumesActionsTest-858037443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-05b91ca5-7286-418f-96d1-c353cc38c535 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:52:39 devstack sudo[95847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-05b91ca5-7286-418f-96d1-c353cc38c535 Sep 28 11:52:39 devstack sudo[95847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:52:39 devstack sudo[95847]: pam_unix(sudo:session): session closed for user root Sep 28 11:52:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2eafd515-0ab9-441a-99ad-df82e0074b40 tempest-VolumesActionsTest-858037443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-05b91ca5-7286-418f-96d1-c353cc38c535" returned: 0 in 0.646s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:52:39 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-2eafd515-0ab9-441a-99ad-df82e0074b40 tempest-VolumesActionsTest-858037443 None] Image conversion details: src /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-05b91ca5-7286-418f-96d1-c353cc38c535, size 1024.00 MB, duration 9.00 sec, destination /opt/stack/data/cinder/conversion/05b91ca5-7286-418f-96d1-c353cc38c535.temp_image.9b516422-fc60-4d15-ad9a-4551fd6f8863rf_uodgl.img {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 11:52:39 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-2eafd515-0ab9-441a-99ad-df82e0074b40 tempest-VolumesActionsTest-858037443 None] Converted 1024.00 MB image at 113.81 MB/s Sep 28 11:52:39 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-2eafd515-0ab9-441a-99ad-df82e0074b40 tempest-VolumesActionsTest-858037443 None] 9b516422-fc60-4d15-ad9a-4551fd6f8863 was raw, no need to convert to raw {{(pid=86916) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 28 11:52:49 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=71,cinder:INSERT=14,cinder:UPDATE=62,cinder:DELETE=3 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 11:52:49 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:UPDATE=63,cinder:SELECT=54,cinder:DELETE=7,cinder:INSERT=16 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 11:53:07 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-61a74421-9d61-420a-8185-bc5af3de771f tempest-SnapshotDependencyTests-164277995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:53:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-61a74421-9d61-420a-8185-bc5af3de771f tempest-SnapshotDependencyTests-164277995 None] Flow 'volume_create_manager' (f8db6703-c6d3-40d5-aa6b-90075c528591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:53:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-61a74421-9d61-420a-8185-bc5af3de771f tempest-SnapshotDependencyTests-164277995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b23f8263-10c0-496e-85e3-a960220e5390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:53:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-61a74421-9d61-420a-8185-bc5af3de771f tempest-SnapshotDependencyTests-164277995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b23f8263-10c0-496e-85e3-a960220e5390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:53:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-502080331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94586c97-6d2e-40fa-9151-15d795b22375,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb1610fb22e749f1944847a4f41b558a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:53:08Z,use_quota=True,user_id='b0bd1700c97544249f813620e279ac58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:53:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-61a74421-9d61-420a-8185-bc5af3de771f tempest-SnapshotDependencyTests-164277995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05979b80-e41d-4c35-b411-b6a8219a14cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:53:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-61a74421-9d61-420a-8185-bc5af3de771f tempest-SnapshotDependencyTests-164277995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05979b80-e41d-4c35-b411-b6a8219a14cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:53:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-61a74421-9d61-420a-8185-bc5af3de771f tempest-SnapshotDependencyTests-164277995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68f169e2-6e5a-4930-bedb-af54ce70373e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:53:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-61a74421-9d61-420a-8185-bc5af3de771f tempest-SnapshotDependencyTests-164277995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68f169e2-6e5a-4930-bedb-af54ce70373e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94586c97-6d2e-40fa-9151-15d795b22375', 'volume_name': 'volume-94586c97-6d2e-40fa-9151-15d795b22375', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:53:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-61a74421-9d61-420a-8185-bc5af3de771f tempest-SnapshotDependencyTests-164277995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5316ac5a-49f2-444d-ba16-f1a63240849e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:53:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-61a74421-9d61-420a-8185-bc5af3de771f tempest-SnapshotDependencyTests-164277995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5316ac5a-49f2-444d-ba16-f1a63240849e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:53:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-61a74421-9d61-420a-8185-bc5af3de771f tempest-SnapshotDependencyTests-164277995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dde2c186-38f8-4c73-b9ec-b0c3a7f84592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:53:07 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-61a74421-9d61-420a-8185-bc5af3de771f tempest-SnapshotDependencyTests-164277995 None] Volume 94586c97-6d2e-40fa-9151-15d795b22375: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94586c97-6d2e-40fa-9151-15d795b22375', 'volume_size': 1} Sep 28 11:53:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-61a74421-9d61-420a-8185-bc5af3de771f tempest-SnapshotDependencyTests-164277995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:53:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2eafd515-0ab9-441a-99ad-df82e0074b40 tempest-VolumesActionsTest-858037443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 39.929s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:53:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2eafd515-0ab9-441a-99ad-df82e0074b40 tempest-VolumesActionsTest-858037443 None] Uploaded volume to glance image-id: 9b516422-fc60-4d15-ad9a-4551fd6f8863. {{(pid=86916) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 11:53:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7bbb03d9-eb44-44cc-8eae-b53fb3296896 tempest-AttachVolumeTestJSON-1340154457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 31.345s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:53:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7bbb03d9-eb44-44cc-8eae-b53fb3296896 tempest-AttachVolumeTestJSON-1340154457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:52:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-17384439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=834a030d-15df-4cf0-b8c7-1f809e9d9333,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='593a37e7b16141da90cbf6cf071519ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:52:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:52:37Z,use_quota=True,user_id='813df1ee376742609bf91a672cfd6306',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:53:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-7bbb03d9-eb44-44cc-8eae-b53fb3296896 tempest-AttachVolumeTestJSON-1340154457 None] Creating volume 834a030d-15df-4cf0-b8c7-1f809e9d9333 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:53:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7bbb03d9-eb44-44cc-8eae-b53fb3296896 tempest-AttachVolumeTestJSON-1340154457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:53:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7bbb03d9-eb44-44cc-8eae-b53fb3296896 tempest-AttachVolumeTestJSON-1340154457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:53:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7bbb03d9-eb44-44cc-8eae-b53fb3296896 tempest-AttachVolumeTestJSON-1340154457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:53:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7bbb03d9-eb44-44cc-8eae-b53fb3296896 tempest-AttachVolumeTestJSON-1340154457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:53:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7bbb03d9-eb44-44cc-8eae-b53fb3296896 tempest-AttachVolumeTestJSON-1340154457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:53:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7bbb03d9-eb44-44cc-8eae-b53fb3296896 tempest-AttachVolumeTestJSON-1340154457 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:53:09 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-7bbb03d9-eb44-44cc-8eae-b53fb3296896 tempest-AttachVolumeTestJSON-1340154457 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:53:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7bbb03d9-eb44-44cc-8eae-b53fb3296896 tempest-AttachVolumeTestJSON-1340154457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-834a030d-15df-4cf0-b8c7-1f809e9d9333 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:09 devstack sudo[96053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-834a030d-15df-4cf0-b8c7-1f809e9d9333 1073741824 Sep 28 11:53:09 devstack sudo[96053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:09 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-2eafd515-0ab9-441a-99ad-df82e0074b40 tempest-VolumesActionsTest-858037443 None] Copy volume to image completed successfully. Sep 28 11:53:09 devstack sudo[96053]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7bbb03d9-eb44-44cc-8eae-b53fb3296896 tempest-AttachVolumeTestJSON-1340154457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-834a030d-15df-4cf0-b8c7-1f809e9d9333 1073741824" returned: 0 in 0.500s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7bbb03d9-eb44-44cc-8eae-b53fb3296896 tempest-AttachVolumeTestJSON-1340154457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-834a030d-15df-4cf0-b8c7-1f809e9d9333 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:09 devstack sudo[96059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-834a030d-15df-4cf0-b8c7-1f809e9d9333 Sep 28 11:53:09 devstack sudo[96059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:09 devstack sudo[96059]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7bbb03d9-eb44-44cc-8eae-b53fb3296896 tempest-AttachVolumeTestJSON-1340154457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-834a030d-15df-4cf0-b8c7-1f809e9d9333" returned: 0 in 0.297s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7bbb03d9-eb44-44cc-8eae-b53fb3296896 tempest-AttachVolumeTestJSON-1340154457 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:53:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7bbb03d9-eb44-44cc-8eae-b53fb3296896 tempest-AttachVolumeTestJSON-1340154457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:53:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-61a74421-9d61-420a-8185-bc5af3de771f tempest-SnapshotDependencyTests-164277995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.207s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:53:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-61a74421-9d61-420a-8185-bc5af3de771f tempest-SnapshotDependencyTests-164277995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:53:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-502080331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94586c97-6d2e-40fa-9151-15d795b22375,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb1610fb22e749f1944847a4f41b558a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:53:08Z,use_quota=True,user_id='b0bd1700c97544249f813620e279ac58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:53:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-61a74421-9d61-420a-8185-bc5af3de771f tempest-SnapshotDependencyTests-164277995 None] Creating volume 94586c97-6d2e-40fa-9151-15d795b22375 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:53:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-61a74421-9d61-420a-8185-bc5af3de771f tempest-SnapshotDependencyTests-164277995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:53:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-61a74421-9d61-420a-8185-bc5af3de771f tempest-SnapshotDependencyTests-164277995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:53:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-61a74421-9d61-420a-8185-bc5af3de771f tempest-SnapshotDependencyTests-164277995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:53:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-61a74421-9d61-420a-8185-bc5af3de771f tempest-SnapshotDependencyTests-164277995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:53:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-61a74421-9d61-420a-8185-bc5af3de771f tempest-SnapshotDependencyTests-164277995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:53:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-61a74421-9d61-420a-8185-bc5af3de771f tempest-SnapshotDependencyTests-164277995 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:53:10 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-61a74421-9d61-420a-8185-bc5af3de771f tempest-SnapshotDependencyTests-164277995 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:53:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-61a74421-9d61-420a-8185-bc5af3de771f tempest-SnapshotDependencyTests-164277995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-94586c97-6d2e-40fa-9151-15d795b22375 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7bbb03d9-eb44-44cc-8eae-b53fb3296896 tempest-AttachVolumeTestJSON-1340154457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af49be70-5457-4b9a-9bc5-6d1c48b2daf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-834a030d-15df-4cf0-b8c7-1f809e9d9333', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:53:10 devstack sudo[96062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-94586c97-6d2e-40fa-9151-15d795b22375 1073741824 Sep 28 11:53:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7bbb03d9-eb44-44cc-8eae-b53fb3296896 tempest-AttachVolumeTestJSON-1340154457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af126517-e943-43eb-8973-234dfae31363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:53:10 devstack sudo[96062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:10 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-7bbb03d9-eb44-44cc-8eae-b53fb3296896 tempest-AttachVolumeTestJSON-1340154457 None] Volume volume-834a030d-15df-4cf0-b8c7-1f809e9d9333 (834a030d-15df-4cf0-b8c7-1f809e9d9333): created successfully Sep 28 11:53:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7bbb03d9-eb44-44cc-8eae-b53fb3296896 tempest-AttachVolumeTestJSON-1340154457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af126517-e943-43eb-8973-234dfae31363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:53:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7bbb03d9-eb44-44cc-8eae-b53fb3296896 tempest-AttachVolumeTestJSON-1340154457 None] Flow 'volume_create_manager' (f1ac8c06-21d6-440c-ba4b-05d3ade21b08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:53:10 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-7bbb03d9-eb44-44cc-8eae-b53fb3296896 tempest-AttachVolumeTestJSON-1340154457 None] Created volume successfully. Sep 28 11:53:10 devstack sudo[96062]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-61a74421-9d61-420a-8185-bc5af3de771f tempest-SnapshotDependencyTests-164277995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-94586c97-6d2e-40fa-9151-15d795b22375 1073741824" returned: 0 in 0.435s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-61a74421-9d61-420a-8185-bc5af3de771f tempest-SnapshotDependencyTests-164277995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-94586c97-6d2e-40fa-9151-15d795b22375 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:10 devstack sudo[96068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-94586c97-6d2e-40fa-9151-15d795b22375 Sep 28 11:53:10 devstack sudo[96068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c30a398e-68bb-48d3-9718-5661a9ddb096 tempest-VolumesActionsTest-858037443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:53:10 devstack sudo[96068]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-61a74421-9d61-420a-8185-bc5af3de771f tempest-SnapshotDependencyTests-164277995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-94586c97-6d2e-40fa-9151-15d795b22375" returned: 0 in 0.268s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-61a74421-9d61-420a-8185-bc5af3de771f tempest-SnapshotDependencyTests-164277995 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:53:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-61a74421-9d61-420a-8185-bc5af3de771f tempest-SnapshotDependencyTests-164277995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:53:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c30a398e-68bb-48d3-9718-5661a9ddb096 tempest-VolumesActionsTest-858037443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.053s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:53:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-61a74421-9d61-420a-8185-bc5af3de771f tempest-SnapshotDependencyTests-164277995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dde2c186-38f8-4c73-b9ec-b0c3a7f84592) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94586c97-6d2e-40fa-9151-15d795b22375', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:53:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-61a74421-9d61-420a-8185-bc5af3de771f tempest-SnapshotDependencyTests-164277995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (188a333a-6c41-4d0d-b11a-ad08b1d166c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:53:10 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[929d3a44-e55a-4895-849d-95d5e22eed4d]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:53:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c30a398e-68bb-48d3-9718-5661a9ddb096 tempest-VolumesActionsTest-858037443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-05b91ca5-7286-418f-96d1-c353cc38c535 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:10 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-61a74421-9d61-420a-8185-bc5af3de771f tempest-SnapshotDependencyTests-164277995 None] Volume volume-94586c97-6d2e-40fa-9151-15d795b22375 (94586c97-6d2e-40fa-9151-15d795b22375): created successfully Sep 28 11:53:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-61a74421-9d61-420a-8185-bc5af3de771f tempest-SnapshotDependencyTests-164277995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (188a333a-6c41-4d0d-b11a-ad08b1d166c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:53:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-61a74421-9d61-420a-8185-bc5af3de771f tempest-SnapshotDependencyTests-164277995 None] Flow 'volume_create_manager' (f8db6703-c6d3-40d5-aa6b-90075c528591) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:53:10 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-61a74421-9d61-420a-8185-bc5af3de771f tempest-SnapshotDependencyTests-164277995 None] Created volume successfully. Sep 28 11:53:10 devstack sudo[96071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-05b91ca5-7286-418f-96d1-c353cc38c535 Sep 28 11:53:10 devstack sudo[96071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:11 devstack sudo[96071]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c30a398e-68bb-48d3-9718-5661a9ddb096 tempest-VolumesActionsTest-858037443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-05b91ca5-7286-418f-96d1-c353cc38c535" returned: 0 in 0.398s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:11 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f56bb0-a688-4f80-9549-f30b7804ff72]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:53:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c30a398e-68bb-48d3-9718-5661a9ddb096 tempest-VolumesActionsTest-858037443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-05b91ca5-7286-418f-96d1-c353cc38c535 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:11 devstack sudo[96079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-05b91ca5-7286-418f-96d1-c353cc38c535 Sep 28 11:53:11 devstack sudo[96079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-303a8a3f-50f6-45f3-9f36-d5c194fc9519 req-25d1f3b2-4d28-49b7-a888-5d3bd3e981e7 tempest-AttachVolumeTestJSON-1340154457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:53:11 devstack sudo[96079]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c30a398e-68bb-48d3-9718-5661a9ddb096 tempest-VolumesActionsTest-858037443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-05b91ca5-7286-418f-96d1-c353cc38c535" returned: 0 in 0.397s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c30a398e-68bb-48d3-9718-5661a9ddb096 tempest-VolumesActionsTest-858037443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-05b91ca5-7286-418f-96d1-c353cc38c535 /opt/stack/data/cinder/conversion/05b91ca5-7286-418f-96d1-c353cc38c535.temp_image.5628de94-43ba-4c9f-abcf-fcffd0c3dabalx60xnfo.img {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:11 devstack sudo[96092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-05b91ca5-7286-418f-96d1-c353cc38c535 /opt/stack/data/cinder/conversion/05b91ca5-7286-418f-96d1-c353cc38c535.temp_image.5628de94-43ba-4c9f-abcf-fcffd0c3dabalx60xnfo.img Sep 28 11:53:11 devstack sudo[96092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-01740aa8-0d01-4a97-b140-fe0a4be1a0a2 tempest-SnapshotDependencyTests-164277995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:53:16 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-984504c8-fa2d-4755-a882-56ebfc604e48 tempest-AttachVolumeNegativeTest-962283120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:53:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-984504c8-fa2d-4755-a882-56ebfc604e48 tempest-AttachVolumeNegativeTest-962283120 None] Flow 'volume_create_manager' (672b7af1-d763-440b-9c8f-172de4c0329b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:53:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-984504c8-fa2d-4755-a882-56ebfc604e48 tempest-AttachVolumeNegativeTest-962283120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ae75dda-3f2f-4d9b-a279-ec481a053505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:53:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-984504c8-fa2d-4755-a882-56ebfc604e48 tempest-AttachVolumeNegativeTest-962283120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ae75dda-3f2f-4d9b-a279-ec481a053505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:53:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2069079600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=310ebfc3-a6f1-42a9-b513-ec3b4310ec19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81ba3469bda8465fb145a233aec61f60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:53:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:53:16Z,use_quota=True,user_id='482c85c2bda54ca5a179eca038a733ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:53:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-984504c8-fa2d-4755-a882-56ebfc604e48 tempest-AttachVolumeNegativeTest-962283120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11c1485b-ba46-43ff-8dc1-72914129e556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:53:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-984504c8-fa2d-4755-a882-56ebfc604e48 tempest-AttachVolumeNegativeTest-962283120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11c1485b-ba46-43ff-8dc1-72914129e556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:53:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-984504c8-fa2d-4755-a882-56ebfc604e48 tempest-AttachVolumeNegativeTest-962283120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74dd3d62-8a74-48ef-bd89-e9211f976c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:53:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-984504c8-fa2d-4755-a882-56ebfc604e48 tempest-AttachVolumeNegativeTest-962283120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74dd3d62-8a74-48ef-bd89-e9211f976c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '310ebfc3-a6f1-42a9-b513-ec3b4310ec19', 'volume_name': 'volume-310ebfc3-a6f1-42a9-b513-ec3b4310ec19', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:53:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-984504c8-fa2d-4755-a882-56ebfc604e48 tempest-AttachVolumeNegativeTest-962283120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (329bc4a1-a3da-417c-a1c9-b070be452044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:53:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-984504c8-fa2d-4755-a882-56ebfc604e48 tempest-AttachVolumeNegativeTest-962283120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (329bc4a1-a3da-417c-a1c9-b070be452044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:53:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-984504c8-fa2d-4755-a882-56ebfc604e48 tempest-AttachVolumeNegativeTest-962283120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41f1047d-da6e-4095-a479-ef9886fedad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:53:16 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-984504c8-fa2d-4755-a882-56ebfc604e48 tempest-AttachVolumeNegativeTest-962283120 None] Volume 310ebfc3-a6f1-42a9-b513-ec3b4310ec19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-310ebfc3-a6f1-42a9-b513-ec3b4310ec19', 'volume_size': 1} Sep 28 11:53:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-984504c8-fa2d-4755-a882-56ebfc604e48 tempest-AttachVolumeNegativeTest-962283120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:53:17 devstack sudo[96092]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c30a398e-68bb-48d3-9718-5661a9ddb096 tempest-VolumesActionsTest-858037443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-05b91ca5-7286-418f-96d1-c353cc38c535 /opt/stack/data/cinder/conversion/05b91ca5-7286-418f-96d1-c353cc38c535.temp_image.5628de94-43ba-4c9f-abcf-fcffd0c3dabalx60xnfo.img" returned: 0 in 6.072s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:17 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[14bbe6b8-8e07-44bd-8412-8030731b54aa]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:53:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c30a398e-68bb-48d3-9718-5661a9ddb096 tempest-VolumesActionsTest-858037443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-05b91ca5-7286-418f-96d1-c353cc38c535 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:17 devstack sudo[96113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-05b91ca5-7286-418f-96d1-c353cc38c535 Sep 28 11:53:17 devstack sudo[96113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:18 devstack sudo[96113]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c30a398e-68bb-48d3-9718-5661a9ddb096 tempest-VolumesActionsTest-858037443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-05b91ca5-7286-418f-96d1-c353cc38c535" returned: 0 in 0.521s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:18 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-c30a398e-68bb-48d3-9718-5661a9ddb096 tempest-VolumesActionsTest-858037443 None] Image conversion details: src /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-05b91ca5-7286-418f-96d1-c353cc38c535, size 1024.00 MB, duration 6.07 sec, destination /opt/stack/data/cinder/conversion/05b91ca5-7286-418f-96d1-c353cc38c535.temp_image.5628de94-43ba-4c9f-abcf-fcffd0c3dabalx60xnfo.img {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 11:53:18 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-c30a398e-68bb-48d3-9718-5661a9ddb096 tempest-VolumesActionsTest-858037443 None] Converted 1024.00 MB image at 168.63 MB/s Sep 28 11:53:18 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-c30a398e-68bb-48d3-9718-5661a9ddb096 tempest-VolumesActionsTest-858037443 None] 5628de94-43ba-4c9f-abcf-fcffd0c3daba was raw, converting to qcow2 {{(pid=86916) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 28 11:53:18 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b085966-cea6-4725-b000-80c8b4c83d37]: (4, 'raw') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:53:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c30a398e-68bb-48d3-9718-5661a9ddb096 tempest-VolumesActionsTest-858037443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/05b91ca5-7286-418f-96d1-c353cc38c535.temp_image.5628de94-43ba-4c9f-abcf-fcffd0c3dabalx60xnfo.img {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:18 devstack sudo[96118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/05b91ca5-7286-418f-96d1-c353cc38c535.temp_image.5628de94-43ba-4c9f-abcf-fcffd0c3dabalx60xnfo.img Sep 28 11:53:18 devstack sudo[96118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:18 devstack sudo[96118]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c30a398e-68bb-48d3-9718-5661a9ddb096 tempest-VolumesActionsTest-858037443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/05b91ca5-7286-418f-96d1-c353cc38c535.temp_image.5628de94-43ba-4c9f-abcf-fcffd0c3dabalx60xnfo.img" returned: 0 in 0.313s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c30a398e-68bb-48d3-9718-5661a9ddb096 tempest-VolumesActionsTest-858037443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/05b91ca5-7286-418f-96d1-c353cc38c535.temp_image.5628de94-43ba-4c9f-abcf-fcffd0c3dabalx60xnfo.img {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:18 devstack sudo[96122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/05b91ca5-7286-418f-96d1-c353cc38c535.temp_image.5628de94-43ba-4c9f-abcf-fcffd0c3dabalx60xnfo.img Sep 28 11:53:18 devstack sudo[96122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:18 devstack sudo[96122]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c30a398e-68bb-48d3-9718-5661a9ddb096 tempest-VolumesActionsTest-858037443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/05b91ca5-7286-418f-96d1-c353cc38c535.temp_image.5628de94-43ba-4c9f-abcf-fcffd0c3dabalx60xnfo.img" returned: 1 in 0.330s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c30a398e-68bb-48d3-9718-5661a9ddb096 tempest-VolumesActionsTest-858037443 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/05b91ca5-7286-418f-96d1-c353cc38c535.temp_image.5628de94-43ba-4c9f-abcf-fcffd0c3dabalx60xnfo.img' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 11:53:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c30a398e-68bb-48d3-9718-5661a9ddb096 tempest-VolumesActionsTest-858037443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/05b91ca5-7286-418f-96d1-c353cc38c535.temp_image.5628de94-43ba-4c9f-abcf-fcffd0c3dabalx60xnfo.img /opt/stack/data/cinder/conversion/vol_upload_8nieaekp {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:18 devstack sudo[96127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/05b91ca5-7286-418f-96d1-c353cc38c535.temp_image.5628de94-43ba-4c9f-abcf-fcffd0c3dabalx60xnfo.img /opt/stack/data/cinder/conversion/vol_upload_8nieaekp Sep 28 11:53:18 devstack sudo[96127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:19 devstack sudo[96127]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c30a398e-68bb-48d3-9718-5661a9ddb096 tempest-VolumesActionsTest-858037443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/05b91ca5-7286-418f-96d1-c353cc38c535.temp_image.5628de94-43ba-4c9f-abcf-fcffd0c3dabalx60xnfo.img /opt/stack/data/cinder/conversion/vol_upload_8nieaekp" returned: 0 in 0.252s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:19 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-c30a398e-68bb-48d3-9718-5661a9ddb096 tempest-VolumesActionsTest-858037443 None] Image conversion details: src /opt/stack/data/cinder/conversion/05b91ca5-7286-418f-96d1-c353cc38c535.temp_image.5628de94-43ba-4c9f-abcf-fcffd0c3dabalx60xnfo.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_8nieaekp {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 11:53:19 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-c30a398e-68bb-48d3-9718-5661a9ddb096 tempest-VolumesActionsTest-858037443 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 28 11:53:19 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2be65f-9da4-4010-b695-de0e9349b7c9]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:53:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c30a398e-68bb-48d3-9718-5661a9ddb096 tempest-VolumesActionsTest-858037443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_8nieaekp {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:19 devstack sudo[96133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_8nieaekp Sep 28 11:53:19 devstack sudo[96133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:19 devstack sudo[96133]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c30a398e-68bb-48d3-9718-5661a9ddb096 tempest-VolumesActionsTest-858037443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_8nieaekp" returned: 0 in 0.321s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c30a398e-68bb-48d3-9718-5661a9ddb096 tempest-VolumesActionsTest-858037443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.928s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:53:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c30a398e-68bb-48d3-9718-5661a9ddb096 tempest-VolumesActionsTest-858037443 None] Uploaded volume to glance image-id: 5628de94-43ba-4c9f-abcf-fcffd0c3daba. {{(pid=86916) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 11:53:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-303a8a3f-50f6-45f3-9f36-d5c194fc9519 req-25d1f3b2-4d28-49b7-a888-5d3bd3e981e7 tempest-AttachVolumeTestJSON-1340154457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.119s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:53:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-303a8a3f-50f6-45f3-9f36-d5c194fc9519 req-25d1f3b2-4d28-49b7-a888-5d3bd3e981e7 tempest-AttachVolumeTestJSON-1340154457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:53:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-01740aa8-0d01-4a97-b140-fe0a4be1a0a2 tempest-SnapshotDependencyTests-164277995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.369s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:53:20 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-c30a398e-68bb-48d3-9718-5661a9ddb096 tempest-VolumesActionsTest-858037443 None] Copy volume to image completed successfully. Sep 28 11:53:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-01740aa8-0d01-4a97-b140-fe0a4be1a0a2 tempest-SnapshotDependencyTests-164277995 None] Creating offline snapshot 5986cfac-3674-4cd3-9a2e-ad6fa46fd86e of volume 94586c97-6d2e-40fa-9151-15d795b22375 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 11:53:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-303a8a3f-50f6-45f3-9f36-d5c194fc9519 req-25d1f3b2-4d28-49b7-a888-5d3bd3e981e7 tempest-AttachVolumeTestJSON-1340154457 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0', 'name': 'volume-834a030d-15df-4cf0-b8c7-1f809e9d9333', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6c35741f-48d3-4c94-ba2f-4c0073b7526b', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 11:53:20 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[2194991c-8dbe-44eb-ae5b-8800269b45a0]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:53:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-01740aa8-0d01-4a97-b140-fe0a4be1a0a2 tempest-SnapshotDependencyTests-164277995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-94586c97-6d2e-40fa-9151-15d795b22375 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:20 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-303a8a3f-50f6-45f3-9f36-d5c194fc9519 req-25d1f3b2-4d28-49b7-a888-5d3bd3e981e7 tempest-AttachVolumeTestJSON-1340154457 None] attachment_update completed successfully. Sep 28 11:53:20 devstack sudo[96140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-94586c97-6d2e-40fa-9151-15d795b22375 Sep 28 11:53:20 devstack sudo[96140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:21 devstack sudo[96140]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-01740aa8-0d01-4a97-b140-fe0a4be1a0a2 tempest-SnapshotDependencyTests-164277995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-94586c97-6d2e-40fa-9151-15d795b22375" returned: 0 in 0.424s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-01740aa8-0d01-4a97-b140-fe0a4be1a0a2 tempest-SnapshotDependencyTests-164277995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-94586c97-6d2e-40fa-9151-15d795b22375,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-94586c97-6d2e-40fa-9151-15d795b22375.5986cfac-3674-4cd3-9a2e-ad6fa46fd86e 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:21 devstack sudo[96445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-94586c97-6d2e-40fa-9151-15d795b22375,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-94586c97-6d2e-40fa-9151-15d795b22375.5986cfac-3674-4cd3-9a2e-ad6fa46fd86e 1G Sep 28 11:53:21 devstack sudo[96445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:21 devstack sudo[96445]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-01740aa8-0d01-4a97-b140-fe0a4be1a0a2 tempest-SnapshotDependencyTests-164277995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-94586c97-6d2e-40fa-9151-15d795b22375,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-94586c97-6d2e-40fa-9151-15d795b22375.5986cfac-3674-4cd3-9a2e-ad6fa46fd86e 1G" returned: 0 in 0.548s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-01740aa8-0d01-4a97-b140-fe0a4be1a0a2 tempest-SnapshotDependencyTests-164277995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94586c97-6d2e-40fa-9151-15d795b22375 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-94586c97-6d2e-40fa-9151-15d795b22375.5986cfac-3674-4cd3-9a2e-ad6fa46fd86e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:21 devstack sudo[96566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94586c97-6d2e-40fa-9151-15d795b22375 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-94586c97-6d2e-40fa-9151-15d795b22375.5986cfac-3674-4cd3-9a2e-ad6fa46fd86e Sep 28 11:53:21 devstack sudo[96566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-047fd8d0-578e-4def-8772-24aedcde1ff8 tempest-VolumesActionsTest-858037443 None] Acquiring lock "cinder-05b91ca5-7286-418f-96d1-c353cc38c535-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:53:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-047fd8d0-578e-4def-8772-24aedcde1ff8 tempest-VolumesActionsTest-858037443 None] Lock "cinder-05b91ca5-7286-418f-96d1-c353cc38c535-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:53:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-047fd8d0-578e-4def-8772-24aedcde1ff8 tempest-VolumesActionsTest-858037443 None] Acquiring lock "cinder-quobyte-05b91ca5-7286-418f-96d1-c353cc38c535" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:53:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-047fd8d0-578e-4def-8772-24aedcde1ff8 tempest-VolumesActionsTest-858037443 None] Lock "cinder-quobyte-05b91ca5-7286-418f-96d1-c353cc38c535" acquired by "delete_volume" :: waited 0.021s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:53:22 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[1116907c-13d1-45be-bec5-e377cb8d7afb]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:53:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-047fd8d0-578e-4def-8772-24aedcde1ff8 tempest-VolumesActionsTest-858037443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-05b91ca5-7286-418f-96d1-c353cc38c535 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:22 devstack sudo[96566]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-01740aa8-0d01-4a97-b140-fe0a4be1a0a2 tempest-SnapshotDependencyTests-164277995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94586c97-6d2e-40fa-9151-15d795b22375 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-94586c97-6d2e-40fa-9151-15d795b22375.5986cfac-3674-4cd3-9a2e-ad6fa46fd86e" returned: 0 in 0.361s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:22 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-01740aa8-0d01-4a97-b140-fe0a4be1a0a2 tempest-SnapshotDependencyTests-164277995 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-94586c97-6d2e-40fa-9151-15d795b22375.5986cfac-3674-4cd3-9a2e-ad6fa46fd86e is being set with open permissions: ugo+rw Sep 28 11:53:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-01740aa8-0d01-4a97-b140-fe0a4be1a0a2 tempest-SnapshotDependencyTests-164277995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-94586c97-6d2e-40fa-9151-15d795b22375.5986cfac-3674-4cd3-9a2e-ad6fa46fd86e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:22 devstack sudo[96572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-94586c97-6d2e-40fa-9151-15d795b22375.5986cfac-3674-4cd3-9a2e-ad6fa46fd86e Sep 28 11:53:22 devstack sudo[96572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:22 devstack sudo[96570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-05b91ca5-7286-418f-96d1-c353cc38c535 Sep 28 11:53:22 devstack sudo[96570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:22 devstack sudo[96572]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-01740aa8-0d01-4a97-b140-fe0a4be1a0a2 tempest-SnapshotDependencyTests-164277995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-94586c97-6d2e-40fa-9151-15d795b22375.5986cfac-3674-4cd3-9a2e-ad6fa46fd86e" returned: 0 in 0.250s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-01740aa8-0d01-4a97-b140-fe0a4be1a0a2 tempest-SnapshotDependencyTests-164277995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-94586c97-6d2e-40fa-9151-15d795b22375.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:22 devstack sudo[96580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-94586c97-6d2e-40fa-9151-15d795b22375.info Sep 28 11:53:22 devstack sudo[96580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:22 devstack sudo[96570]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-047fd8d0-578e-4def-8772-24aedcde1ff8 tempest-VolumesActionsTest-858037443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-05b91ca5-7286-418f-96d1-c353cc38c535" returned: 0 in 0.421s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-047fd8d0-578e-4def-8772-24aedcde1ff8 tempest-VolumesActionsTest-858037443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-05b91ca5-7286-418f-96d1-c353cc38c535 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:22 devstack sudo[96582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-05b91ca5-7286-418f-96d1-c353cc38c535 Sep 28 11:53:22 devstack sudo[96582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:22 devstack sudo[96580]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-01740aa8-0d01-4a97-b140-fe0a4be1a0a2 tempest-SnapshotDependencyTests-164277995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-94586c97-6d2e-40fa-9151-15d795b22375.info" returned: 0 in 0.277s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:22 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-01740aa8-0d01-4a97-b140-fe0a4be1a0a2 tempest-SnapshotDependencyTests-164277995 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-94586c97-6d2e-40fa-9151-15d795b22375.info is being set with open permissions: ugo+rw Sep 28 11:53:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-01740aa8-0d01-4a97-b140-fe0a4be1a0a2 tempest-SnapshotDependencyTests-164277995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-94586c97-6d2e-40fa-9151-15d795b22375.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:22 devstack sudo[96585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-94586c97-6d2e-40fa-9151-15d795b22375.info Sep 28 11:53:22 devstack sudo[96585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:22 devstack sudo[96582]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-047fd8d0-578e-4def-8772-24aedcde1ff8 tempest-VolumesActionsTest-858037443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-05b91ca5-7286-418f-96d1-c353cc38c535" returned: 0 in 0.316s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-047fd8d0-578e-4def-8772-24aedcde1ff8 tempest-VolumesActionsTest-858037443 None] Lock "cinder-quobyte-05b91ca5-7286-418f-96d1-c353cc38c535" released by "delete_volume" :: held 0.801s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:53:22 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-047fd8d0-578e-4def-8772-24aedcde1ff8 tempest-VolumesActionsTest-858037443 None] Created reservations ['aa47a061-644f-43ab-bbd3-2dd11ee9b1e3', '98e75a3d-0764-4f45-ba89-183c1ff0eda4', 'f36d466b-2aef-4cf5-a537-6b91a442e5ec', '698a5955-3570-46ac-ad2c-4889cf1531d5'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:53:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-047fd8d0-578e-4def-8772-24aedcde1ff8 tempest-VolumesActionsTest-858037443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:53:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-047fd8d0-578e-4def-8772-24aedcde1ff8 tempest-VolumesActionsTest-858037443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:53:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-047fd8d0-578e-4def-8772-24aedcde1ff8 tempest-VolumesActionsTest-858037443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:53:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-047fd8d0-578e-4def-8772-24aedcde1ff8 tempest-VolumesActionsTest-858037443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:53:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-047fd8d0-578e-4def-8772-24aedcde1ff8 tempest-VolumesActionsTest-858037443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:53:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-047fd8d0-578e-4def-8772-24aedcde1ff8 tempest-VolumesActionsTest-858037443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:22 devstack sudo[96589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:53:22 devstack sudo[96589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:22 devstack sudo[96585]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-01740aa8-0d01-4a97-b140-fe0a4be1a0a2 tempest-SnapshotDependencyTests-164277995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-94586c97-6d2e-40fa-9151-15d795b22375.info" returned: 0 in 0.297s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-01740aa8-0d01-4a97-b140-fe0a4be1a0a2 tempest-SnapshotDependencyTests-164277995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.342s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:53:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-984504c8-fa2d-4755-a882-56ebfc604e48 tempest-AttachVolumeNegativeTest-962283120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.747s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:53:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-984504c8-fa2d-4755-a882-56ebfc604e48 tempest-AttachVolumeNegativeTest-962283120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:53:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2069079600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=310ebfc3-a6f1-42a9-b513-ec3b4310ec19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81ba3469bda8465fb145a233aec61f60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:53:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:53:16Z,use_quota=True,user_id='482c85c2bda54ca5a179eca038a733ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:53:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-984504c8-fa2d-4755-a882-56ebfc604e48 tempest-AttachVolumeNegativeTest-962283120 None] Creating volume 310ebfc3-a6f1-42a9-b513-ec3b4310ec19 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:53:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-984504c8-fa2d-4755-a882-56ebfc604e48 tempest-AttachVolumeNegativeTest-962283120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:53:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-984504c8-fa2d-4755-a882-56ebfc604e48 tempest-AttachVolumeNegativeTest-962283120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:53:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-984504c8-fa2d-4755-a882-56ebfc604e48 tempest-AttachVolumeNegativeTest-962283120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:53:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-984504c8-fa2d-4755-a882-56ebfc604e48 tempest-AttachVolumeNegativeTest-962283120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:53:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-984504c8-fa2d-4755-a882-56ebfc604e48 tempest-AttachVolumeNegativeTest-962283120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:53:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-984504c8-fa2d-4755-a882-56ebfc604e48 tempest-AttachVolumeNegativeTest-962283120 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:53:23 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-984504c8-fa2d-4755-a882-56ebfc604e48 tempest-AttachVolumeNegativeTest-962283120 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:53:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-984504c8-fa2d-4755-a882-56ebfc604e48 tempest-AttachVolumeNegativeTest-962283120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-310ebfc3-a6f1-42a9-b513-ec3b4310ec19 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:23 devstack sudo[96594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-310ebfc3-a6f1-42a9-b513-ec3b4310ec19 1073741824 Sep 28 11:53:23 devstack sudo[96594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:23 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-01740aa8-0d01-4a97-b140-fe0a4be1a0a2 tempest-SnapshotDependencyTests-164277995 None] Create snapshot completed successfully Sep 28 11:53:23 devstack sudo[96589]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-047fd8d0-578e-4def-8772-24aedcde1ff8 tempest-VolumesActionsTest-858037443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.300s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:23 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-047fd8d0-578e-4def-8772-24aedcde1ff8 tempest-VolumesActionsTest-858037443 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:53:23 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-047fd8d0-578e-4def-8772-24aedcde1ff8 tempest-VolumesActionsTest-858037443 None] Deleted volume successfully. Sep 28 11:53:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-047fd8d0-578e-4def-8772-24aedcde1ff8 tempest-VolumesActionsTest-858037443 None] Lock "cinder-05b91ca5-7286-418f-96d1-c353cc38c535-delete_volume" released by "delete_volume" :: held 1.355s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:53:23 devstack sudo[96594]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-984504c8-fa2d-4755-a882-56ebfc604e48 tempest-AttachVolumeNegativeTest-962283120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-310ebfc3-a6f1-42a9-b513-ec3b4310ec19 1073741824" returned: 0 in 0.535s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-984504c8-fa2d-4755-a882-56ebfc604e48 tempest-AttachVolumeNegativeTest-962283120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-310ebfc3-a6f1-42a9-b513-ec3b4310ec19 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:23 devstack sudo[96606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-310ebfc3-a6f1-42a9-b513-ec3b4310ec19 Sep 28 11:53:23 devstack sudo[96606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:23 devstack sudo[96606]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-984504c8-fa2d-4755-a882-56ebfc604e48 tempest-AttachVolumeNegativeTest-962283120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-310ebfc3-a6f1-42a9-b513-ec3b4310ec19" returned: 0 in 0.280s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-984504c8-fa2d-4755-a882-56ebfc604e48 tempest-AttachVolumeNegativeTest-962283120 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:53:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-984504c8-fa2d-4755-a882-56ebfc604e48 tempest-AttachVolumeNegativeTest-962283120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:53:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-984504c8-fa2d-4755-a882-56ebfc604e48 tempest-AttachVolumeNegativeTest-962283120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41f1047d-da6e-4095-a479-ef9886fedad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-310ebfc3-a6f1-42a9-b513-ec3b4310ec19', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:53:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-984504c8-fa2d-4755-a882-56ebfc604e48 tempest-AttachVolumeNegativeTest-962283120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23df0260-c776-4ba8-b630-af88fea0c1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:53:23 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-984504c8-fa2d-4755-a882-56ebfc604e48 tempest-AttachVolumeNegativeTest-962283120 None] Volume volume-310ebfc3-a6f1-42a9-b513-ec3b4310ec19 (310ebfc3-a6f1-42a9-b513-ec3b4310ec19): created successfully Sep 28 11:53:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-984504c8-fa2d-4755-a882-56ebfc604e48 tempest-AttachVolumeNegativeTest-962283120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23df0260-c776-4ba8-b630-af88fea0c1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:53:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-984504c8-fa2d-4755-a882-56ebfc604e48 tempest-AttachVolumeNegativeTest-962283120 None] Flow 'volume_create_manager' (672b7af1-d763-440b-9c8f-172de4c0329b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:53:23 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-984504c8-fa2d-4755-a882-56ebfc604e48 tempest-AttachVolumeNegativeTest-962283120 None] Created volume successfully. Sep 28 11:53:24 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-bec67618-1e41-4499-b0aa-697660591a3d tempest-SnapshotDependencyTests-164277995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:53:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bec67618-1e41-4499-b0aa-697660591a3d tempest-SnapshotDependencyTests-164277995 None] Flow 'volume_create_manager' (ee5544c5-7c08-4dd4-9286-17bb1277a5c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:53:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bec67618-1e41-4499-b0aa-697660591a3d tempest-SnapshotDependencyTests-164277995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5291003-9259-4259-a070-c69f8098c9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:53:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bec67618-1e41-4499-b0aa-697660591a3d tempest-SnapshotDependencyTests-164277995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5291003-9259-4259-a070-c69f8098c9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:53:24Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e89c681a-64a8-4869-8543-f075c0978229,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb1610fb22e749f1944847a4f41b558a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:53:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5986cfac-3674-4cd3-9a2e-ad6fa46fd86e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:53:24Z,use_quota=True,user_id='b0bd1700c97544249f813620e279ac58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:53:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bec67618-1e41-4499-b0aa-697660591a3d tempest-SnapshotDependencyTests-164277995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6236df08-1ef8-49f9-a52c-d6f194e5b38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:53:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bec67618-1e41-4499-b0aa-697660591a3d tempest-SnapshotDependencyTests-164277995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6236df08-1ef8-49f9-a52c-d6f194e5b38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:53:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bec67618-1e41-4499-b0aa-697660591a3d tempest-SnapshotDependencyTests-164277995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0526330f-3a96-479f-8715-b88efec69b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:53:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bec67618-1e41-4499-b0aa-697660591a3d tempest-SnapshotDependencyTests-164277995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0526330f-3a96-479f-8715-b88efec69b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e89c681a-64a8-4869-8543-f075c0978229', 'volume_name': 'volume-e89c681a-64a8-4869-8543-f075c0978229', 'volume_size': 1, 'snapshot_id': '5986cfac-3674-4cd3-9a2e-ad6fa46fd86e'}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:53:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bec67618-1e41-4499-b0aa-697660591a3d tempest-SnapshotDependencyTests-164277995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4da811f9-b8e3-4c43-979c-d3aa304e4969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:53:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bec67618-1e41-4499-b0aa-697660591a3d tempest-SnapshotDependencyTests-164277995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4da811f9-b8e3-4c43-979c-d3aa304e4969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:53:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bec67618-1e41-4499-b0aa-697660591a3d tempest-SnapshotDependencyTests-164277995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc256186-6387-46ec-9a39-afd13582a03b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:53:24 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-bec67618-1e41-4499-b0aa-697660591a3d tempest-SnapshotDependencyTests-164277995 None] Volume e89c681a-64a8-4869-8543-f075c0978229: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e89c681a-64a8-4869-8543-f075c0978229', 'volume_size': 1, 'snapshot_id': '5986cfac-3674-4cd3-9a2e-ad6fa46fd86e'} Sep 28 11:53:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bec67618-1e41-4499-b0aa-697660591a3d tempest-SnapshotDependencyTests-164277995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:53:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bec67618-1e41-4499-b0aa-697660591a3d tempest-SnapshotDependencyTests-164277995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:53:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bec67618-1e41-4499-b0aa-697660591a3d tempest-SnapshotDependencyTests-164277995 None] Acquiring lock "cinder-quobyte-5986cfac-3674-4cd3-9a2e-ad6fa46fd86e-e89c681a-64a8-4869-8543-f075c0978229" by "_create_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:53:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bec67618-1e41-4499-b0aa-697660591a3d tempest-SnapshotDependencyTests-164277995 None] Lock "cinder-quobyte-5986cfac-3674-4cd3-9a2e-ad6fa46fd86e-e89c681a-64a8-4869-8543-f075c0978229" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:53:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bec67618-1e41-4499-b0aa-697660591a3d tempest-SnapshotDependencyTests-164277995 None] Creating volume e89c681a-64a8-4869-8543-f075c0978229 from snapshot 5986cfac-3674-4cd3-9a2e-ad6fa46fd86e {{(pid=86916) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 11:53:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bec67618-1e41-4499-b0aa-697660591a3d tempest-SnapshotDependencyTests-164277995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:53:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bec67618-1e41-4499-b0aa-697660591a3d tempest-SnapshotDependencyTests-164277995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:53:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bec67618-1e41-4499-b0aa-697660591a3d tempest-SnapshotDependencyTests-164277995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:53:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bec67618-1e41-4499-b0aa-697660591a3d tempest-SnapshotDependencyTests-164277995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:53:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bec67618-1e41-4499-b0aa-697660591a3d tempest-SnapshotDependencyTests-164277995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:53:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bec67618-1e41-4499-b0aa-697660591a3d tempest-SnapshotDependencyTests-164277995 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:53:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bec67618-1e41-4499-b0aa-697660591a3d tempest-SnapshotDependencyTests-164277995 None] Acquiring lock "cinder-quobyte-e89c681a-64a8-4869-8543-f075c0978229" by "_copy_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:53:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bec67618-1e41-4499-b0aa-697660591a3d tempest-SnapshotDependencyTests-164277995 None] Lock "cinder-quobyte-e89c681a-64a8-4869-8543-f075c0978229" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:53:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bec67618-1e41-4499-b0aa-697660591a3d tempest-SnapshotDependencyTests-164277995 None] snapshot: 5986cfac-3674-4cd3-9a2e-ad6fa46fd86e, volume: e89c681a-64a8-4869-8543-f075c0978229, {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 11:53:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bec67618-1e41-4499-b0aa-697660591a3d tempest-SnapshotDependencyTests-164277995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:53:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bec67618-1e41-4499-b0aa-697660591a3d tempest-SnapshotDependencyTests-164277995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:53:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bec67618-1e41-4499-b0aa-697660591a3d tempest-SnapshotDependencyTests-164277995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:53:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bec67618-1e41-4499-b0aa-697660591a3d tempest-SnapshotDependencyTests-164277995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:53:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bec67618-1e41-4499-b0aa-697660591a3d tempest-SnapshotDependencyTests-164277995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:53:24 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2378a3c-7322-4a43-bd23-c7cd6c64bb69]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:53:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bec67618-1e41-4499-b0aa-697660591a3d tempest-SnapshotDependencyTests-164277995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-94586c97-6d2e-40fa-9151-15d795b22375.5986cfac-3674-4cd3-9a2e-ad6fa46fd86e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:24 devstack sudo[96609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-94586c97-6d2e-40fa-9151-15d795b22375.5986cfac-3674-4cd3-9a2e-ad6fa46fd86e Sep 28 11:53:24 devstack sudo[96609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:25 devstack sudo[96609]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bec67618-1e41-4499-b0aa-697660591a3d tempest-SnapshotDependencyTests-164277995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-94586c97-6d2e-40fa-9151-15d795b22375.5986cfac-3674-4cd3-9a2e-ad6fa46fd86e" returned: 0 in 0.522s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-bec67618-1e41-4499-b0aa-697660591a3d tempest-SnapshotDependencyTests-164277995 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94586c97-6d2e-40fa-9151-15d795b22375(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 11:53:25 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[475d881c-2ed3-4318-924b-81e54be920dd]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:53:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bec67618-1e41-4499-b0aa-697660591a3d tempest-SnapshotDependencyTests-164277995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-94586c97-6d2e-40fa-9151-15d795b22375 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:25 devstack sudo[96618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-94586c97-6d2e-40fa-9151-15d795b22375 Sep 28 11:53:25 devstack sudo[96618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:25 devstack sudo[96618]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bec67618-1e41-4499-b0aa-697660591a3d tempest-SnapshotDependencyTests-164277995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-94586c97-6d2e-40fa-9151-15d795b22375" returned: 0 in 0.566s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bec67618-1e41-4499-b0aa-697660591a3d tempest-SnapshotDependencyTests-164277995 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-94586c97-6d2e-40fa-9151-15d795b22375 {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 11:53:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bec67618-1e41-4499-b0aa-697660591a3d tempest-SnapshotDependencyTests-164277995 None] Creating direct copy from snapshot {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 11:53:25 devstack cinder-volume[86916]: DEBUG cinder.utils [None req-bec67618-1e41-4499-b0aa-697660591a3d tempest-SnapshotDependencyTests-164277995 None] Path /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e89c681a-64a8-4869-8543-f075c0978229 not found in is_blk_device check {{(pid=86916) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 11:53:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bec67618-1e41-4499-b0aa-697660591a3d tempest-SnapshotDependencyTests-164277995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-94586c97-6d2e-40fa-9151-15d795b22375 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e89c681a-64a8-4869-8543-f075c0978229 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:25 devstack sudo[96640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-94586c97-6d2e-40fa-9151-15d795b22375 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e89c681a-64a8-4869-8543-f075c0978229 Sep 28 11:53:25 devstack sudo[96640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-9120b609-5f1d-4440-ae92-5c5afc60892c req-dd1aa6be-c2e9-4061-ac3b-ca0e5348faaf tempest-AttachVolumeNegativeTest-962283120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:53:34 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=26,cinder:UPDATE=16,cinder:DELETE=4,cinder:INSERT=3 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 11:53:35 devstack sudo[96640]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bec67618-1e41-4499-b0aa-697660591a3d tempest-SnapshotDependencyTests-164277995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-94586c97-6d2e-40fa-9151-15d795b22375 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e89c681a-64a8-4869-8543-f075c0978229" returned: 0 in 10.038s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:35 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-bec67618-1e41-4499-b0aa-697660591a3d tempest-SnapshotDependencyTests-164277995 None] Image conversion details: src /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-94586c97-6d2e-40fa-9151-15d795b22375, size 1024.00 MB, duration 10.04 sec, destination /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e89c681a-64a8-4869-8543-f075c0978229 {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 11:53:35 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-bec67618-1e41-4499-b0aa-697660591a3d tempest-SnapshotDependencyTests-164277995 None] Converted 1024.00 MB image at 102.01 MB/s Sep 28 11:53:35 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-bec67618-1e41-4499-b0aa-697660591a3d tempest-SnapshotDependencyTests-164277995 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e89c681a-64a8-4869-8543-f075c0978229 is being set with open permissions: ugo+rw Sep 28 11:53:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bec67618-1e41-4499-b0aa-697660591a3d tempest-SnapshotDependencyTests-164277995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e89c681a-64a8-4869-8543-f075c0978229 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:35 devstack sudo[97197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e89c681a-64a8-4869-8543-f075c0978229 Sep 28 11:53:35 devstack sudo[97197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:36 devstack sudo[97197]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bec67618-1e41-4499-b0aa-697660591a3d tempest-SnapshotDependencyTests-164277995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e89c681a-64a8-4869-8543-f075c0978229" returned: 0 in 0.242s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bec67618-1e41-4499-b0aa-697660591a3d tempest-SnapshotDependencyTests-164277995 None] Lock "cinder-quobyte-e89c681a-64a8-4869-8543-f075c0978229" released by "_copy_volume_from_snapshot" :: held 11.524s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:53:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bec67618-1e41-4499-b0aa-697660591a3d tempest-SnapshotDependencyTests-164277995 None] Lock "cinder-quobyte-5986cfac-3674-4cd3-9a2e-ad6fa46fd86e-e89c681a-64a8-4869-8543-f075c0978229" released by "_create_volume_from_snapshot" :: held 11.632s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:53:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bec67618-1e41-4499-b0aa-697660591a3d tempest-SnapshotDependencyTests-164277995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.654s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:53:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-9120b609-5f1d-4440-ae92-5c5afc60892c req-dd1aa6be-c2e9-4061-ac3b-ca0e5348faaf tempest-AttachVolumeNegativeTest-962283120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 10.021s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:53:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-9120b609-5f1d-4440-ae92-5c5afc60892c req-dd1aa6be-c2e9-4061-ac3b-ca0e5348faaf tempest-AttachVolumeNegativeTest-962283120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:53:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bec67618-1e41-4499-b0aa-697660591a3d tempest-SnapshotDependencyTests-164277995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc256186-6387-46ec-9a39-afd13582a03b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e89c681a-64a8-4869-8543-f075c0978229', 'volume_size': 1, 'snapshot_id': '5986cfac-3674-4cd3-9a2e-ad6fa46fd86e'}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:53:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bec67618-1e41-4499-b0aa-697660591a3d tempest-SnapshotDependencyTests-164277995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45bd9783-a2a1-45f2-97ff-0e88c2f3bdf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:53:36 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-bec67618-1e41-4499-b0aa-697660591a3d tempest-SnapshotDependencyTests-164277995 None] Volume volume-e89c681a-64a8-4869-8543-f075c0978229 (e89c681a-64a8-4869-8543-f075c0978229): created successfully Sep 28 11:53:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bec67618-1e41-4499-b0aa-697660591a3d tempest-SnapshotDependencyTests-164277995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45bd9783-a2a1-45f2-97ff-0e88c2f3bdf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:53:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bec67618-1e41-4499-b0aa-697660591a3d tempest-SnapshotDependencyTests-164277995 None] Flow 'volume_create_manager' (ee5544c5-7c08-4dd4-9286-17bb1277a5c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:53:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-9120b609-5f1d-4440-ae92-5c5afc60892c req-dd1aa6be-c2e9-4061-ac3b-ca0e5348faaf tempest-AttachVolumeNegativeTest-962283120 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0', 'name': 'volume-310ebfc3-a6f1-42a9-b513-ec3b4310ec19', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c29d2c96-043a-4ca3-9ae4-c5c2ccd99f6e', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 11:53:36 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-bec67618-1e41-4499-b0aa-697660591a3d tempest-SnapshotDependencyTests-164277995 None] Created volume successfully. Sep 28 11:53:36 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-9120b609-5f1d-4440-ae92-5c5afc60892c req-dd1aa6be-c2e9-4061-ac3b-ca0e5348faaf tempest-AttachVolumeNegativeTest-962283120 None] attachment_update completed successfully. Sep 28 11:53:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-93ddc848-db9b-4fa2-99ca-c006884e7a74 tempest-SnapshotDependencyTests-164277995 None] Acquiring lock "cinder-5986cfac-3674-4cd3-9a2e-ad6fa46fd86e-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:53:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-93ddc848-db9b-4fa2-99ca-c006884e7a74 tempest-SnapshotDependencyTests-164277995 None] Lock "cinder-5986cfac-3674-4cd3-9a2e-ad6fa46fd86e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:53:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-93ddc848-db9b-4fa2-99ca-c006884e7a74 tempest-SnapshotDependencyTests-164277995 None] Acquiring lock "cinder-quobyte-94586c97-6d2e-40fa-9151-15d795b22375" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:53:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-93ddc848-db9b-4fa2-99ca-c006884e7a74 tempest-SnapshotDependencyTests-164277995 None] Lock "cinder-quobyte-94586c97-6d2e-40fa-9151-15d795b22375" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:53:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-93ddc848-db9b-4fa2-99ca-c006884e7a74 tempest-SnapshotDependencyTests-164277995 None] Acquiring lock "cinder-quobyte-5986cfac-3674-4cd3-9a2e-ad6fa46fd86e" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:53:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-93ddc848-db9b-4fa2-99ca-c006884e7a74 tempest-SnapshotDependencyTests-164277995 None] Lock "cinder-quobyte-5986cfac-3674-4cd3-9a2e-ad6fa46fd86e" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:53:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-93ddc848-db9b-4fa2-99ca-c006884e7a74 tempest-SnapshotDependencyTests-164277995 None] Deleting offline snapshot 5986cfac-3674-4cd3-9a2e-ad6fa46fd86e of volume 94586c97-6d2e-40fa-9151-15d795b22375 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 11:53:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-93ddc848-db9b-4fa2-99ca-c006884e7a74 tempest-SnapshotDependencyTests-164277995 None] snapshot_file for this snap is: volume-94586c97-6d2e-40fa-9151-15d795b22375.5986cfac-3674-4cd3-9a2e-ad6fa46fd86e {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 11:53:37 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db887bc-56f3-4b4d-aa28-4797b532a2f8]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:53:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-93ddc848-db9b-4fa2-99ca-c006884e7a74 tempest-SnapshotDependencyTests-164277995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-94586c97-6d2e-40fa-9151-15d795b22375.5986cfac-3674-4cd3-9a2e-ad6fa46fd86e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:37 devstack sudo[97205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-94586c97-6d2e-40fa-9151-15d795b22375.5986cfac-3674-4cd3-9a2e-ad6fa46fd86e Sep 28 11:53:37 devstack sudo[97205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:37 devstack sudo[97205]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-93ddc848-db9b-4fa2-99ca-c006884e7a74 tempest-SnapshotDependencyTests-164277995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-94586c97-6d2e-40fa-9151-15d795b22375.5986cfac-3674-4cd3-9a2e-ad6fa46fd86e" returned: 0 in 0.487s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-93ddc848-db9b-4fa2-99ca-c006884e7a74 tempest-SnapshotDependencyTests-164277995 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94586c97-6d2e-40fa-9151-15d795b22375(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 11:53:37 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37e6aca-cf36-4c90-9618-7b9a380f77fa]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:53:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-93ddc848-db9b-4fa2-99ca-c006884e7a74 tempest-SnapshotDependencyTests-164277995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-94586c97-6d2e-40fa-9151-15d795b22375 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:37 devstack sudo[97210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-94586c97-6d2e-40fa-9151-15d795b22375 Sep 28 11:53:37 devstack sudo[97210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:38 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:53:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] Flow 'volume_create_manager' (9cb9834b-7ee9-411c-b257-16bbd0994f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:53:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dee65713-bf2f-4d69-a489-dbc0b17abddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:53:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dee65713-bf2f-4d69-a489-dbc0b17abddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:53:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-599871003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0adfaea-32c0-44ac-9b07-a27165e552bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15e5e8fb093a412d8dbb499964df94a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:53:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:53:38Z,use_quota=True,user_id='3af807a6821642e7a2f827ed21e5818b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:53:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e39d8e2a-0be1-4424-a4dc-10682c3184c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:53:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e39d8e2a-0be1-4424-a4dc-10682c3184c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:53:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6a62614-760a-4317-9ffd-b51a7a5bc265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:53:38 devstack cinder-volume[86916]: DEBUG cinder.image.glance [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] Creating Keystone auth plugin from conf {{(pid=86916) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 11:53:38 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-edea3aad-291b-48c1-bfd3-48e3da3f9198 req-09fa76a0-aee4-4fe5-ad91-2837967b0593 tempest-AttachVolumeNegativeTest-962283120 None] Terminate volume connection completed successfully. Sep 28 11:53:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-edea3aad-291b-48c1-bfd3-48e3da3f9198 req-09fa76a0-aee4-4fe5-ad91-2837967b0593 tempest-AttachVolumeNegativeTest-962283120 None] Deleting attachment c29d2c96-043a-4ca3-9ae4-c5c2ccd99f6e. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 11:53:38 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 11:53:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:53:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:53:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:53:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:53:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:53:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:38 devstack sudo[97210]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-93ddc848-db9b-4fa2-99ca-c006884e7a74 tempest-SnapshotDependencyTests-164277995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-94586c97-6d2e-40fa-9151-15d795b22375" returned: 0 in 0.875s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-93ddc848-db9b-4fa2-99ca-c006884e7a74 tempest-SnapshotDependencyTests-164277995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-94586c97-6d2e-40fa-9151-15d795b22375.5986cfac-3674-4cd3-9a2e-ad6fa46fd86e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:38 devstack sudo[97220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:53:38 devstack sudo[97220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:38 devstack sudo[97222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-94586c97-6d2e-40fa-9151-15d795b22375.5986cfac-3674-4cd3-9a2e-ad6fa46fd86e Sep 28 11:53:38 devstack sudo[97222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6a62614-760a-4317-9ffd-b51a7a5bc265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f0adfaea-32c0-44ac-9b07-a27165e552bb', 'volume_name': 'volume-f0adfaea-32c0-44ac-9b07-a27165e552bb', 'volume_size': 1, 'image_id': '5400a738-7bf7-408f-b314-8b5954ac2b81', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5400a738-7bf7-408f-b314-8b5954ac2b81', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0c8ef073bf9e4608b40db55c7aa6c23c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5400a738-7bf7-408f-b314-8b5954ac2b81', 'created_at': datetime.datetime(2026, 9, 28, 9, 39, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 9, 39, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5400a738-7bf7-408f-b314-8b5954ac2b81/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:53:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6bf2571-5398-4224-97ab-db1963421c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:53:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6bf2571-5398-4224-97ab-db1963421c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:53:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67bdd71b-e8b0-4101-a3a1-a32bba381d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:53:38 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] Volume f0adfaea-32c0-44ac-9b07-a27165e552bb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f0adfaea-32c0-44ac-9b07-a27165e552bb', 'volume_size': 1, 'image_id': '5400a738-7bf7-408f-b314-8b5954ac2b81', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5400a738-7bf7-408f-b314-8b5954ac2b81', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0c8ef073bf9e4608b40db55c7aa6c23c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5400a738-7bf7-408f-b314-8b5954ac2b81', 'created_at': datetime.datetime(2026, 9, 28, 9, 39, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 9, 39, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5400a738-7bf7-408f-b314-8b5954ac2b81/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 11:53:38 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] Trying to clone f0adfaea-32c0-44ac-9b07-a27165e552bb from image 5400a738-7bf7-408f-b314-8b5954ac2b81 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5400a738-7bf7-408f-b314-8b5954ac2b81', 'metadata': {}}]). {{(pid=86916) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 11:53:39 devstack sudo[97220]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.439s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:39 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:53:39 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 11:53:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] thread count: 28 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 11:53:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] thread info: [<_MainThread(MainThread, started 135408582168704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 11:53:39 devstack sudo[97222]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-93ddc848-db9b-4fa2-99ca-c006884e7a74 tempest-SnapshotDependencyTests-164277995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-94586c97-6d2e-40fa-9151-15d795b22375.5986cfac-3674-4cd3-9a2e-ad6fa46fd86e" returned: 0 in 0.629s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-93ddc848-db9b-4fa2-99ca-c006884e7a74 tempest-SnapshotDependencyTests-164277995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-94586c97-6d2e-40fa-9151-15d795b22375.5986cfac-3674-4cd3-9a2e-ad6fa46fd86e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:39 devstack sudo[97228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-94586c97-6d2e-40fa-9151-15d795b22375.5986cfac-3674-4cd3-9a2e-ad6fa46fd86e Sep 28 11:53:39 devstack sudo[97228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:39 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_3iio93lmdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 11:53:39 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] Image download 20.69 MB at 20.69 MB/s Sep 28 11:53:39 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ff9d78-777c-4590-b0bf-9b2482458194]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:53:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_3iio93lmdevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:39 devstack sudo[97231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_3iio93lmdevstack@QuobyteHD Sep 28 11:53:39 devstack sudo[97231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:39 devstack sudo[97228]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-93ddc848-db9b-4fa2-99ca-c006884e7a74 tempest-SnapshotDependencyTests-164277995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-94586c97-6d2e-40fa-9151-15d795b22375.5986cfac-3674-4cd3-9a2e-ad6fa46fd86e" returned: 0 in 0.444s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-93ddc848-db9b-4fa2-99ca-c006884e7a74 tempest-SnapshotDependencyTests-164277995 None] Lock "cinder-quobyte-5986cfac-3674-4cd3-9a2e-ad6fa46fd86e" released by "_delete_snapshot" :: held 2.597s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:53:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-93ddc848-db9b-4fa2-99ca-c006884e7a74 tempest-SnapshotDependencyTests-164277995 None] Lock "cinder-quobyte-94586c97-6d2e-40fa-9151-15d795b22375" released by "delete_snapshot" :: held 2.645s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:53:39 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-93ddc848-db9b-4fa2-99ca-c006884e7a74 tempest-SnapshotDependencyTests-164277995 None] Created reservations ['644a3059-6614-4fe5-83a8-e084911e4914', 'cb4c18d3-a307-4bae-9321-97a11c5326da', 'c3487307-7f78-41d9-b5cd-c3e525335e12', '0b198ee6-78b9-467c-93c0-c7867b78e626'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:53:40 devstack sudo[97231]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_3iio93lmdevstack@QuobyteHD" returned: 0 in 0.521s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:40 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] Temporary image 5400a738-7bf7-408f-b314-8b5954ac2b81 is fetched for user 3af807a6821642e7a2f827ed21e5818b. {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 11:53:40 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-93ddc848-db9b-4fa2-99ca-c006884e7a74 tempest-SnapshotDependencyTests-164277995 None] Delete snapshot completed successfully. Sep 28 11:53:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-93ddc848-db9b-4fa2-99ca-c006884e7a74 tempest-SnapshotDependencyTests-164277995 None] Lock "cinder-5986cfac-3674-4cd3-9a2e-ad6fa46fd86e-delete_snapshot" released by "delete_snapshot" :: held 2.951s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:53:40 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71ebb25-3d66-47de-9d41-6ba7e6a9fc45]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:53:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_3iio93lmdevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:40 devstack sudo[97257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_3iio93lmdevstack@QuobyteHD Sep 28 11:53:40 devstack sudo[97257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c55166a1-2bd4-4780-bdc1-fd2819783042 tempest-SnapshotDependencyTests-164277995 None] Acquiring lock "cinder-94586c97-6d2e-40fa-9151-15d795b22375-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:53:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c55166a1-2bd4-4780-bdc1-fd2819783042 tempest-SnapshotDependencyTests-164277995 None] Lock "cinder-94586c97-6d2e-40fa-9151-15d795b22375-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:53:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c55166a1-2bd4-4780-bdc1-fd2819783042 tempest-SnapshotDependencyTests-164277995 None] Acquiring lock "cinder-quobyte-94586c97-6d2e-40fa-9151-15d795b22375" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:53:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c55166a1-2bd4-4780-bdc1-fd2819783042 tempest-SnapshotDependencyTests-164277995 None] Lock "cinder-quobyte-94586c97-6d2e-40fa-9151-15d795b22375" acquired by "delete_volume" :: waited 0.042s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:53:40 devstack sudo[97257]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_3iio93lmdevstack@QuobyteHD" returned: 0 in 0.509s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:53:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:53:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:53:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-599871003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0adfaea-32c0-44ac-9b07-a27165e552bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15e5e8fb093a412d8dbb499964df94a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:53:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:53:38Z,use_quota=True,user_id='3af807a6821642e7a2f827ed21e5818b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:53:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] Creating volume f0adfaea-32c0-44ac-9b07-a27165e552bb {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:53:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:53:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:53:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:53:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:53:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:53:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:53:40 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:53:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f0adfaea-32c0-44ac-9b07-a27165e552bb 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:40 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[808e4de7-1853-453b-82ac-45714545fc02]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:53:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c55166a1-2bd4-4780-bdc1-fd2819783042 tempest-SnapshotDependencyTests-164277995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-94586c97-6d2e-40fa-9151-15d795b22375 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:40 devstack sudo[97269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f0adfaea-32c0-44ac-9b07-a27165e552bb 1073741824 Sep 28 11:53:40 devstack sudo[97269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:40 devstack sudo[97270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-94586c97-6d2e-40fa-9151-15d795b22375 Sep 28 11:53:40 devstack sudo[97270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:41 devstack sudo[97269]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f0adfaea-32c0-44ac-9b07-a27165e552bb 1073741824" returned: 0 in 0.763s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:41 devstack sudo[97270]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c55166a1-2bd4-4780-bdc1-fd2819783042 tempest-SnapshotDependencyTests-164277995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-94586c97-6d2e-40fa-9151-15d795b22375" returned: 0 in 0.759s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c55166a1-2bd4-4780-bdc1-fd2819783042 tempest-SnapshotDependencyTests-164277995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-94586c97-6d2e-40fa-9151-15d795b22375 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:41 devstack sudo[97281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-94586c97-6d2e-40fa-9151-15d795b22375 Sep 28 11:53:41 devstack sudo[97281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f0adfaea-32c0-44ac-9b07-a27165e552bb {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:41 devstack sudo[97284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f0adfaea-32c0-44ac-9b07-a27165e552bb Sep 28 11:53:41 devstack sudo[97284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:42 devstack sudo[97281]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c55166a1-2bd4-4780-bdc1-fd2819783042 tempest-SnapshotDependencyTests-164277995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-94586c97-6d2e-40fa-9151-15d795b22375" returned: 0 in 0.479s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:42 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c55166a1-2bd4-4780-bdc1-fd2819783042 tempest-SnapshotDependencyTests-164277995 None] Lock "cinder-quobyte-94586c97-6d2e-40fa-9151-15d795b22375" released by "delete_volume" :: held 1.383s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:53:42 devstack sudo[97284]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f0adfaea-32c0-44ac-9b07-a27165e552bb" returned: 0 in 0.461s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] <== create_volume: return (1323ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:53:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.329s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:53:42 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] Attempting download of 5400a738-7bf7-408f-b314-8b5954ac2b81 ((None, [{'url': 'file:///opt/stack/data/glance/images/5400a738-7bf7-408f-b314-8b5954ac2b81', 'metadata': {}}])) to volume f0adfaea-32c0-44ac-9b07-a27165e552bb. {{(pid=86916) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 11:53:42 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-c55166a1-2bd4-4780-bdc1-fd2819783042 tempest-SnapshotDependencyTests-164277995 None] Created reservations ['9fffb6ec-ba1c-4bc0-900c-eda2f480bea6', 'b74462a4-dd5c-4184-af5b-ec6d32778785', 'af770a0c-1e7c-4b34-9450-eb7c12b00002', 'a4f54d00-5c27-4bc5-9d05-519b054d5a63'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:53:42 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[76750c6a-10d1-4077-84cf-a6e277dfaa92]: (4, 'raw') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:53:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5400a738-7bf7-408f-b314-8b5954ac2b81_bfh0v4gm {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c55166a1-2bd4-4780-bdc1-fd2819783042 tempest-SnapshotDependencyTests-164277995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:53:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c55166a1-2bd4-4780-bdc1-fd2819783042 tempest-SnapshotDependencyTests-164277995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:53:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c55166a1-2bd4-4780-bdc1-fd2819783042 tempest-SnapshotDependencyTests-164277995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:53:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c55166a1-2bd4-4780-bdc1-fd2819783042 tempest-SnapshotDependencyTests-164277995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:53:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c55166a1-2bd4-4780-bdc1-fd2819783042 tempest-SnapshotDependencyTests-164277995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:53:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c55166a1-2bd4-4780-bdc1-fd2819783042 tempest-SnapshotDependencyTests-164277995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:42 devstack sudo[97290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:53:42 devstack sudo[97290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:42 devstack sudo[97289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5400a738-7bf7-408f-b314-8b5954ac2b81_bfh0v4gm Sep 28 11:53:42 devstack sudo[97289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:42 devstack sudo[97290]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c55166a1-2bd4-4780-bdc1-fd2819783042 tempest-SnapshotDependencyTests-164277995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.283s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:42 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-c55166a1-2bd4-4780-bdc1-fd2819783042 tempest-SnapshotDependencyTests-164277995 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:53:42 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-c55166a1-2bd4-4780-bdc1-fd2819783042 tempest-SnapshotDependencyTests-164277995 None] Deleted volume successfully. Sep 28 11:53:42 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c55166a1-2bd4-4780-bdc1-fd2819783042 tempest-SnapshotDependencyTests-164277995 None] Lock "cinder-94586c97-6d2e-40fa-9151-15d795b22375-delete_volume" released by "delete_volume" :: held 2.091s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:53:42 devstack sudo[97289]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5400a738-7bf7-408f-b314-8b5954ac2b81_bfh0v4gm" returned: 0 in 0.472s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5400a738-7bf7-408f-b314-8b5954ac2b81_bfh0v4gm {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:42 devstack sudo[97296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5400a738-7bf7-408f-b314-8b5954ac2b81_bfh0v4gm Sep 28 11:53:42 devstack sudo[97296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:42 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2b279c39-9e21-42d3-951f-22dd6880b7f6 tempest-SnapshotDependencyTests-164277995 None] Acquiring lock "cinder-e89c681a-64a8-4869-8543-f075c0978229-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:53:43 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2b279c39-9e21-42d3-951f-22dd6880b7f6 tempest-SnapshotDependencyTests-164277995 None] Lock "cinder-e89c681a-64a8-4869-8543-f075c0978229-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:53:43 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2b279c39-9e21-42d3-951f-22dd6880b7f6 tempest-SnapshotDependencyTests-164277995 None] Acquiring lock "cinder-quobyte-e89c681a-64a8-4869-8543-f075c0978229" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:53:43 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2b279c39-9e21-42d3-951f-22dd6880b7f6 tempest-SnapshotDependencyTests-164277995 None] Lock "cinder-quobyte-e89c681a-64a8-4869-8543-f075c0978229" acquired by "delete_volume" :: waited 0.029s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:53:43 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[3591740b-76a8-4895-9426-72719250233e]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:53:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2b279c39-9e21-42d3-951f-22dd6880b7f6 tempest-SnapshotDependencyTests-164277995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e89c681a-64a8-4869-8543-f075c0978229 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:43 devstack sudo[97298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e89c681a-64a8-4869-8543-f075c0978229 Sep 28 11:53:43 devstack sudo[97298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:43 devstack sudo[97296]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5400a738-7bf7-408f-b314-8b5954ac2b81_bfh0v4gm" returned: 1 in 0.612s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5400a738-7bf7-408f-b314-8b5954ac2b81_bfh0v4gm' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 11:53:43 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b5ae71-ecbb-442c-99be-b8f8161f2d17]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:53:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_3iio93lmdevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:43 devstack sudo[97302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_3iio93lmdevstack@QuobyteHD Sep 28 11:53:43 devstack sudo[97302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:43 devstack sudo[97298]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2b279c39-9e21-42d3-951f-22dd6880b7f6 tempest-SnapshotDependencyTests-164277995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e89c681a-64a8-4869-8543-f075c0978229" returned: 0 in 0.447s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2b279c39-9e21-42d3-951f-22dd6880b7f6 tempest-SnapshotDependencyTests-164277995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e89c681a-64a8-4869-8543-f075c0978229 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:43 devstack sudo[97308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e89c681a-64a8-4869-8543-f075c0978229 Sep 28 11:53:43 devstack sudo[97308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:43 devstack sudo[97302]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_3iio93lmdevstack@QuobyteHD" returned: 0 in 0.361s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:43 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] 5400a738-7bf7-408f-b314-8b5954ac2b81 was qcow2, converting to qcow2 {{(pid=86916) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 11:53:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_3iio93lmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f0adfaea-32c0-44ac-9b07-a27165e552bb {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:43 devstack sudo[97312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_3iio93lmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f0adfaea-32c0-44ac-9b07-a27165e552bb Sep 28 11:53:43 devstack sudo[97312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:43 devstack sudo[97308]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2b279c39-9e21-42d3-951f-22dd6880b7f6 tempest-SnapshotDependencyTests-164277995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e89c681a-64a8-4869-8543-f075c0978229" returned: 0 in 0.366s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2b279c39-9e21-42d3-951f-22dd6880b7f6 tempest-SnapshotDependencyTests-164277995 None] Lock "cinder-quobyte-e89c681a-64a8-4869-8543-f075c0978229" released by "delete_volume" :: held 0.876s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:53:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0bfbb1ee-4703-4e89-8f86-df6b464913a4 tempest-AttachVolumeNegativeTest-962283120 None] Acquiring lock "cinder-310ebfc3-a6f1-42a9-b513-ec3b4310ec19-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:53:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0bfbb1ee-4703-4e89-8f86-df6b464913a4 tempest-AttachVolumeNegativeTest-962283120 None] Lock "cinder-310ebfc3-a6f1-42a9-b513-ec3b4310ec19-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:53:44 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-2b279c39-9e21-42d3-951f-22dd6880b7f6 tempest-SnapshotDependencyTests-164277995 None] Created reservations ['738553c3-08bb-4744-9c9b-a5c1f4b4347e', 'a2a5e1b6-8278-4ff0-aa10-927414d84202', 'cc8e5009-1fb1-4bc6-b054-32c7075fdb52', 'e4d9ff43-e204-44e9-ac71-52db4f1d22bf'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:53:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0bfbb1ee-4703-4e89-8f86-df6b464913a4 tempest-AttachVolumeNegativeTest-962283120 None] Acquiring lock "cinder-quobyte-310ebfc3-a6f1-42a9-b513-ec3b4310ec19" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:53:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0bfbb1ee-4703-4e89-8f86-df6b464913a4 tempest-AttachVolumeNegativeTest-962283120 None] Lock "cinder-quobyte-310ebfc3-a6f1-42a9-b513-ec3b4310ec19" acquired by "delete_volume" :: waited 0.043s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:53:44 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf64527-6bec-4065-8f8e-3137c630a98e]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:53:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0bfbb1ee-4703-4e89-8f86-df6b464913a4 tempest-AttachVolumeNegativeTest-962283120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-310ebfc3-a6f1-42a9-b513-ec3b4310ec19 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2b279c39-9e21-42d3-951f-22dd6880b7f6 tempest-SnapshotDependencyTests-164277995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:53:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2b279c39-9e21-42d3-951f-22dd6880b7f6 tempest-SnapshotDependencyTests-164277995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:53:44 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2b279c39-9e21-42d3-951f-22dd6880b7f6 tempest-SnapshotDependencyTests-164277995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:53:44 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2b279c39-9e21-42d3-951f-22dd6880b7f6 tempest-SnapshotDependencyTests-164277995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:53:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2b279c39-9e21-42d3-951f-22dd6880b7f6 tempest-SnapshotDependencyTests-164277995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:53:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2b279c39-9e21-42d3-951f-22dd6880b7f6 tempest-SnapshotDependencyTests-164277995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:44 devstack sudo[97320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:53:44 devstack sudo[97320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:44 devstack sudo[97319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-310ebfc3-a6f1-42a9-b513-ec3b4310ec19 Sep 28 11:53:44 devstack sudo[97319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:44 devstack sudo[97320]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2b279c39-9e21-42d3-951f-22dd6880b7f6 tempest-SnapshotDependencyTests-164277995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.319s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:44 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-2b279c39-9e21-42d3-951f-22dd6880b7f6 tempest-SnapshotDependencyTests-164277995 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:53:44 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-2b279c39-9e21-42d3-951f-22dd6880b7f6 tempest-SnapshotDependencyTests-164277995 None] Deleted volume successfully. Sep 28 11:53:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2b279c39-9e21-42d3-951f-22dd6880b7f6 tempest-SnapshotDependencyTests-164277995 None] Lock "cinder-e89c681a-64a8-4869-8543-f075c0978229-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:53:44 devstack sudo[97319]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0bfbb1ee-4703-4e89-8f86-df6b464913a4 tempest-AttachVolumeNegativeTest-962283120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-310ebfc3-a6f1-42a9-b513-ec3b4310ec19" returned: 0 in 0.509s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0bfbb1ee-4703-4e89-8f86-df6b464913a4 tempest-AttachVolumeNegativeTest-962283120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-310ebfc3-a6f1-42a9-b513-ec3b4310ec19 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:44 devstack sudo[97343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-310ebfc3-a6f1-42a9-b513-ec3b4310ec19 Sep 28 11:53:44 devstack sudo[97343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:45 devstack sudo[97343]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0bfbb1ee-4703-4e89-8f86-df6b464913a4 tempest-AttachVolumeNegativeTest-962283120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-310ebfc3-a6f1-42a9-b513-ec3b4310ec19" returned: 0 in 0.325s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:45 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0bfbb1ee-4703-4e89-8f86-df6b464913a4 tempest-AttachVolumeNegativeTest-962283120 None] Lock "cinder-quobyte-310ebfc3-a6f1-42a9-b513-ec3b4310ec19" released by "delete_volume" :: held 0.882s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:53:45 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-0bfbb1ee-4703-4e89-8f86-df6b464913a4 tempest-AttachVolumeNegativeTest-962283120 None] Created reservations ['1ccf0df8-aaab-43ef-be22-0dcfcb313f1c', 'ae366bd8-deb6-4a93-8552-0dc8b951b3a3', '239d3d23-cdc9-45f4-b64b-b66f39bdd3da', 'c1499c38-5977-4b03-aa01-e76c1fb5509b'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:53:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0bfbb1ee-4703-4e89-8f86-df6b464913a4 tempest-AttachVolumeNegativeTest-962283120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:53:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0bfbb1ee-4703-4e89-8f86-df6b464913a4 tempest-AttachVolumeNegativeTest-962283120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:53:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0bfbb1ee-4703-4e89-8f86-df6b464913a4 tempest-AttachVolumeNegativeTest-962283120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:53:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0bfbb1ee-4703-4e89-8f86-df6b464913a4 tempest-AttachVolumeNegativeTest-962283120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:53:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0bfbb1ee-4703-4e89-8f86-df6b464913a4 tempest-AttachVolumeNegativeTest-962283120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:53:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0bfbb1ee-4703-4e89-8f86-df6b464913a4 tempest-AttachVolumeNegativeTest-962283120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:45 devstack sudo[97346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:53:45 devstack sudo[97346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:45 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9a387651-1ac2-44e0-8036-0aeae677068a tempest-AttachVolumeNegativeTest-962283120 None] Acquiring lock "cinder-4b49bcb3-720e-4f02-9f54-4db301a94e5f-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:53:45 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9a387651-1ac2-44e0-8036-0aeae677068a tempest-AttachVolumeNegativeTest-962283120 None] Lock "cinder-4b49bcb3-720e-4f02-9f54-4db301a94e5f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:53:45 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9a387651-1ac2-44e0-8036-0aeae677068a tempest-AttachVolumeNegativeTest-962283120 None] Acquiring lock "cinder-quobyte-4b49bcb3-720e-4f02-9f54-4db301a94e5f" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:53:45 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9a387651-1ac2-44e0-8036-0aeae677068a tempest-AttachVolumeNegativeTest-962283120 None] Lock "cinder-quobyte-4b49bcb3-720e-4f02-9f54-4db301a94e5f" acquired by "delete_volume" :: waited 0.036s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:53:45 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a56947-facd-439b-bcc1-22e2faf66687]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:53:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9a387651-1ac2-44e0-8036-0aeae677068a tempest-AttachVolumeNegativeTest-962283120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4b49bcb3-720e-4f02-9f54-4db301a94e5f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:45 devstack sudo[97346]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0bfbb1ee-4703-4e89-8f86-df6b464913a4 tempest-AttachVolumeNegativeTest-962283120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.407s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:45 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-0bfbb1ee-4703-4e89-8f86-df6b464913a4 tempest-AttachVolumeNegativeTest-962283120 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:53:45 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-0bfbb1ee-4703-4e89-8f86-df6b464913a4 tempest-AttachVolumeNegativeTest-962283120 None] Deleted volume successfully. Sep 28 11:53:45 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0bfbb1ee-4703-4e89-8f86-df6b464913a4 tempest-AttachVolumeNegativeTest-962283120 None] Lock "cinder-310ebfc3-a6f1-42a9-b513-ec3b4310ec19-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:53:45 devstack sudo[97349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4b49bcb3-720e-4f02-9f54-4db301a94e5f Sep 28 11:53:45 devstack sudo[97349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:46 devstack sudo[97349]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9a387651-1ac2-44e0-8036-0aeae677068a tempest-AttachVolumeNegativeTest-962283120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4b49bcb3-720e-4f02-9f54-4db301a94e5f" returned: 0 in 0.439s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9a387651-1ac2-44e0-8036-0aeae677068a tempest-AttachVolumeNegativeTest-962283120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4b49bcb3-720e-4f02-9f54-4db301a94e5f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:46 devstack sudo[97354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4b49bcb3-720e-4f02-9f54-4db301a94e5f Sep 28 11:53:46 devstack sudo[97354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:46 devstack sudo[97312]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_3iio93lmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f0adfaea-32c0-44ac-9b07-a27165e552bb" returned: 0 in 2.494s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:46 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_3iio93lmdevstack@QuobyteHD, size 112.00 MB, duration 2.50 sec, destination /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f0adfaea-32c0-44ac-9b07-a27165e552bb {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 11:53:46 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] Converted 112.00 MB image at 44.89 MB/s Sep 28 11:53:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f0adfaea-32c0-44ac-9b07-a27165e552bb 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:46 devstack sudo[97356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f0adfaea-32c0-44ac-9b07-a27165e552bb 1G Sep 28 11:53:46 devstack sudo[97356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:46 devstack sudo[97354]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9a387651-1ac2-44e0-8036-0aeae677068a tempest-AttachVolumeNegativeTest-962283120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4b49bcb3-720e-4f02-9f54-4db301a94e5f" returned: 0 in 0.277s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9a387651-1ac2-44e0-8036-0aeae677068a tempest-AttachVolumeNegativeTest-962283120 None] Lock "cinder-quobyte-4b49bcb3-720e-4f02-9f54-4db301a94e5f" released by "delete_volume" :: held 0.802s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:53:46 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-9a387651-1ac2-44e0-8036-0aeae677068a tempest-AttachVolumeNegativeTest-962283120 None] Created reservations ['4c790484-49e3-4c38-9428-ac8e77a5b415', 'da425dd1-ee6d-4044-8445-c030c2c39066', '927d73b7-6604-46aa-8ca5-9bd8ebdb3c28', '7e894a29-f97a-4491-9601-82db1edb7113'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:53:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9a387651-1ac2-44e0-8036-0aeae677068a tempest-AttachVolumeNegativeTest-962283120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:53:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9a387651-1ac2-44e0-8036-0aeae677068a tempest-AttachVolumeNegativeTest-962283120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:53:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9a387651-1ac2-44e0-8036-0aeae677068a tempest-AttachVolumeNegativeTest-962283120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:53:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9a387651-1ac2-44e0-8036-0aeae677068a tempest-AttachVolumeNegativeTest-962283120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:53:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9a387651-1ac2-44e0-8036-0aeae677068a tempest-AttachVolumeNegativeTest-962283120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:53:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9a387651-1ac2-44e0-8036-0aeae677068a tempest-AttachVolumeNegativeTest-962283120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:46 devstack sudo[97386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:53:46 devstack sudo[97386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:46 devstack sudo[97356]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f0adfaea-32c0-44ac-9b07-a27165e552bb 1G" returned: 0 in 0.395s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:46 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] Downloaded image 5400a738-7bf7-408f-b314-8b5954ac2b81 ((None, [{'url': 'file:///opt/stack/data/glance/images/5400a738-7bf7-408f-b314-8b5954ac2b81', 'metadata': {}}])) to volume f0adfaea-32c0-44ac-9b07-a27165e552bb successfully. {{(pid=86916) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 11:53:46 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] Temporary image 5400a738-7bf7-408f-b314-8b5954ac2b81 for user 3af807a6821642e7a2f827ed21e5818b is deleted. {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 11:53:46 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] Marking volume f0adfaea-32c0-44ac-9b07-a27165e552bb as bootable. {{(pid=86916) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 11:53:46 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] Copying metadata from image 5400a738-7bf7-408f-b314-8b5954ac2b81 to f0adfaea-32c0-44ac-9b07-a27165e552bb. {{(pid=86916) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 11:53:46 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] Creating volume glance metadata for volume f0adfaea-32c0-44ac-9b07-a27165e552bb backed by image 5400a738-7bf7-408f-b314-8b5954ac2b81 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5400a738-7bf7-408f-b314-8b5954ac2b81', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86916) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 11:53:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67bdd71b-e8b0-4101-a3a1-a32bba381d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0adfaea-32c0-44ac-9b07-a27165e552bb', 'volume_size': 1, 'image_id': '5400a738-7bf7-408f-b314-8b5954ac2b81', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5400a738-7bf7-408f-b314-8b5954ac2b81', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0c8ef073bf9e4608b40db55c7aa6c23c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5400a738-7bf7-408f-b314-8b5954ac2b81', 'created_at': datetime.datetime(2026, 9, 28, 9, 39, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 9, 39, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5400a738-7bf7-408f-b314-8b5954ac2b81/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:53:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b914b91a-e96f-45d9-b849-a9c39011bcc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:53:46 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] Volume volume-f0adfaea-32c0-44ac-9b07-a27165e552bb (f0adfaea-32c0-44ac-9b07-a27165e552bb): created successfully Sep 28 11:53:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b914b91a-e96f-45d9-b849-a9c39011bcc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:53:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] Flow 'volume_create_manager' (9cb9834b-7ee9-411c-b257-16bbd0994f93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:53:46 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-a95b790e-0765-4e65-855b-9cde2277902e tempest-VolumesExtendTest-1779327788 None] Created volume successfully. Sep 28 11:53:46 devstack sudo[97386]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9a387651-1ac2-44e0-8036-0aeae677068a tempest-AttachVolumeNegativeTest-962283120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.352s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:46 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-9a387651-1ac2-44e0-8036-0aeae677068a tempest-AttachVolumeNegativeTest-962283120 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:53:46 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-9a387651-1ac2-44e0-8036-0aeae677068a tempest-AttachVolumeNegativeTest-962283120 None] Deleted volume successfully. Sep 28 11:53:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9a387651-1ac2-44e0-8036-0aeae677068a tempest-AttachVolumeNegativeTest-962283120 None] Lock "cinder-4b49bcb3-720e-4f02-9f54-4db301a94e5f-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:53:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b000a705-c9f2-42d7-a8d5-f4efdf6bc797 tempest-AttachVolumeNegativeTest-962283120 None] Acquiring lock "cinder-16b67192-a83e-4cd9-a29f-8106ce313696-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:53:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b000a705-c9f2-42d7-a8d5-f4efdf6bc797 tempest-AttachVolumeNegativeTest-962283120 None] Lock "cinder-16b67192-a83e-4cd9-a29f-8106ce313696-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:53:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b000a705-c9f2-42d7-a8d5-f4efdf6bc797 tempest-AttachVolumeNegativeTest-962283120 None] Acquiring lock "cinder-quobyte-16b67192-a83e-4cd9-a29f-8106ce313696" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:53:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b000a705-c9f2-42d7-a8d5-f4efdf6bc797 tempest-AttachVolumeNegativeTest-962283120 None] Lock "cinder-quobyte-16b67192-a83e-4cd9-a29f-8106ce313696" acquired by "delete_volume" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:53:47 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2b1eae-e792-4d5f-a622-184aee810efd]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:53:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b000a705-c9f2-42d7-a8d5-f4efdf6bc797 tempest-AttachVolumeNegativeTest-962283120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-16b67192-a83e-4cd9-a29f-8106ce313696 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:47 devstack sudo[97389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-16b67192-a83e-4cd9-a29f-8106ce313696 Sep 28 11:53:47 devstack sudo[97389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-18d22d73-79bd-4bb6-aedc-3f0adef202b8 tempest-VolumesExtendTest-1779327788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:53:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-18d22d73-79bd-4bb6-aedc-3f0adef202b8 tempest-VolumesExtendTest-1779327788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:53:47 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0dbb54-df76-4ec8-ba3b-4f6f04831053]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:53:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-18d22d73-79bd-4bb6-aedc-3f0adef202b8 tempest-VolumesExtendTest-1779327788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f0adfaea-32c0-44ac-9b07-a27165e552bb {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:47 devstack sudo[97392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f0adfaea-32c0-44ac-9b07-a27165e552bb Sep 28 11:53:47 devstack sudo[97392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:47 devstack sudo[97389]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b000a705-c9f2-42d7-a8d5-f4efdf6bc797 tempest-AttachVolumeNegativeTest-962283120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-16b67192-a83e-4cd9-a29f-8106ce313696" returned: 0 in 0.426s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b000a705-c9f2-42d7-a8d5-f4efdf6bc797 tempest-AttachVolumeNegativeTest-962283120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-16b67192-a83e-4cd9-a29f-8106ce313696 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:47 devstack sudo[97397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-16b67192-a83e-4cd9-a29f-8106ce313696 Sep 28 11:53:47 devstack sudo[97397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:47 devstack sudo[97392]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-18d22d73-79bd-4bb6-aedc-3f0adef202b8 tempest-VolumesExtendTest-1779327788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f0adfaea-32c0-44ac-9b07-a27165e552bb" returned: 0 in 0.406s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-18d22d73-79bd-4bb6-aedc-3f0adef202b8 tempest-VolumesExtendTest-1779327788 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f0adfaea-32c0-44ac-9b07-a27165e552bb 2G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:47 devstack sudo[97397]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b000a705-c9f2-42d7-a8d5-f4efdf6bc797 tempest-AttachVolumeNegativeTest-962283120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-16b67192-a83e-4cd9-a29f-8106ce313696" returned: 0 in 0.266s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:47 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b000a705-c9f2-42d7-a8d5-f4efdf6bc797 tempest-AttachVolumeNegativeTest-962283120 None] Lock "cinder-quobyte-16b67192-a83e-4cd9-a29f-8106ce313696" released by "delete_volume" :: held 0.746s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:53:47 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-b000a705-c9f2-42d7-a8d5-f4efdf6bc797 tempest-AttachVolumeNegativeTest-962283120 None] Created reservations ['81d580d6-b011-47bd-9879-a500ccef3493', '6a2ec22a-2629-4599-9890-2ad22a91fb43', '20c12111-dcaf-4765-91ca-4cd648ff1816', '9039dad1-f8f6-4396-8bed-fd9bf77e0af4'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:53:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-18d22d73-79bd-4bb6-aedc-3f0adef202b8 tempest-VolumesExtendTest-1779327788 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f0adfaea-32c0-44ac-9b07-a27165e552bb 2G" returned: 0 in 0.131s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-18d22d73-79bd-4bb6-aedc-3f0adef202b8 tempest-VolumesExtendTest-1779327788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.570s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:53:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b000a705-c9f2-42d7-a8d5-f4efdf6bc797 tempest-AttachVolumeNegativeTest-962283120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:53:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b000a705-c9f2-42d7-a8d5-f4efdf6bc797 tempest-AttachVolumeNegativeTest-962283120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:53:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b000a705-c9f2-42d7-a8d5-f4efdf6bc797 tempest-AttachVolumeNegativeTest-962283120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:53:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b000a705-c9f2-42d7-a8d5-f4efdf6bc797 tempest-AttachVolumeNegativeTest-962283120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:53:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b000a705-c9f2-42d7-a8d5-f4efdf6bc797 tempest-AttachVolumeNegativeTest-962283120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:53:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b000a705-c9f2-42d7-a8d5-f4efdf6bc797 tempest-AttachVolumeNegativeTest-962283120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:47 devstack sudo[97406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:53:47 devstack sudo[97406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:47 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-18d22d73-79bd-4bb6-aedc-3f0adef202b8 tempest-VolumesExtendTest-1779327788 None] Extend volume completed successfully. Sep 28 11:53:48 devstack sudo[97406]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b000a705-c9f2-42d7-a8d5-f4efdf6bc797 tempest-AttachVolumeNegativeTest-962283120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.259s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:48 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-b000a705-c9f2-42d7-a8d5-f4efdf6bc797 tempest-AttachVolumeNegativeTest-962283120 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:53:48 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b000a705-c9f2-42d7-a8d5-f4efdf6bc797 tempest-AttachVolumeNegativeTest-962283120 None] Deleted volume successfully. Sep 28 11:53:48 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b000a705-c9f2-42d7-a8d5-f4efdf6bc797 tempest-AttachVolumeNegativeTest-962283120 None] Lock "cinder-16b67192-a83e-4cd9-a29f-8106ce313696-delete_volume" released by "delete_volume" :: held 1.217s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:53:48 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fae26bcd-8d2e-4a7f-b9fd-2539366fcff2 tempest-VolumesExtendTest-1779327788 None] Acquiring lock "cinder-f0adfaea-32c0-44ac-9b07-a27165e552bb-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:53:48 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fae26bcd-8d2e-4a7f-b9fd-2539366fcff2 tempest-VolumesExtendTest-1779327788 None] Lock "cinder-f0adfaea-32c0-44ac-9b07-a27165e552bb-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:53:48 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fae26bcd-8d2e-4a7f-b9fd-2539366fcff2 tempest-VolumesExtendTest-1779327788 None] Acquiring lock "cinder-quobyte-f0adfaea-32c0-44ac-9b07-a27165e552bb" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:53:48 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fae26bcd-8d2e-4a7f-b9fd-2539366fcff2 tempest-VolumesExtendTest-1779327788 None] Lock "cinder-quobyte-f0adfaea-32c0-44ac-9b07-a27165e552bb" acquired by "delete_volume" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:53:48 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0bd2eeb-666a-45f1-b10c-07b68f261c3d]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:53:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fae26bcd-8d2e-4a7f-b9fd-2539366fcff2 tempest-VolumesExtendTest-1779327788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f0adfaea-32c0-44ac-9b07-a27165e552bb {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:48 devstack sudo[97409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f0adfaea-32c0-44ac-9b07-a27165e552bb Sep 28 11:53:48 devstack sudo[97409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:49 devstack sudo[97409]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fae26bcd-8d2e-4a7f-b9fd-2539366fcff2 tempest-VolumesExtendTest-1779327788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f0adfaea-32c0-44ac-9b07-a27165e552bb" returned: 0 in 0.435s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fae26bcd-8d2e-4a7f-b9fd-2539366fcff2 tempest-VolumesExtendTest-1779327788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f0adfaea-32c0-44ac-9b07-a27165e552bb {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:49 devstack sudo[97414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f0adfaea-32c0-44ac-9b07-a27165e552bb Sep 28 11:53:49 devstack sudo[97414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:49 devstack sudo[97414]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fae26bcd-8d2e-4a7f-b9fd-2539366fcff2 tempest-VolumesExtendTest-1779327788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f0adfaea-32c0-44ac-9b07-a27165e552bb" returned: 0 in 0.335s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:49 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fae26bcd-8d2e-4a7f-b9fd-2539366fcff2 tempest-VolumesExtendTest-1779327788 None] Lock "cinder-quobyte-f0adfaea-32c0-44ac-9b07-a27165e552bb" released by "delete_volume" :: held 0.819s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:53:49 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-fae26bcd-8d2e-4a7f-b9fd-2539366fcff2 tempest-VolumesExtendTest-1779327788 None] Created reservations ['b3cf9c43-405e-41b5-9466-fdc3de122ca4', '5f1c4bcc-8728-4f87-be51-368920f19b77', 'ded90ace-d161-4ac0-bfca-454a132e837a', 'edd4cdfa-954a-4607-bd21-0e1e7bb07668'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:53:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fae26bcd-8d2e-4a7f-b9fd-2539366fcff2 tempest-VolumesExtendTest-1779327788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:53:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fae26bcd-8d2e-4a7f-b9fd-2539366fcff2 tempest-VolumesExtendTest-1779327788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:53:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-fae26bcd-8d2e-4a7f-b9fd-2539366fcff2 tempest-VolumesExtendTest-1779327788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:53:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-fae26bcd-8d2e-4a7f-b9fd-2539366fcff2 tempest-VolumesExtendTest-1779327788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:53:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fae26bcd-8d2e-4a7f-b9fd-2539366fcff2 tempest-VolumesExtendTest-1779327788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:53:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fae26bcd-8d2e-4a7f-b9fd-2539366fcff2 tempest-VolumesExtendTest-1779327788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:49 devstack sudo[97419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:53:49 devstack sudo[97419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:50 devstack sudo[97419]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fae26bcd-8d2e-4a7f-b9fd-2539366fcff2 tempest-VolumesExtendTest-1779327788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.392s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:50 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-fae26bcd-8d2e-4a7f-b9fd-2539366fcff2 tempest-VolumesExtendTest-1779327788 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:53:50 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-fae26bcd-8d2e-4a7f-b9fd-2539366fcff2 tempest-VolumesExtendTest-1779327788 None] Deleted volume successfully. Sep 28 11:53:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fae26bcd-8d2e-4a7f-b9fd-2539366fcff2 tempest-VolumesExtendTest-1779327788 None] Lock "cinder-f0adfaea-32c0-44ac-9b07-a27165e552bb-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:53:50 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-a670cc4c-09b9-404f-a988-9e39f2eee074 tempest-VolumesExtendTest-1779327788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:53:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a670cc4c-09b9-404f-a988-9e39f2eee074 tempest-VolumesExtendTest-1779327788 None] Flow 'volume_create_manager' (1183206b-584c-41fb-89d7-27d41b4aeb35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:53:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a670cc4c-09b9-404f-a988-9e39f2eee074 tempest-VolumesExtendTest-1779327788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9b6339f-d260-4706-8956-1c92df196f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:53:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a670cc4c-09b9-404f-a988-9e39f2eee074 tempest-VolumesExtendTest-1779327788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9b6339f-d260-4706-8956-1c92df196f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-159640578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a24f54d3-cb22-40f3-b199-a0580d20d053,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15e5e8fb093a412d8dbb499964df94a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:53:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:53:50Z,use_quota=True,user_id='3af807a6821642e7a2f827ed21e5818b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:53:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a670cc4c-09b9-404f-a988-9e39f2eee074 tempest-VolumesExtendTest-1779327788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fa67850-126b-4426-8294-bb296a23ab40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:53:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a670cc4c-09b9-404f-a988-9e39f2eee074 tempest-VolumesExtendTest-1779327788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fa67850-126b-4426-8294-bb296a23ab40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:53:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a670cc4c-09b9-404f-a988-9e39f2eee074 tempest-VolumesExtendTest-1779327788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8c4bbe8-60f9-4493-a305-632d201493ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:53:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a670cc4c-09b9-404f-a988-9e39f2eee074 tempest-VolumesExtendTest-1779327788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8c4bbe8-60f9-4493-a305-632d201493ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a24f54d3-cb22-40f3-b199-a0580d20d053', 'volume_name': 'volume-a24f54d3-cb22-40f3-b199-a0580d20d053', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:53:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a670cc4c-09b9-404f-a988-9e39f2eee074 tempest-VolumesExtendTest-1779327788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87c5bd21-8ac8-4899-9651-ff7926278508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:53:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a670cc4c-09b9-404f-a988-9e39f2eee074 tempest-VolumesExtendTest-1779327788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87c5bd21-8ac8-4899-9651-ff7926278508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:53:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a670cc4c-09b9-404f-a988-9e39f2eee074 tempest-VolumesExtendTest-1779327788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ed06259-0a91-4336-8b7c-cd559259a8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:53:50 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-a670cc4c-09b9-404f-a988-9e39f2eee074 tempest-VolumesExtendTest-1779327788 None] Volume a24f54d3-cb22-40f3-b199-a0580d20d053: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a24f54d3-cb22-40f3-b199-a0580d20d053', 'volume_size': 1} Sep 28 11:53:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a670cc4c-09b9-404f-a988-9e39f2eee074 tempest-VolumesExtendTest-1779327788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:53:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a670cc4c-09b9-404f-a988-9e39f2eee074 tempest-VolumesExtendTest-1779327788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:53:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a670cc4c-09b9-404f-a988-9e39f2eee074 tempest-VolumesExtendTest-1779327788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-159640578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a24f54d3-cb22-40f3-b199-a0580d20d053,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15e5e8fb093a412d8dbb499964df94a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:53:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:53:50Z,use_quota=True,user_id='3af807a6821642e7a2f827ed21e5818b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:53:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-a670cc4c-09b9-404f-a988-9e39f2eee074 tempest-VolumesExtendTest-1779327788 None] Creating volume a24f54d3-cb22-40f3-b199-a0580d20d053 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:53:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a670cc4c-09b9-404f-a988-9e39f2eee074 tempest-VolumesExtendTest-1779327788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:53:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a670cc4c-09b9-404f-a988-9e39f2eee074 tempest-VolumesExtendTest-1779327788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:53:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a670cc4c-09b9-404f-a988-9e39f2eee074 tempest-VolumesExtendTest-1779327788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:53:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a670cc4c-09b9-404f-a988-9e39f2eee074 tempest-VolumesExtendTest-1779327788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:53:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a670cc4c-09b9-404f-a988-9e39f2eee074 tempest-VolumesExtendTest-1779327788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:53:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a670cc4c-09b9-404f-a988-9e39f2eee074 tempest-VolumesExtendTest-1779327788 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:53:50 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-a670cc4c-09b9-404f-a988-9e39f2eee074 tempest-VolumesExtendTest-1779327788 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:53:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a670cc4c-09b9-404f-a988-9e39f2eee074 tempest-VolumesExtendTest-1779327788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a24f54d3-cb22-40f3-b199-a0580d20d053 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:50 devstack sudo[97423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a24f54d3-cb22-40f3-b199-a0580d20d053 1073741824 Sep 28 11:53:50 devstack sudo[97423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:51 devstack sudo[97423]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a670cc4c-09b9-404f-a988-9e39f2eee074 tempest-VolumesExtendTest-1779327788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a24f54d3-cb22-40f3-b199-a0580d20d053 1073741824" returned: 0 in 0.495s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a670cc4c-09b9-404f-a988-9e39f2eee074 tempest-VolumesExtendTest-1779327788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a24f54d3-cb22-40f3-b199-a0580d20d053 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:51 devstack sudo[97429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a24f54d3-cb22-40f3-b199-a0580d20d053 Sep 28 11:53:51 devstack sudo[97429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:51 devstack sudo[97429]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a670cc4c-09b9-404f-a988-9e39f2eee074 tempest-VolumesExtendTest-1779327788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a24f54d3-cb22-40f3-b199-a0580d20d053" returned: 0 in 0.276s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a670cc4c-09b9-404f-a988-9e39f2eee074 tempest-VolumesExtendTest-1779327788 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:53:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a670cc4c-09b9-404f-a988-9e39f2eee074 tempest-VolumesExtendTest-1779327788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:53:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a670cc4c-09b9-404f-a988-9e39f2eee074 tempest-VolumesExtendTest-1779327788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ed06259-0a91-4336-8b7c-cd559259a8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a24f54d3-cb22-40f3-b199-a0580d20d053', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:53:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a670cc4c-09b9-404f-a988-9e39f2eee074 tempest-VolumesExtendTest-1779327788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26a82f5f-551f-48ac-a5cd-108ec8f88a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:53:51 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-a670cc4c-09b9-404f-a988-9e39f2eee074 tempest-VolumesExtendTest-1779327788 None] Volume volume-a24f54d3-cb22-40f3-b199-a0580d20d053 (a24f54d3-cb22-40f3-b199-a0580d20d053): created successfully Sep 28 11:53:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a670cc4c-09b9-404f-a988-9e39f2eee074 tempest-VolumesExtendTest-1779327788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26a82f5f-551f-48ac-a5cd-108ec8f88a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:53:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a670cc4c-09b9-404f-a988-9e39f2eee074 tempest-VolumesExtendTest-1779327788 None] Flow 'volume_create_manager' (1183206b-584c-41fb-89d7-27d41b4aeb35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:53:51 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-a670cc4c-09b9-404f-a988-9e39f2eee074 tempest-VolumesExtendTest-1779327788 None] Created volume successfully. Sep 28 11:53:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-78dcbd7b-8b5b-47ae-9f0f-29c2098f82b3 tempest-VolumesExtendTest-1779327788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:53:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-78dcbd7b-8b5b-47ae-9f0f-29c2098f82b3 tempest-VolumesExtendTest-1779327788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:53:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-78dcbd7b-8b5b-47ae-9f0f-29c2098f82b3 tempest-VolumesExtendTest-1779327788 None] Creating offline snapshot 59536b59-0016-46d4-8e42-820472731c04 of volume a24f54d3-cb22-40f3-b199-a0580d20d053 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 11:53:53 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e40e5c-eddb-426d-969d-7a6783e7e61d]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:53:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-78dcbd7b-8b5b-47ae-9f0f-29c2098f82b3 tempest-VolumesExtendTest-1779327788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a24f54d3-cb22-40f3-b199-a0580d20d053 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:53 devstack sudo[97435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a24f54d3-cb22-40f3-b199-a0580d20d053 Sep 28 11:53:53 devstack sudo[97435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:53 devstack sudo[97435]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-78dcbd7b-8b5b-47ae-9f0f-29c2098f82b3 tempest-VolumesExtendTest-1779327788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a24f54d3-cb22-40f3-b199-a0580d20d053" returned: 0 in 0.582s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-78dcbd7b-8b5b-47ae-9f0f-29c2098f82b3 tempest-VolumesExtendTest-1779327788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a24f54d3-cb22-40f3-b199-a0580d20d053,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a24f54d3-cb22-40f3-b199-a0580d20d053.59536b59-0016-46d4-8e42-820472731c04 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:53 devstack sudo[97443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a24f54d3-cb22-40f3-b199-a0580d20d053,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a24f54d3-cb22-40f3-b199-a0580d20d053.59536b59-0016-46d4-8e42-820472731c04 1G Sep 28 11:53:53 devstack sudo[97443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:54 devstack sudo[97443]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-78dcbd7b-8b5b-47ae-9f0f-29c2098f82b3 tempest-VolumesExtendTest-1779327788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a24f54d3-cb22-40f3-b199-a0580d20d053,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a24f54d3-cb22-40f3-b199-a0580d20d053.59536b59-0016-46d4-8e42-820472731c04 1G" returned: 0 in 0.691s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-78dcbd7b-8b5b-47ae-9f0f-29c2098f82b3 tempest-VolumesExtendTest-1779327788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a24f54d3-cb22-40f3-b199-a0580d20d053 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a24f54d3-cb22-40f3-b199-a0580d20d053.59536b59-0016-46d4-8e42-820472731c04 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:54 devstack sudo[97452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a24f54d3-cb22-40f3-b199-a0580d20d053 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a24f54d3-cb22-40f3-b199-a0580d20d053.59536b59-0016-46d4-8e42-820472731c04 Sep 28 11:53:54 devstack sudo[97452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:54 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-2a4acf88-242f-4b41-ad3f-cc72f294bcbc req-65b5cb84-2be6-438c-8f2e-93ece67db2bc tempest-AttachVolumeTestJSON-1340154457 None] Terminate volume connection completed successfully. Sep 28 11:53:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-2a4acf88-242f-4b41-ad3f-cc72f294bcbc req-65b5cb84-2be6-438c-8f2e-93ece67db2bc tempest-AttachVolumeTestJSON-1340154457 None] Deleting attachment 6c35741f-48d3-4c94-ba2f-4c0073b7526b. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 11:53:54 devstack sudo[97452]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-78dcbd7b-8b5b-47ae-9f0f-29c2098f82b3 tempest-VolumesExtendTest-1779327788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a24f54d3-cb22-40f3-b199-a0580d20d053 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a24f54d3-cb22-40f3-b199-a0580d20d053.59536b59-0016-46d4-8e42-820472731c04" returned: 0 in 0.366s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:54 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-78dcbd7b-8b5b-47ae-9f0f-29c2098f82b3 tempest-VolumesExtendTest-1779327788 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a24f54d3-cb22-40f3-b199-a0580d20d053.59536b59-0016-46d4-8e42-820472731c04 is being set with open permissions: ugo+rw Sep 28 11:53:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-78dcbd7b-8b5b-47ae-9f0f-29c2098f82b3 tempest-VolumesExtendTest-1779327788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a24f54d3-cb22-40f3-b199-a0580d20d053.59536b59-0016-46d4-8e42-820472731c04 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:54 devstack sudo[97460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a24f54d3-cb22-40f3-b199-a0580d20d053.59536b59-0016-46d4-8e42-820472731c04 Sep 28 11:53:54 devstack sudo[97460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:55 devstack sudo[97460]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-78dcbd7b-8b5b-47ae-9f0f-29c2098f82b3 tempest-VolumesExtendTest-1779327788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a24f54d3-cb22-40f3-b199-a0580d20d053.59536b59-0016-46d4-8e42-820472731c04" returned: 0 in 0.291s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-78dcbd7b-8b5b-47ae-9f0f-29c2098f82b3 tempest-VolumesExtendTest-1779327788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a24f54d3-cb22-40f3-b199-a0580d20d053.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:55 devstack sudo[97463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a24f54d3-cb22-40f3-b199-a0580d20d053.info Sep 28 11:53:55 devstack sudo[97463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:55 devstack sudo[97463]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-78dcbd7b-8b5b-47ae-9f0f-29c2098f82b3 tempest-VolumesExtendTest-1779327788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a24f54d3-cb22-40f3-b199-a0580d20d053.info" returned: 0 in 0.441s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:55 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-78dcbd7b-8b5b-47ae-9f0f-29c2098f82b3 tempest-VolumesExtendTest-1779327788 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a24f54d3-cb22-40f3-b199-a0580d20d053.info is being set with open permissions: ugo+rw Sep 28 11:53:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-78dcbd7b-8b5b-47ae-9f0f-29c2098f82b3 tempest-VolumesExtendTest-1779327788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a24f54d3-cb22-40f3-b199-a0580d20d053.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:55 devstack sudo[97469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a24f54d3-cb22-40f3-b199-a0580d20d053.info Sep 28 11:53:55 devstack sudo[97469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:55 devstack sudo[97469]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-78dcbd7b-8b5b-47ae-9f0f-29c2098f82b3 tempest-VolumesExtendTest-1779327788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a24f54d3-cb22-40f3-b199-a0580d20d053.info" returned: 0 in 0.352s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-78dcbd7b-8b5b-47ae-9f0f-29c2098f82b3 tempest-VolumesExtendTest-1779327788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.887s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:53:55 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-78dcbd7b-8b5b-47ae-9f0f-29c2098f82b3 tempest-VolumesExtendTest-1779327788 None] Create snapshot completed successfully Sep 28 11:53:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f4153bb5-8b6e-41b2-bf8d-49e0747092ff tempest-VolumesExtendTest-1779327788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:53:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f4153bb5-8b6e-41b2-bf8d-49e0747092ff tempest-VolumesExtendTest-1779327788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:53:56 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f71d28-c909-4490-8bfd-0637dc129e10]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:53:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f4153bb5-8b6e-41b2-bf8d-49e0747092ff tempest-VolumesExtendTest-1779327788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a24f54d3-cb22-40f3-b199-a0580d20d053 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:56 devstack sudo[97479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a24f54d3-cb22-40f3-b199-a0580d20d053 Sep 28 11:53:56 devstack sudo[97479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:56 devstack sudo[97479]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f4153bb5-8b6e-41b2-bf8d-49e0747092ff tempest-VolumesExtendTest-1779327788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a24f54d3-cb22-40f3-b199-a0580d20d053" returned: 0 in 0.461s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f4153bb5-8b6e-41b2-bf8d-49e0747092ff tempest-VolumesExtendTest-1779327788 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a24f54d3-cb22-40f3-b199-a0580d20d053.59536b59-0016-46d4-8e42-820472731c04 2G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f4153bb5-8b6e-41b2-bf8d-49e0747092ff tempest-VolumesExtendTest-1779327788 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a24f54d3-cb22-40f3-b199-a0580d20d053.59536b59-0016-46d4-8e42-820472731c04 2G" returned: 0 in 0.192s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f4153bb5-8b6e-41b2-bf8d-49e0747092ff tempest-VolumesExtendTest-1779327788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.742s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:53:57 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-f4153bb5-8b6e-41b2-bf8d-49e0747092ff tempest-VolumesExtendTest-1779327788 None] Extend volume completed successfully. Sep 28 11:53:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0027f035-d317-4993-9f97-e164164ba169 tempest-VolumesExtendTest-1779327788 None] Acquiring lock "cinder-59536b59-0016-46d4-8e42-820472731c04-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:53:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0027f035-d317-4993-9f97-e164164ba169 tempest-VolumesExtendTest-1779327788 None] Lock "cinder-59536b59-0016-46d4-8e42-820472731c04-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:53:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0027f035-d317-4993-9f97-e164164ba169 tempest-VolumesExtendTest-1779327788 None] Acquiring lock "cinder-quobyte-a24f54d3-cb22-40f3-b199-a0580d20d053" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:53:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0027f035-d317-4993-9f97-e164164ba169 tempest-VolumesExtendTest-1779327788 None] Lock "cinder-quobyte-a24f54d3-cb22-40f3-b199-a0580d20d053" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:53:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0027f035-d317-4993-9f97-e164164ba169 tempest-VolumesExtendTest-1779327788 None] Acquiring lock "cinder-quobyte-59536b59-0016-46d4-8e42-820472731c04" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:53:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0027f035-d317-4993-9f97-e164164ba169 tempest-VolumesExtendTest-1779327788 None] Lock "cinder-quobyte-59536b59-0016-46d4-8e42-820472731c04" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:53:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-0027f035-d317-4993-9f97-e164164ba169 tempest-VolumesExtendTest-1779327788 None] Deleting offline snapshot 59536b59-0016-46d4-8e42-820472731c04 of volume a24f54d3-cb22-40f3-b199-a0580d20d053 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 11:53:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-0027f035-d317-4993-9f97-e164164ba169 tempest-VolumesExtendTest-1779327788 None] snapshot_file for this snap is: volume-a24f54d3-cb22-40f3-b199-a0580d20d053.59536b59-0016-46d4-8e42-820472731c04 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 11:53:57 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea479ec-8bfa-40e1-bdb2-74f614b7a00c]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:53:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0027f035-d317-4993-9f97-e164164ba169 tempest-VolumesExtendTest-1779327788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a24f54d3-cb22-40f3-b199-a0580d20d053.59536b59-0016-46d4-8e42-820472731c04 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:57 devstack sudo[97489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a24f54d3-cb22-40f3-b199-a0580d20d053.59536b59-0016-46d4-8e42-820472731c04 Sep 28 11:53:57 devstack sudo[97489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:58 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [req-a45f9b82-616c-4475-8119-bec5e2a38eb3 req-c0117a43-cbaf-4cf5-b1f8-6d503ee8b084 tempest-VolumesSnapshotsTestJSON-2058909463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:53:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-a45f9b82-616c-4475-8119-bec5e2a38eb3 req-c0117a43-cbaf-4cf5-b1f8-6d503ee8b084 tempest-VolumesSnapshotsTestJSON-2058909463 None] Flow 'volume_create_manager' (c2bfd636-eaf7-4300-afa0-c2ed82cc5f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:53:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-a45f9b82-616c-4475-8119-bec5e2a38eb3 req-c0117a43-cbaf-4cf5-b1f8-6d503ee8b084 tempest-VolumesSnapshotsTestJSON-2058909463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b26329d1-6326-42c4-a8f4-f56a17fa5534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:53:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-a45f9b82-616c-4475-8119-bec5e2a38eb3 req-c0117a43-cbaf-4cf5-b1f8-6d503ee8b084 tempest-VolumesSnapshotsTestJSON-2058909463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b26329d1-6326-42c4-a8f4-f56a17fa5534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-654210237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='874da93496364502be83093dcedb5a7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:53:58Z,use_quota=True,user_id='ecf235ffe7ff47a3b5601ab938adece9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:53:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-a45f9b82-616c-4475-8119-bec5e2a38eb3 req-c0117a43-cbaf-4cf5-b1f8-6d503ee8b084 tempest-VolumesSnapshotsTestJSON-2058909463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a10473b-baf0-489c-bfb1-e2fbb861b3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:53:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-a45f9b82-616c-4475-8119-bec5e2a38eb3 req-c0117a43-cbaf-4cf5-b1f8-6d503ee8b084 tempest-VolumesSnapshotsTestJSON-2058909463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a10473b-baf0-489c-bfb1-e2fbb861b3ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:53:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-a45f9b82-616c-4475-8119-bec5e2a38eb3 req-c0117a43-cbaf-4cf5-b1f8-6d503ee8b084 tempest-VolumesSnapshotsTestJSON-2058909463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (834f7bfd-a0a9-42f7-b441-02a9f8a5cf12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:53:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-a45f9b82-616c-4475-8119-bec5e2a38eb3 req-c0117a43-cbaf-4cf5-b1f8-6d503ee8b084 tempest-VolumesSnapshotsTestJSON-2058909463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (834f7bfd-a0a9-42f7-b441-02a9f8a5cf12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4', 'volume_name': 'volume-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:53:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-a45f9b82-616c-4475-8119-bec5e2a38eb3 req-c0117a43-cbaf-4cf5-b1f8-6d503ee8b084 tempest-VolumesSnapshotsTestJSON-2058909463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f247442f-3402-43c3-8309-ee71340a1a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:53:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-a45f9b82-616c-4475-8119-bec5e2a38eb3 req-c0117a43-cbaf-4cf5-b1f8-6d503ee8b084 tempest-VolumesSnapshotsTestJSON-2058909463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f247442f-3402-43c3-8309-ee71340a1a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:53:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-a45f9b82-616c-4475-8119-bec5e2a38eb3 req-c0117a43-cbaf-4cf5-b1f8-6d503ee8b084 tempest-VolumesSnapshotsTestJSON-2058909463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6086ac5d-53ec-432d-9992-5e81df97882c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:53:58 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [req-a45f9b82-616c-4475-8119-bec5e2a38eb3 req-c0117a43-cbaf-4cf5-b1f8-6d503ee8b084 tempest-VolumesSnapshotsTestJSON-2058909463 None] Volume db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4', 'volume_size': 1} Sep 28 11:53:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-a45f9b82-616c-4475-8119-bec5e2a38eb3 req-c0117a43-cbaf-4cf5-b1f8-6d503ee8b084 tempest-VolumesSnapshotsTestJSON-2058909463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:53:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-a45f9b82-616c-4475-8119-bec5e2a38eb3 req-c0117a43-cbaf-4cf5-b1f8-6d503ee8b084 tempest-VolumesSnapshotsTestJSON-2058909463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:53:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [req-a45f9b82-616c-4475-8119-bec5e2a38eb3 req-c0117a43-cbaf-4cf5-b1f8-6d503ee8b084 tempest-VolumesSnapshotsTestJSON-2058909463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-654210237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='874da93496364502be83093dcedb5a7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:53:58Z,use_quota=True,user_id='ecf235ffe7ff47a3b5601ab938adece9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:53:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [req-a45f9b82-616c-4475-8119-bec5e2a38eb3 req-c0117a43-cbaf-4cf5-b1f8-6d503ee8b084 tempest-VolumesSnapshotsTestJSON-2058909463 None] Creating volume db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:53:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-a45f9b82-616c-4475-8119-bec5e2a38eb3 req-c0117a43-cbaf-4cf5-b1f8-6d503ee8b084 tempest-VolumesSnapshotsTestJSON-2058909463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:53:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-a45f9b82-616c-4475-8119-bec5e2a38eb3 req-c0117a43-cbaf-4cf5-b1f8-6d503ee8b084 tempest-VolumesSnapshotsTestJSON-2058909463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:53:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [req-a45f9b82-616c-4475-8119-bec5e2a38eb3 req-c0117a43-cbaf-4cf5-b1f8-6d503ee8b084 tempest-VolumesSnapshotsTestJSON-2058909463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:53:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [req-a45f9b82-616c-4475-8119-bec5e2a38eb3 req-c0117a43-cbaf-4cf5-b1f8-6d503ee8b084 tempest-VolumesSnapshotsTestJSON-2058909463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:53:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-a45f9b82-616c-4475-8119-bec5e2a38eb3 req-c0117a43-cbaf-4cf5-b1f8-6d503ee8b084 tempest-VolumesSnapshotsTestJSON-2058909463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:53:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [req-a45f9b82-616c-4475-8119-bec5e2a38eb3 req-c0117a43-cbaf-4cf5-b1f8-6d503ee8b084 tempest-VolumesSnapshotsTestJSON-2058909463 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:53:58 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [req-a45f9b82-616c-4475-8119-bec5e2a38eb3 req-c0117a43-cbaf-4cf5-b1f8-6d503ee8b084 tempest-VolumesSnapshotsTestJSON-2058909463 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:53:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-a45f9b82-616c-4475-8119-bec5e2a38eb3 req-c0117a43-cbaf-4cf5-b1f8-6d503ee8b084 tempest-VolumesSnapshotsTestJSON-2058909463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:58 devstack sudo[97502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4 1073741824 Sep 28 11:53:58 devstack sudo[97502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:58 devstack sudo[97489]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0027f035-d317-4993-9f97-e164164ba169 tempest-VolumesExtendTest-1779327788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a24f54d3-cb22-40f3-b199-a0580d20d053.59536b59-0016-46d4-8e42-820472731c04" returned: 0 in 0.646s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-0027f035-d317-4993-9f97-e164164ba169 tempest-VolumesExtendTest-1779327788 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a24f54d3-cb22-40f3-b199-a0580d20d053(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 11:53:58 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba85af9f-95c0-46a3-9dcf-0fb5e09e5bd9]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:53:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0027f035-d317-4993-9f97-e164164ba169 tempest-VolumesExtendTest-1779327788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a24f54d3-cb22-40f3-b199-a0580d20d053 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:58 devstack sudo[97509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a24f54d3-cb22-40f3-b199-a0580d20d053 Sep 28 11:53:58 devstack sudo[97509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:59 devstack sudo[97509]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0027f035-d317-4993-9f97-e164164ba169 tempest-VolumesExtendTest-1779327788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a24f54d3-cb22-40f3-b199-a0580d20d053" returned: 0 in 0.580s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0027f035-d317-4993-9f97-e164164ba169 tempest-VolumesExtendTest-1779327788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a24f54d3-cb22-40f3-b199-a0580d20d053.59536b59-0016-46d4-8e42-820472731c04 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:59 devstack sudo[97502]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-a45f9b82-616c-4475-8119-bec5e2a38eb3 req-c0117a43-cbaf-4cf5-b1f8-6d503ee8b084 tempest-VolumesSnapshotsTestJSON-2058909463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4 1073741824" returned: 0 in 0.761s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:59 devstack sudo[97529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a24f54d3-cb22-40f3-b199-a0580d20d053.59536b59-0016-46d4-8e42-820472731c04 Sep 28 11:53:59 devstack sudo[97529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-a45f9b82-616c-4475-8119-bec5e2a38eb3 req-c0117a43-cbaf-4cf5-b1f8-6d503ee8b084 tempest-VolumesSnapshotsTestJSON-2058909463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:59 devstack sudo[97531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4 Sep 28 11:53:59 devstack sudo[97531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:53:59 devstack sudo[97531]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-a45f9b82-616c-4475-8119-bec5e2a38eb3 req-c0117a43-cbaf-4cf5-b1f8-6d503ee8b084 tempest-VolumesSnapshotsTestJSON-2058909463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4" returned: 0 in 0.336s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [req-a45f9b82-616c-4475-8119-bec5e2a38eb3 req-c0117a43-cbaf-4cf5-b1f8-6d503ee8b084 tempest-VolumesSnapshotsTestJSON-2058909463 None] <== create_volume: return (1167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:53:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-a45f9b82-616c-4475-8119-bec5e2a38eb3 req-c0117a43-cbaf-4cf5-b1f8-6d503ee8b084 tempest-VolumesSnapshotsTestJSON-2058909463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:53:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-a45f9b82-616c-4475-8119-bec5e2a38eb3 req-c0117a43-cbaf-4cf5-b1f8-6d503ee8b084 tempest-VolumesSnapshotsTestJSON-2058909463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6086ac5d-53ec-432d-9992-5e81df97882c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:53:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-a45f9b82-616c-4475-8119-bec5e2a38eb3 req-c0117a43-cbaf-4cf5-b1f8-6d503ee8b084 tempest-VolumesSnapshotsTestJSON-2058909463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd10f07f-be2c-496c-a86e-a2909980f328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:53:59 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [req-a45f9b82-616c-4475-8119-bec5e2a38eb3 req-c0117a43-cbaf-4cf5-b1f8-6d503ee8b084 tempest-VolumesSnapshotsTestJSON-2058909463 None] Volume volume-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4 (db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4): created successfully Sep 28 11:53:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-a45f9b82-616c-4475-8119-bec5e2a38eb3 req-c0117a43-cbaf-4cf5-b1f8-6d503ee8b084 tempest-VolumesSnapshotsTestJSON-2058909463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd10f07f-be2c-496c-a86e-a2909980f328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:53:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-a45f9b82-616c-4475-8119-bec5e2a38eb3 req-c0117a43-cbaf-4cf5-b1f8-6d503ee8b084 tempest-VolumesSnapshotsTestJSON-2058909463 None] Flow 'volume_create_manager' (c2bfd636-eaf7-4300-afa0-c2ed82cc5f48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:53:59 devstack sudo[97529]: pam_unix(sudo:session): session closed for user root Sep 28 11:53:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0027f035-d317-4993-9f97-e164164ba169 tempest-VolumesExtendTest-1779327788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a24f54d3-cb22-40f3-b199-a0580d20d053.59536b59-0016-46d4-8e42-820472731c04" returned: 0 in 0.500s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:53:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0027f035-d317-4993-9f97-e164164ba169 tempest-VolumesExtendTest-1779327788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a24f54d3-cb22-40f3-b199-a0580d20d053.59536b59-0016-46d4-8e42-820472731c04 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:53:59 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-a45f9b82-616c-4475-8119-bec5e2a38eb3 req-c0117a43-cbaf-4cf5-b1f8-6d503ee8b084 tempest-VolumesSnapshotsTestJSON-2058909463 None] Created volume successfully. Sep 28 11:53:59 devstack sudo[97548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a24f54d3-cb22-40f3-b199-a0580d20d053.59536b59-0016-46d4-8e42-820472731c04 Sep 28 11:53:59 devstack sudo[97548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:00 devstack sudo[97548]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0027f035-d317-4993-9f97-e164164ba169 tempest-VolumesExtendTest-1779327788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a24f54d3-cb22-40f3-b199-a0580d20d053.59536b59-0016-46d4-8e42-820472731c04" returned: 0 in 0.574s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:00 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=89,cinder:UPDATE=112,cinder:INSERT=32,cinder:DELETE=6 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 11:54:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0027f035-d317-4993-9f97-e164164ba169 tempest-VolumesExtendTest-1779327788 None] Lock "cinder-quobyte-59536b59-0016-46d4-8e42-820472731c04" released by "_delete_snapshot" :: held 2.490s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:54:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0027f035-d317-4993-9f97-e164164ba169 tempest-VolumesExtendTest-1779327788 None] Lock "cinder-quobyte-a24f54d3-cb22-40f3-b199-a0580d20d053" released by "delete_snapshot" :: held 2.527s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:54:00 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-0027f035-d317-4993-9f97-e164164ba169 tempest-VolumesExtendTest-1779327788 None] Created reservations ['87942d4f-4e80-437f-b5a4-52d2054c7d3d', '92d02d95-543c-4602-8e99-c9a91c87fde0', '119d8e65-2d43-4c58-8b43-42740ef06982', '27f9ae1f-6f88-497a-a840-dc0cbee978f8'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:54:00 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-0027f035-d317-4993-9f97-e164164ba169 tempest-VolumesExtendTest-1779327788 None] Delete snapshot completed successfully. Sep 28 11:54:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0027f035-d317-4993-9f97-e164164ba169 tempest-VolumesExtendTest-1779327788 None] Lock "cinder-59536b59-0016-46d4-8e42-820472731c04-delete_snapshot" released by "delete_snapshot" :: held 2.733s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:54:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-e4eb01cb-4054-4200-b6f3-20658215bd1f req-75a6d6c7-04e3-4389-803e-3f84e1d04cff tempest-VolumesSnapshotsTestJSON-2058909463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:54:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-e4eb01cb-4054-4200-b6f3-20658215bd1f req-75a6d6c7-04e3-4389-803e-3f84e1d04cff tempest-VolumesSnapshotsTestJSON-2058909463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:54:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [req-e4eb01cb-4054-4200-b6f3-20658215bd1f req-75a6d6c7-04e3-4389-803e-3f84e1d04cff tempest-VolumesSnapshotsTestJSON-2058909463 None] Creating offline snapshot 1cca8200-5722-4005-9eba-1ecd29550381 of volume db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 11:54:00 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1f61a0-eca0-4576-867b-afa1b95ba284]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:54:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-e4eb01cb-4054-4200-b6f3-20658215bd1f req-75a6d6c7-04e3-4389-803e-3f84e1d04cff tempest-VolumesSnapshotsTestJSON-2058909463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:01 devstack sudo[97618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4 Sep 28 11:54:01 devstack sudo[97618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-23180419-12e1-4978-b64f-f1cc6fdfa8c9 tempest-VolumesExtendTest-1779327788 None] Acquiring lock "cinder-a24f54d3-cb22-40f3-b199-a0580d20d053-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:54:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-23180419-12e1-4978-b64f-f1cc6fdfa8c9 tempest-VolumesExtendTest-1779327788 None] Lock "cinder-a24f54d3-cb22-40f3-b199-a0580d20d053-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:54:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-23180419-12e1-4978-b64f-f1cc6fdfa8c9 tempest-VolumesExtendTest-1779327788 None] Acquiring lock "cinder-quobyte-a24f54d3-cb22-40f3-b199-a0580d20d053" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:54:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-23180419-12e1-4978-b64f-f1cc6fdfa8c9 tempest-VolumesExtendTest-1779327788 None] Lock "cinder-quobyte-a24f54d3-cb22-40f3-b199-a0580d20d053" acquired by "delete_volume" :: waited 0.024s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:54:01 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b590ac-7e8d-447c-9644-70c2889144ca]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:54:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-23180419-12e1-4978-b64f-f1cc6fdfa8c9 tempest-VolumesExtendTest-1779327788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a24f54d3-cb22-40f3-b199-a0580d20d053 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:01 devstack sudo[97618]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-e4eb01cb-4054-4200-b6f3-20658215bd1f req-75a6d6c7-04e3-4389-803e-3f84e1d04cff tempest-VolumesSnapshotsTestJSON-2058909463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4" returned: 0 in 0.501s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-e4eb01cb-4054-4200-b6f3-20658215bd1f req-75a6d6c7-04e3-4389-803e-3f84e1d04cff tempest-VolumesSnapshotsTestJSON-2058909463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4.1cca8200-5722-4005-9eba-1ecd29550381 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:01 devstack sudo[97634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4.1cca8200-5722-4005-9eba-1ecd29550381 1G Sep 28 11:54:01 devstack sudo[97634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:01 devstack sudo[97633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a24f54d3-cb22-40f3-b199-a0580d20d053 Sep 28 11:54:01 devstack sudo[97633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:01 devstack sudo[97633]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-23180419-12e1-4978-b64f-f1cc6fdfa8c9 tempest-VolumesExtendTest-1779327788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a24f54d3-cb22-40f3-b199-a0580d20d053" returned: 0 in 0.521s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-23180419-12e1-4978-b64f-f1cc6fdfa8c9 tempest-VolumesExtendTest-1779327788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a24f54d3-cb22-40f3-b199-a0580d20d053 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:01 devstack sudo[97643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a24f54d3-cb22-40f3-b199-a0580d20d053 Sep 28 11:54:01 devstack sudo[97643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:01 devstack sudo[97634]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-e4eb01cb-4054-4200-b6f3-20658215bd1f req-75a6d6c7-04e3-4389-803e-3f84e1d04cff tempest-VolumesSnapshotsTestJSON-2058909463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4.1cca8200-5722-4005-9eba-1ecd29550381 1G" returned: 0 in 0.541s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-e4eb01cb-4054-4200-b6f3-20658215bd1f req-75a6d6c7-04e3-4389-803e-3f84e1d04cff tempest-VolumesSnapshotsTestJSON-2058909463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4.1cca8200-5722-4005-9eba-1ecd29550381 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:01 devstack sudo[97646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4.1cca8200-5722-4005-9eba-1ecd29550381 Sep 28 11:54:01 devstack sudo[97646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:02 devstack sudo[97643]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-23180419-12e1-4978-b64f-f1cc6fdfa8c9 tempest-VolumesExtendTest-1779327788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a24f54d3-cb22-40f3-b199-a0580d20d053" returned: 0 in 0.309s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-23180419-12e1-4978-b64f-f1cc6fdfa8c9 tempest-VolumesExtendTest-1779327788 None] Lock "cinder-quobyte-a24f54d3-cb22-40f3-b199-a0580d20d053" released by "delete_volume" :: held 0.949s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:54:02 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-23180419-12e1-4978-b64f-f1cc6fdfa8c9 tempest-VolumesExtendTest-1779327788 None] Created reservations ['0dc5bc86-71a5-4031-8d3d-4193809f2ada', 'b7145d3b-589d-42dd-a375-3877ed511dfc', '39fbf498-a86d-41a3-84aa-5046a62b8dad', '65cd031a-ac7a-4618-b74a-deb1ced97dc7'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:54:02 devstack sudo[97646]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-e4eb01cb-4054-4200-b6f3-20658215bd1f req-75a6d6c7-04e3-4389-803e-3f84e1d04cff tempest-VolumesSnapshotsTestJSON-2058909463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4.1cca8200-5722-4005-9eba-1ecd29550381" returned: 0 in 0.421s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:02 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [req-e4eb01cb-4054-4200-b6f3-20658215bd1f req-75a6d6c7-04e3-4389-803e-3f84e1d04cff tempest-VolumesSnapshotsTestJSON-2058909463 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4.1cca8200-5722-4005-9eba-1ecd29550381 is being set with open permissions: ugo+rw Sep 28 11:54:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-e4eb01cb-4054-4200-b6f3-20658215bd1f req-75a6d6c7-04e3-4389-803e-3f84e1d04cff tempest-VolumesSnapshotsTestJSON-2058909463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4.1cca8200-5722-4005-9eba-1ecd29550381 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-23180419-12e1-4978-b64f-f1cc6fdfa8c9 tempest-VolumesExtendTest-1779327788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:54:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-23180419-12e1-4978-b64f-f1cc6fdfa8c9 tempest-VolumesExtendTest-1779327788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:54:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-23180419-12e1-4978-b64f-f1cc6fdfa8c9 tempest-VolumesExtendTest-1779327788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:54:02 devstack sudo[97654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4.1cca8200-5722-4005-9eba-1ecd29550381 Sep 28 11:54:02 devstack sudo[97654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-23180419-12e1-4978-b64f-f1cc6fdfa8c9 tempest-VolumesExtendTest-1779327788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:54:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-23180419-12e1-4978-b64f-f1cc6fdfa8c9 tempest-VolumesExtendTest-1779327788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:54:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-23180419-12e1-4978-b64f-f1cc6fdfa8c9 tempest-VolumesExtendTest-1779327788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:02 devstack sudo[97656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:54:02 devstack sudo[97656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:02 devstack sudo[97654]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-e4eb01cb-4054-4200-b6f3-20658215bd1f req-75a6d6c7-04e3-4389-803e-3f84e1d04cff tempest-VolumesSnapshotsTestJSON-2058909463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4.1cca8200-5722-4005-9eba-1ecd29550381" returned: 0 in 0.265s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:02 devstack sudo[97656]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-23180419-12e1-4978-b64f-f1cc6fdfa8c9 tempest-VolumesExtendTest-1779327788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.259s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:02 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-23180419-12e1-4978-b64f-f1cc6fdfa8c9 tempest-VolumesExtendTest-1779327788 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:54:02 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-23180419-12e1-4978-b64f-f1cc6fdfa8c9 tempest-VolumesExtendTest-1779327788 None] Deleted volume successfully. Sep 28 11:54:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-e4eb01cb-4054-4200-b6f3-20658215bd1f req-75a6d6c7-04e3-4389-803e-3f84e1d04cff tempest-VolumesSnapshotsTestJSON-2058909463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-23180419-12e1-4978-b64f-f1cc6fdfa8c9 tempest-VolumesExtendTest-1779327788 None] Lock "cinder-a24f54d3-cb22-40f3-b199-a0580d20d053-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:54:02 devstack sudo[97660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4.info Sep 28 11:54:02 devstack sudo[97660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:02 devstack sudo[97660]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-e4eb01cb-4054-4200-b6f3-20658215bd1f req-75a6d6c7-04e3-4389-803e-3f84e1d04cff tempest-VolumesSnapshotsTestJSON-2058909463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4.info" returned: 0 in 0.296s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:02 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [req-e4eb01cb-4054-4200-b6f3-20658215bd1f req-75a6d6c7-04e3-4389-803e-3f84e1d04cff tempest-VolumesSnapshotsTestJSON-2058909463 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4.info is being set with open permissions: ugo+rw Sep 28 11:54:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-e4eb01cb-4054-4200-b6f3-20658215bd1f req-75a6d6c7-04e3-4389-803e-3f84e1d04cff tempest-VolumesSnapshotsTestJSON-2058909463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:03 devstack sudo[97664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4.info Sep 28 11:54:03 devstack sudo[97664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:03 devstack sudo[97664]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-e4eb01cb-4054-4200-b6f3-20658215bd1f req-75a6d6c7-04e3-4389-803e-3f84e1d04cff tempest-VolumesSnapshotsTestJSON-2058909463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4.info" returned: 0 in 0.266s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-e4eb01cb-4054-4200-b6f3-20658215bd1f req-75a6d6c7-04e3-4389-803e-3f84e1d04cff tempest-VolumesSnapshotsTestJSON-2058909463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.433s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:54:03 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-e4eb01cb-4054-4200-b6f3-20658215bd1f req-75a6d6c7-04e3-4389-803e-3f84e1d04cff tempest-VolumesSnapshotsTestJSON-2058909463 None] Create snapshot completed successfully Sep 28 11:54:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-7fff1674-f43a-43f5-a2a6-4d4dd94e9f72 req-66c44b93-f3ed-404a-bfac-d8988c07bff2 tempest-VolumesSnapshotsTestJSON-2058909463 None] Acquiring lock "cinder-1cca8200-5722-4005-9eba-1ecd29550381-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:54:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-7fff1674-f43a-43f5-a2a6-4d4dd94e9f72 req-66c44b93-f3ed-404a-bfac-d8988c07bff2 tempest-VolumesSnapshotsTestJSON-2058909463 None] Lock "cinder-1cca8200-5722-4005-9eba-1ecd29550381-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:54:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-7fff1674-f43a-43f5-a2a6-4d4dd94e9f72 req-66c44b93-f3ed-404a-bfac-d8988c07bff2 tempest-VolumesSnapshotsTestJSON-2058909463 None] Acquiring lock "cinder-quobyte-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:54:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-7fff1674-f43a-43f5-a2a6-4d4dd94e9f72 req-66c44b93-f3ed-404a-bfac-d8988c07bff2 tempest-VolumesSnapshotsTestJSON-2058909463 None] Lock "cinder-quobyte-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:54:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-7fff1674-f43a-43f5-a2a6-4d4dd94e9f72 req-66c44b93-f3ed-404a-bfac-d8988c07bff2 tempest-VolumesSnapshotsTestJSON-2058909463 None] Acquiring lock "cinder-quobyte-1cca8200-5722-4005-9eba-1ecd29550381" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:54:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-7fff1674-f43a-43f5-a2a6-4d4dd94e9f72 req-66c44b93-f3ed-404a-bfac-d8988c07bff2 tempest-VolumesSnapshotsTestJSON-2058909463 None] Lock "cinder-quobyte-1cca8200-5722-4005-9eba-1ecd29550381" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:54:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [req-7fff1674-f43a-43f5-a2a6-4d4dd94e9f72 req-66c44b93-f3ed-404a-bfac-d8988c07bff2 tempest-VolumesSnapshotsTestJSON-2058909463 None] Deleting offline snapshot 1cca8200-5722-4005-9eba-1ecd29550381 of volume db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 11:54:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [req-7fff1674-f43a-43f5-a2a6-4d4dd94e9f72 req-66c44b93-f3ed-404a-bfac-d8988c07bff2 tempest-VolumesSnapshotsTestJSON-2058909463 None] snapshot_file for this snap is: volume-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4.1cca8200-5722-4005-9eba-1ecd29550381 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 11:54:04 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d551a58-5ee1-492b-9140-a3a1cafdb0d8]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:54:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-7fff1674-f43a-43f5-a2a6-4d4dd94e9f72 req-66c44b93-f3ed-404a-bfac-d8988c07bff2 tempest-VolumesSnapshotsTestJSON-2058909463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4.1cca8200-5722-4005-9eba-1ecd29550381 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:04 devstack sudo[97667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4.1cca8200-5722-4005-9eba-1ecd29550381 Sep 28 11:54:04 devstack sudo[97667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:04 devstack sudo[97667]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-7fff1674-f43a-43f5-a2a6-4d4dd94e9f72 req-66c44b93-f3ed-404a-bfac-d8988c07bff2 tempest-VolumesSnapshotsTestJSON-2058909463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4.1cca8200-5722-4005-9eba-1ecd29550381" returned: 0 in 0.590s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [req-7fff1674-f43a-43f5-a2a6-4d4dd94e9f72 req-66c44b93-f3ed-404a-bfac-d8988c07bff2 tempest-VolumesSnapshotsTestJSON-2058909463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 11:54:04 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae89bf4-f1e0-4c6b-9160-707f16b4956c]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:54:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-7fff1674-f43a-43f5-a2a6-4d4dd94e9f72 req-66c44b93-f3ed-404a-bfac-d8988c07bff2 tempest-VolumesSnapshotsTestJSON-2058909463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:04 devstack sudo[97678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4 Sep 28 11:54:04 devstack sudo[97678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:05 devstack sudo[97678]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-7fff1674-f43a-43f5-a2a6-4d4dd94e9f72 req-66c44b93-f3ed-404a-bfac-d8988c07bff2 tempest-VolumesSnapshotsTestJSON-2058909463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4" returned: 0 in 0.610s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-7fff1674-f43a-43f5-a2a6-4d4dd94e9f72 req-66c44b93-f3ed-404a-bfac-d8988c07bff2 tempest-VolumesSnapshotsTestJSON-2058909463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4.1cca8200-5722-4005-9eba-1ecd29550381 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:05 devstack sudo[97721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4.1cca8200-5722-4005-9eba-1ecd29550381 Sep 28 11:54:05 devstack sudo[97721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:05 devstack sudo[97721]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-7fff1674-f43a-43f5-a2a6-4d4dd94e9f72 req-66c44b93-f3ed-404a-bfac-d8988c07bff2 tempest-VolumesSnapshotsTestJSON-2058909463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4.1cca8200-5722-4005-9eba-1ecd29550381" returned: 0 in 0.538s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-7fff1674-f43a-43f5-a2a6-4d4dd94e9f72 req-66c44b93-f3ed-404a-bfac-d8988c07bff2 tempest-VolumesSnapshotsTestJSON-2058909463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4.1cca8200-5722-4005-9eba-1ecd29550381 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:05 devstack sudo[97728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4.1cca8200-5722-4005-9eba-1ecd29550381 Sep 28 11:54:05 devstack sudo[97728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:06 devstack sudo[97728]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-7fff1674-f43a-43f5-a2a6-4d4dd94e9f72 req-66c44b93-f3ed-404a-bfac-d8988c07bff2 tempest-VolumesSnapshotsTestJSON-2058909463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4.1cca8200-5722-4005-9eba-1ecd29550381" returned: 0 in 0.267s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-7fff1674-f43a-43f5-a2a6-4d4dd94e9f72 req-66c44b93-f3ed-404a-bfac-d8988c07bff2 tempest-VolumesSnapshotsTestJSON-2058909463 None] Lock "cinder-quobyte-1cca8200-5722-4005-9eba-1ecd29550381" released by "_delete_snapshot" :: held 2.158s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:54:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-7fff1674-f43a-43f5-a2a6-4d4dd94e9f72 req-66c44b93-f3ed-404a-bfac-d8988c07bff2 tempest-VolumesSnapshotsTestJSON-2058909463 None] Lock "cinder-quobyte-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4" released by "delete_snapshot" :: held 2.206s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:54:06 devstack cinder-volume[86916]: DEBUG cinder.quota [req-7fff1674-f43a-43f5-a2a6-4d4dd94e9f72 req-66c44b93-f3ed-404a-bfac-d8988c07bff2 tempest-VolumesSnapshotsTestJSON-2058909463 None] Created reservations ['a27759ed-87c6-456b-9201-cffb8f5011ef', '8fd3e12e-fa61-4405-81a5-a5a4a0987b73', '53181153-df1a-45dd-ba6f-3df561795e4c', 'f177ffa9-f125-4c4d-aed6-9ef4451d398d'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:54:06 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-7fff1674-f43a-43f5-a2a6-4d4dd94e9f72 req-66c44b93-f3ed-404a-bfac-d8988c07bff2 tempest-VolumesSnapshotsTestJSON-2058909463 None] Delete snapshot completed successfully. Sep 28 11:54:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-7fff1674-f43a-43f5-a2a6-4d4dd94e9f72 req-66c44b93-f3ed-404a-bfac-d8988c07bff2 tempest-VolumesSnapshotsTestJSON-2058909463 None] Lock "cinder-1cca8200-5722-4005-9eba-1ecd29550381-delete_snapshot" released by "delete_snapshot" :: held 2.382s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:54:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-9798fa1a-91e7-4f78-8646-085088eeecc3 req-8f4a7b52-392f-4001-867e-9f4f46714563 tempest-VolumesSnapshotsTestJSON-2058909463 None] Acquiring lock "cinder-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:54:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-9798fa1a-91e7-4f78-8646-085088eeecc3 req-8f4a7b52-392f-4001-867e-9f4f46714563 tempest-VolumesSnapshotsTestJSON-2058909463 None] Lock "cinder-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:54:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-9798fa1a-91e7-4f78-8646-085088eeecc3 req-8f4a7b52-392f-4001-867e-9f4f46714563 tempest-VolumesSnapshotsTestJSON-2058909463 None] Acquiring lock "cinder-quobyte-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:54:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-9798fa1a-91e7-4f78-8646-085088eeecc3 req-8f4a7b52-392f-4001-867e-9f4f46714563 tempest-VolumesSnapshotsTestJSON-2058909463 None] Lock "cinder-quobyte-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4" acquired by "delete_volume" :: waited 0.033s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:54:07 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2889833-05f8-4008-bdd8-6ca41d54869b]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:54:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-9798fa1a-91e7-4f78-8646-085088eeecc3 req-8f4a7b52-392f-4001-867e-9f4f46714563 tempest-VolumesSnapshotsTestJSON-2058909463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:07 devstack sudo[97731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4 Sep 28 11:54:07 devstack sudo[97731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:07 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-d91d3261-83e7-4cca-bab1-d64a10cd72b9 tempest-VolumesGetTest-1204081055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:54:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d91d3261-83e7-4cca-bab1-d64a10cd72b9 tempest-VolumesGetTest-1204081055 None] Flow 'volume_create_manager' (5ff2d2e1-161f-4b7a-ad00-49d2e352e40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:54:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d91d3261-83e7-4cca-bab1-d64a10cd72b9 tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4bdb448-d652-4787-b6de-4b830c1d7129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:07 devstack sudo[97731]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-9798fa1a-91e7-4f78-8646-085088eeecc3 req-8f4a7b52-392f-4001-867e-9f4f46714563 tempest-VolumesSnapshotsTestJSON-2058909463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4" returned: 0 in 0.473s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-9798fa1a-91e7-4f78-8646-085088eeecc3 req-8f4a7b52-392f-4001-867e-9f4f46714563 tempest-VolumesSnapshotsTestJSON-2058909463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d91d3261-83e7-4cca-bab1-d64a10cd72b9 tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4bdb448-d652-4787-b6de-4b830c1d7129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:54:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1094454317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71e00ebe-e1d4-4744-a520-55c8e141ed16,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8790c17115e54fa0ba110c487f5a135e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:54:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:54:08Z,use_quota=True,user_id='1bf577ca5c394deebd5591e73249b349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d91d3261-83e7-4cca-bab1-d64a10cd72b9 tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee35841e-591c-4bfd-a8fc-06624813e5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:08 devstack sudo[97736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4 Sep 28 11:54:08 devstack sudo[97736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d91d3261-83e7-4cca-bab1-d64a10cd72b9 tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee35841e-591c-4bfd-a8fc-06624813e5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d91d3261-83e7-4cca-bab1-d64a10cd72b9 tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aab62351-8b73-4ca9-b3f6-797b55d6548f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d91d3261-83e7-4cca-bab1-d64a10cd72b9 tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aab62351-8b73-4ca9-b3f6-797b55d6548f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71e00ebe-e1d4-4744-a520-55c8e141ed16', 'volume_name': 'volume-71e00ebe-e1d4-4744-a520-55c8e141ed16', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d91d3261-83e7-4cca-bab1-d64a10cd72b9 tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (336fd0ca-1537-49fa-8876-e353cb91c703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d91d3261-83e7-4cca-bab1-d64a10cd72b9 tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (336fd0ca-1537-49fa-8876-e353cb91c703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d91d3261-83e7-4cca-bab1-d64a10cd72b9 tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (435496a6-8048-4103-8500-f13309251092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:08 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-d91d3261-83e7-4cca-bab1-d64a10cd72b9 tempest-VolumesGetTest-1204081055 None] Volume 71e00ebe-e1d4-4744-a520-55c8e141ed16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71e00ebe-e1d4-4744-a520-55c8e141ed16', 'volume_size': 1} Sep 28 11:54:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d91d3261-83e7-4cca-bab1-d64a10cd72b9 tempest-VolumesGetTest-1204081055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:54:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d91d3261-83e7-4cca-bab1-d64a10cd72b9 tempest-VolumesGetTest-1204081055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:54:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d91d3261-83e7-4cca-bab1-d64a10cd72b9 tempest-VolumesGetTest-1204081055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:54:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1094454317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71e00ebe-e1d4-4744-a520-55c8e141ed16,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8790c17115e54fa0ba110c487f5a135e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:54:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:54:08Z,use_quota=True,user_id='1bf577ca5c394deebd5591e73249b349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:54:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-d91d3261-83e7-4cca-bab1-d64a10cd72b9 tempest-VolumesGetTest-1204081055 None] Creating volume 71e00ebe-e1d4-4744-a520-55c8e141ed16 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:54:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d91d3261-83e7-4cca-bab1-d64a10cd72b9 tempest-VolumesGetTest-1204081055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:54:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d91d3261-83e7-4cca-bab1-d64a10cd72b9 tempest-VolumesGetTest-1204081055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:54:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d91d3261-83e7-4cca-bab1-d64a10cd72b9 tempest-VolumesGetTest-1204081055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:54:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d91d3261-83e7-4cca-bab1-d64a10cd72b9 tempest-VolumesGetTest-1204081055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:54:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d91d3261-83e7-4cca-bab1-d64a10cd72b9 tempest-VolumesGetTest-1204081055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:54:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d91d3261-83e7-4cca-bab1-d64a10cd72b9 tempest-VolumesGetTest-1204081055 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:54:08 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-d91d3261-83e7-4cca-bab1-d64a10cd72b9 tempest-VolumesGetTest-1204081055 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:54:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d91d3261-83e7-4cca-bab1-d64a10cd72b9 tempest-VolumesGetTest-1204081055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-71e00ebe-e1d4-4744-a520-55c8e141ed16 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:08 devstack sudo[97738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-71e00ebe-e1d4-4744-a520-55c8e141ed16 1073741824 Sep 28 11:54:08 devstack sudo[97738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:08 devstack sudo[97736]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-9798fa1a-91e7-4f78-8646-085088eeecc3 req-8f4a7b52-392f-4001-867e-9f4f46714563 tempest-VolumesSnapshotsTestJSON-2058909463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4" returned: 0 in 0.264s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-9798fa1a-91e7-4f78-8646-085088eeecc3 req-8f4a7b52-392f-4001-867e-9f4f46714563 tempest-VolumesSnapshotsTestJSON-2058909463 None] Lock "cinder-quobyte-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4" released by "delete_volume" :: held 0.824s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:54:08 devstack cinder-volume[86916]: DEBUG cinder.quota [req-9798fa1a-91e7-4f78-8646-085088eeecc3 req-8f4a7b52-392f-4001-867e-9f4f46714563 tempest-VolumesSnapshotsTestJSON-2058909463 None] Created reservations ['b9ffca49-7e0c-4c59-994d-f47f2c425042', '532031ef-c0b8-4214-a580-0f4716b6507e', 'cdaaedd5-ae6e-4ffe-9f15-939980e23abf', '40cc912e-06e2-449e-b639-d77d19cc97ec'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:54:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-9798fa1a-91e7-4f78-8646-085088eeecc3 req-8f4a7b52-392f-4001-867e-9f4f46714563 tempest-VolumesSnapshotsTestJSON-2058909463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:54:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-9798fa1a-91e7-4f78-8646-085088eeecc3 req-8f4a7b52-392f-4001-867e-9f4f46714563 tempest-VolumesSnapshotsTestJSON-2058909463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:54:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [req-9798fa1a-91e7-4f78-8646-085088eeecc3 req-8f4a7b52-392f-4001-867e-9f4f46714563 tempest-VolumesSnapshotsTestJSON-2058909463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:54:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [req-9798fa1a-91e7-4f78-8646-085088eeecc3 req-8f4a7b52-392f-4001-867e-9f4f46714563 tempest-VolumesSnapshotsTestJSON-2058909463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:54:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-9798fa1a-91e7-4f78-8646-085088eeecc3 req-8f4a7b52-392f-4001-867e-9f4f46714563 tempest-VolumesSnapshotsTestJSON-2058909463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:54:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-9798fa1a-91e7-4f78-8646-085088eeecc3 req-8f4a7b52-392f-4001-867e-9f4f46714563 tempest-VolumesSnapshotsTestJSON-2058909463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:08 devstack sudo[97744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:54:08 devstack sudo[97744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:08 devstack sudo[97738]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d91d3261-83e7-4cca-bab1-d64a10cd72b9 tempest-VolumesGetTest-1204081055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-71e00ebe-e1d4-4744-a520-55c8e141ed16 1073741824" returned: 0 in 0.516s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d91d3261-83e7-4cca-bab1-d64a10cd72b9 tempest-VolumesGetTest-1204081055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-71e00ebe-e1d4-4744-a520-55c8e141ed16 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:08 devstack sudo[97747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-71e00ebe-e1d4-4744-a520-55c8e141ed16 Sep 28 11:54:08 devstack sudo[97747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:08 devstack sudo[97744]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-9798fa1a-91e7-4f78-8646-085088eeecc3 req-8f4a7b52-392f-4001-867e-9f4f46714563 tempest-VolumesSnapshotsTestJSON-2058909463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.351s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:08 devstack cinder-volume[86916]: DEBUG cinder.manager [req-9798fa1a-91e7-4f78-8646-085088eeecc3 req-8f4a7b52-392f-4001-867e-9f4f46714563 tempest-VolumesSnapshotsTestJSON-2058909463 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:54:08 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-9798fa1a-91e7-4f78-8646-085088eeecc3 req-8f4a7b52-392f-4001-867e-9f4f46714563 tempest-VolumesSnapshotsTestJSON-2058909463 None] Deleted volume successfully. Sep 28 11:54:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-9798fa1a-91e7-4f78-8646-085088eeecc3 req-8f4a7b52-392f-4001-867e-9f4f46714563 tempest-VolumesSnapshotsTestJSON-2058909463 None] Lock "cinder-db2a7ee2-b15a-4bc0-9ff3-f36d24eaedd4-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:54:08 devstack sudo[97747]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d91d3261-83e7-4cca-bab1-d64a10cd72b9 tempest-VolumesGetTest-1204081055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-71e00ebe-e1d4-4744-a520-55c8e141ed16" returned: 0 in 0.282s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d91d3261-83e7-4cca-bab1-d64a10cd72b9 tempest-VolumesGetTest-1204081055 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:54:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d91d3261-83e7-4cca-bab1-d64a10cd72b9 tempest-VolumesGetTest-1204081055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:54:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d91d3261-83e7-4cca-bab1-d64a10cd72b9 tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (435496a6-8048-4103-8500-f13309251092) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71e00ebe-e1d4-4744-a520-55c8e141ed16', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d91d3261-83e7-4cca-bab1-d64a10cd72b9 tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeeef94e-638a-40e8-959f-04ccd3f0955e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:08 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-d91d3261-83e7-4cca-bab1-d64a10cd72b9 tempest-VolumesGetTest-1204081055 None] Volume volume-71e00ebe-e1d4-4744-a520-55c8e141ed16 (71e00ebe-e1d4-4744-a520-55c8e141ed16): created successfully Sep 28 11:54:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d91d3261-83e7-4cca-bab1-d64a10cd72b9 tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeeef94e-638a-40e8-959f-04ccd3f0955e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d91d3261-83e7-4cca-bab1-d64a10cd72b9 tempest-VolumesGetTest-1204081055 None] Flow 'volume_create_manager' (5ff2d2e1-161f-4b7a-ad00-49d2e352e40b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:54:08 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-d91d3261-83e7-4cca-bab1-d64a10cd72b9 tempest-VolumesGetTest-1204081055 None] Created volume successfully. Sep 28 11:54:11 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-75746458-de9d-4ff8-af7b-e3ef47a1e2cd tempest-VolumesGetTest-1204081055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:54:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-75746458-de9d-4ff8-af7b-e3ef47a1e2cd tempest-VolumesGetTest-1204081055 None] Flow 'volume_create_manager' (f7c93d79-fd74-426c-a2a5-e91a4711f00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:54:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-75746458-de9d-4ff8-af7b-e3ef47a1e2cd tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09ca85d1-9e86-426a-835a-52ae8e3b3fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-75746458-de9d-4ff8-af7b-e3ef47a1e2cd tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09ca85d1-9e86-426a-835a-52ae8e3b3fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:54:11Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-606606052',display_name='tempest-VolumesGetTest-Volume-439732085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ee6d8ef-2670-4df2-a1cb-9814c59f04a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8790c17115e54fa0ba110c487f5a135e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:54:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:54:11Z,use_quota=True,user_id='1bf577ca5c394deebd5591e73249b349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-75746458-de9d-4ff8-af7b-e3ef47a1e2cd tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b0930c0-fb8c-4f22-80f3-dd8450b0645b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-75746458-de9d-4ff8-af7b-e3ef47a1e2cd tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b0930c0-fb8c-4f22-80f3-dd8450b0645b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-75746458-de9d-4ff8-af7b-e3ef47a1e2cd tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3048b1e-f2d2-4f29-84c4-e029a97861d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-75746458-de9d-4ff8-af7b-e3ef47a1e2cd tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3048b1e-f2d2-4f29-84c4-e029a97861d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ee6d8ef-2670-4df2-a1cb-9814c59f04a2', 'volume_name': 'volume-1ee6d8ef-2670-4df2-a1cb-9814c59f04a2', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-75746458-de9d-4ff8-af7b-e3ef47a1e2cd tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c442ee3-3962-4401-ac2b-5f1cf29c95d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-75746458-de9d-4ff8-af7b-e3ef47a1e2cd tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c442ee3-3962-4401-ac2b-5f1cf29c95d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-75746458-de9d-4ff8-af7b-e3ef47a1e2cd tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1e1b555-6b1b-4fe6-a0ef-3ff96a971a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:11 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-75746458-de9d-4ff8-af7b-e3ef47a1e2cd tempest-VolumesGetTest-1204081055 None] Volume 1ee6d8ef-2670-4df2-a1cb-9814c59f04a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ee6d8ef-2670-4df2-a1cb-9814c59f04a2', 'volume_size': 1} Sep 28 11:54:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-75746458-de9d-4ff8-af7b-e3ef47a1e2cd tempest-VolumesGetTest-1204081055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:54:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-75746458-de9d-4ff8-af7b-e3ef47a1e2cd tempest-VolumesGetTest-1204081055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:54:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-75746458-de9d-4ff8-af7b-e3ef47a1e2cd tempest-VolumesGetTest-1204081055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:54:11Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-606606052',display_name='tempest-VolumesGetTest-Volume-439732085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ee6d8ef-2670-4df2-a1cb-9814c59f04a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8790c17115e54fa0ba110c487f5a135e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:54:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:54:11Z,use_quota=True,user_id='1bf577ca5c394deebd5591e73249b349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:54:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-75746458-de9d-4ff8-af7b-e3ef47a1e2cd tempest-VolumesGetTest-1204081055 None] Creating volume 1ee6d8ef-2670-4df2-a1cb-9814c59f04a2 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:54:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-75746458-de9d-4ff8-af7b-e3ef47a1e2cd tempest-VolumesGetTest-1204081055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:54:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-75746458-de9d-4ff8-af7b-e3ef47a1e2cd tempest-VolumesGetTest-1204081055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:54:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-75746458-de9d-4ff8-af7b-e3ef47a1e2cd tempest-VolumesGetTest-1204081055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:54:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-75746458-de9d-4ff8-af7b-e3ef47a1e2cd tempest-VolumesGetTest-1204081055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:54:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-75746458-de9d-4ff8-af7b-e3ef47a1e2cd tempest-VolumesGetTest-1204081055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:54:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-75746458-de9d-4ff8-af7b-e3ef47a1e2cd tempest-VolumesGetTest-1204081055 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:54:11 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-75746458-de9d-4ff8-af7b-e3ef47a1e2cd tempest-VolumesGetTest-1204081055 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:54:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-75746458-de9d-4ff8-af7b-e3ef47a1e2cd tempest-VolumesGetTest-1204081055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1ee6d8ef-2670-4df2-a1cb-9814c59f04a2 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:11 devstack sudo[97752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1ee6d8ef-2670-4df2-a1cb-9814c59f04a2 1073741824 Sep 28 11:54:11 devstack sudo[97752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:11 devstack sudo[97752]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-75746458-de9d-4ff8-af7b-e3ef47a1e2cd tempest-VolumesGetTest-1204081055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1ee6d8ef-2670-4df2-a1cb-9814c59f04a2 1073741824" returned: 0 in 0.484s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-75746458-de9d-4ff8-af7b-e3ef47a1e2cd tempest-VolumesGetTest-1204081055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1ee6d8ef-2670-4df2-a1cb-9814c59f04a2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:11 devstack sudo[97758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1ee6d8ef-2670-4df2-a1cb-9814c59f04a2 Sep 28 11:54:11 devstack sudo[97758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:12 devstack sudo[97758]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-75746458-de9d-4ff8-af7b-e3ef47a1e2cd tempest-VolumesGetTest-1204081055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1ee6d8ef-2670-4df2-a1cb-9814c59f04a2" returned: 0 in 0.301s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-75746458-de9d-4ff8-af7b-e3ef47a1e2cd tempest-VolumesGetTest-1204081055 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:54:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-75746458-de9d-4ff8-af7b-e3ef47a1e2cd tempest-VolumesGetTest-1204081055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:54:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-75746458-de9d-4ff8-af7b-e3ef47a1e2cd tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1e1b555-6b1b-4fe6-a0ef-3ff96a971a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ee6d8ef-2670-4df2-a1cb-9814c59f04a2', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-75746458-de9d-4ff8-af7b-e3ef47a1e2cd tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b46f2052-6bda-4fff-bb4e-69003c176b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:12 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-75746458-de9d-4ff8-af7b-e3ef47a1e2cd tempest-VolumesGetTest-1204081055 None] Volume volume-1ee6d8ef-2670-4df2-a1cb-9814c59f04a2 (1ee6d8ef-2670-4df2-a1cb-9814c59f04a2): created successfully Sep 28 11:54:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-75746458-de9d-4ff8-af7b-e3ef47a1e2cd tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b46f2052-6bda-4fff-bb4e-69003c176b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-75746458-de9d-4ff8-af7b-e3ef47a1e2cd tempest-VolumesGetTest-1204081055 None] Flow 'volume_create_manager' (f7c93d79-fd74-426c-a2a5-e91a4711f00e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:54:12 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-75746458-de9d-4ff8-af7b-e3ef47a1e2cd tempest-VolumesGetTest-1204081055 None] Created volume successfully. Sep 28 11:54:12 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-5abc0ae2-c243-40dd-b351-7d257e75548d tempest-VolumesTestJSON-109379566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:54:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5abc0ae2-c243-40dd-b351-7d257e75548d tempest-VolumesTestJSON-109379566 None] Flow 'volume_create_manager' (81269d60-6f83-4170-b837-29b3054f75ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:54:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5abc0ae2-c243-40dd-b351-7d257e75548d tempest-VolumesTestJSON-109379566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e6712a2-ac09-4977-9ed1-5a92d24f1f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5abc0ae2-c243-40dd-b351-7d257e75548d tempest-VolumesTestJSON-109379566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e6712a2-ac09-4977-9ed1-5a92d24f1f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:54:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-537494398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7b19507-413b-4080-9fc7-8fe588eccbdb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='347c3e9d3f634a0193e70eae4f038541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:54:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:54:13Z,use_quota=True,user_id='3293ead5155b40468c0538050c5c3c60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5abc0ae2-c243-40dd-b351-7d257e75548d tempest-VolumesTestJSON-109379566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f2a4e84-800f-4b3b-a24a-d22d9501cac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5abc0ae2-c243-40dd-b351-7d257e75548d tempest-VolumesTestJSON-109379566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f2a4e84-800f-4b3b-a24a-d22d9501cac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5abc0ae2-c243-40dd-b351-7d257e75548d tempest-VolumesTestJSON-109379566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (478bd6c6-56d4-4ca8-bde0-a434c3f0b536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5abc0ae2-c243-40dd-b351-7d257e75548d tempest-VolumesTestJSON-109379566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (478bd6c6-56d4-4ca8-bde0-a434c3f0b536) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7b19507-413b-4080-9fc7-8fe588eccbdb', 'volume_name': 'volume-c7b19507-413b-4080-9fc7-8fe588eccbdb', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5abc0ae2-c243-40dd-b351-7d257e75548d tempest-VolumesTestJSON-109379566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd5252fe-639b-4f91-a646-5c1e1f945fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5abc0ae2-c243-40dd-b351-7d257e75548d tempest-VolumesTestJSON-109379566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd5252fe-639b-4f91-a646-5c1e1f945fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5abc0ae2-c243-40dd-b351-7d257e75548d tempest-VolumesTestJSON-109379566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d8ba0dd-fac2-4da8-945e-8f271d5fab83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:12 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-5abc0ae2-c243-40dd-b351-7d257e75548d tempest-VolumesTestJSON-109379566 None] Volume c7b19507-413b-4080-9fc7-8fe588eccbdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7b19507-413b-4080-9fc7-8fe588eccbdb', 'volume_size': 1} Sep 28 11:54:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5abc0ae2-c243-40dd-b351-7d257e75548d tempest-VolumesTestJSON-109379566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:54:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5abc0ae2-c243-40dd-b351-7d257e75548d tempest-VolumesTestJSON-109379566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:54:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5abc0ae2-c243-40dd-b351-7d257e75548d tempest-VolumesTestJSON-109379566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:54:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-537494398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7b19507-413b-4080-9fc7-8fe588eccbdb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='347c3e9d3f634a0193e70eae4f038541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:54:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:54:13Z,use_quota=True,user_id='3293ead5155b40468c0538050c5c3c60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:54:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-5abc0ae2-c243-40dd-b351-7d257e75548d tempest-VolumesTestJSON-109379566 None] Creating volume c7b19507-413b-4080-9fc7-8fe588eccbdb {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:54:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5abc0ae2-c243-40dd-b351-7d257e75548d tempest-VolumesTestJSON-109379566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:54:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5abc0ae2-c243-40dd-b351-7d257e75548d tempest-VolumesTestJSON-109379566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:54:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5abc0ae2-c243-40dd-b351-7d257e75548d tempest-VolumesTestJSON-109379566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:54:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5abc0ae2-c243-40dd-b351-7d257e75548d tempest-VolumesTestJSON-109379566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:54:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5abc0ae2-c243-40dd-b351-7d257e75548d tempest-VolumesTestJSON-109379566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:54:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5abc0ae2-c243-40dd-b351-7d257e75548d tempest-VolumesTestJSON-109379566 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:54:13 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-5abc0ae2-c243-40dd-b351-7d257e75548d tempest-VolumesTestJSON-109379566 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:54:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5abc0ae2-c243-40dd-b351-7d257e75548d tempest-VolumesTestJSON-109379566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c7b19507-413b-4080-9fc7-8fe588eccbdb 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:13 devstack sudo[97761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c7b19507-413b-4080-9fc7-8fe588eccbdb 1073741824 Sep 28 11:54:13 devstack sudo[97761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0c48defc-9981-4b52-a5af-56d09f707942 tempest-VolumesGetTest-1204081055 None] Acquiring lock "cinder-1ee6d8ef-2670-4df2-a1cb-9814c59f04a2-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:54:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0c48defc-9981-4b52-a5af-56d09f707942 tempest-VolumesGetTest-1204081055 None] Lock "cinder-1ee6d8ef-2670-4df2-a1cb-9814c59f04a2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:54:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0c48defc-9981-4b52-a5af-56d09f707942 tempest-VolumesGetTest-1204081055 None] Acquiring lock "cinder-quobyte-1ee6d8ef-2670-4df2-a1cb-9814c59f04a2" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:54:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0c48defc-9981-4b52-a5af-56d09f707942 tempest-VolumesGetTest-1204081055 None] Lock "cinder-quobyte-1ee6d8ef-2670-4df2-a1cb-9814c59f04a2" acquired by "delete_volume" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:54:13 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf014a2d-57b1-4160-8b9e-f48fa18f0e2c]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:54:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0c48defc-9981-4b52-a5af-56d09f707942 tempest-VolumesGetTest-1204081055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1ee6d8ef-2670-4df2-a1cb-9814c59f04a2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:13 devstack sudo[97761]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5abc0ae2-c243-40dd-b351-7d257e75548d tempest-VolumesTestJSON-109379566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c7b19507-413b-4080-9fc7-8fe588eccbdb 1073741824" returned: 0 in 0.525s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5abc0ae2-c243-40dd-b351-7d257e75548d tempest-VolumesTestJSON-109379566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c7b19507-413b-4080-9fc7-8fe588eccbdb {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:13 devstack sudo[97767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1ee6d8ef-2670-4df2-a1cb-9814c59f04a2 Sep 28 11:54:13 devstack sudo[97767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:13 devstack sudo[97768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c7b19507-413b-4080-9fc7-8fe588eccbdb Sep 28 11:54:13 devstack sudo[97768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:13 devstack sudo[97768]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5abc0ae2-c243-40dd-b351-7d257e75548d tempest-VolumesTestJSON-109379566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c7b19507-413b-4080-9fc7-8fe588eccbdb" returned: 0 in 0.270s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5abc0ae2-c243-40dd-b351-7d257e75548d tempest-VolumesTestJSON-109379566 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:54:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5abc0ae2-c243-40dd-b351-7d257e75548d tempest-VolumesTestJSON-109379566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:54:13 devstack sudo[97767]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0c48defc-9981-4b52-a5af-56d09f707942 tempest-VolumesGetTest-1204081055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1ee6d8ef-2670-4df2-a1cb-9814c59f04a2" returned: 0 in 0.386s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0c48defc-9981-4b52-a5af-56d09f707942 tempest-VolumesGetTest-1204081055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1ee6d8ef-2670-4df2-a1cb-9814c59f04a2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5abc0ae2-c243-40dd-b351-7d257e75548d tempest-VolumesTestJSON-109379566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d8ba0dd-fac2-4da8-945e-8f271d5fab83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7b19507-413b-4080-9fc7-8fe588eccbdb', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5abc0ae2-c243-40dd-b351-7d257e75548d tempest-VolumesTestJSON-109379566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (421216fd-16cf-48fd-ad7c-35e030ea9272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:13 devstack sudo[97775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1ee6d8ef-2670-4df2-a1cb-9814c59f04a2 Sep 28 11:54:13 devstack sudo[97775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:13 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-5abc0ae2-c243-40dd-b351-7d257e75548d tempest-VolumesTestJSON-109379566 None] Volume volume-c7b19507-413b-4080-9fc7-8fe588eccbdb (c7b19507-413b-4080-9fc7-8fe588eccbdb): created successfully Sep 28 11:54:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5abc0ae2-c243-40dd-b351-7d257e75548d tempest-VolumesTestJSON-109379566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (421216fd-16cf-48fd-ad7c-35e030ea9272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5abc0ae2-c243-40dd-b351-7d257e75548d tempest-VolumesTestJSON-109379566 None] Flow 'volume_create_manager' (81269d60-6f83-4170-b837-29b3054f75ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:54:13 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-5abc0ae2-c243-40dd-b351-7d257e75548d tempest-VolumesTestJSON-109379566 None] Created volume successfully. Sep 28 11:54:14 devstack sudo[97775]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0c48defc-9981-4b52-a5af-56d09f707942 tempest-VolumesGetTest-1204081055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1ee6d8ef-2670-4df2-a1cb-9814c59f04a2" returned: 0 in 0.266s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0c48defc-9981-4b52-a5af-56d09f707942 tempest-VolumesGetTest-1204081055 None] Lock "cinder-quobyte-1ee6d8ef-2670-4df2-a1cb-9814c59f04a2" released by "delete_volume" :: held 0.697s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:54:14 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-0c48defc-9981-4b52-a5af-56d09f707942 tempest-VolumesGetTest-1204081055 None] Created reservations ['3f1bd7db-2777-4165-84ec-55b6df874580', 'd7a6bef0-97be-4d10-ac80-774a34cbb24e', '293e51b1-53ab-4a07-a81b-baa578f234a7', '54793ce7-b95e-4a89-b83d-7a00f4bb169c'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:54:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0c48defc-9981-4b52-a5af-56d09f707942 tempest-VolumesGetTest-1204081055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:54:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0c48defc-9981-4b52-a5af-56d09f707942 tempest-VolumesGetTest-1204081055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:54:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0c48defc-9981-4b52-a5af-56d09f707942 tempest-VolumesGetTest-1204081055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:54:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0c48defc-9981-4b52-a5af-56d09f707942 tempest-VolumesGetTest-1204081055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:54:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0c48defc-9981-4b52-a5af-56d09f707942 tempest-VolumesGetTest-1204081055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:54:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0c48defc-9981-4b52-a5af-56d09f707942 tempest-VolumesGetTest-1204081055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:14 devstack sudo[97778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:54:14 devstack sudo[97778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:14 devstack sudo[97778]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0c48defc-9981-4b52-a5af-56d09f707942 tempest-VolumesGetTest-1204081055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.306s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:14 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-0c48defc-9981-4b52-a5af-56d09f707942 tempest-VolumesGetTest-1204081055 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:54:14 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-0c48defc-9981-4b52-a5af-56d09f707942 tempest-VolumesGetTest-1204081055 None] Deleted volume successfully. Sep 28 11:54:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0c48defc-9981-4b52-a5af-56d09f707942 tempest-VolumesGetTest-1204081055 None] Lock "cinder-1ee6d8ef-2670-4df2-a1cb-9814c59f04a2-delete_volume" released by "delete_volume" :: held 1.234s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:54:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-60211c67-71bf-45c4-84bf-acf04cf56a03 tempest-VolumesGetTest-1204081055 None] Acquiring lock "cinder-71e00ebe-e1d4-4744-a520-55c8e141ed16-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:54:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-60211c67-71bf-45c4-84bf-acf04cf56a03 tempest-VolumesGetTest-1204081055 None] Lock "cinder-71e00ebe-e1d4-4744-a520-55c8e141ed16-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:54:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-60211c67-71bf-45c4-84bf-acf04cf56a03 tempest-VolumesGetTest-1204081055 None] Acquiring lock "cinder-quobyte-71e00ebe-e1d4-4744-a520-55c8e141ed16" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:54:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-60211c67-71bf-45c4-84bf-acf04cf56a03 tempest-VolumesGetTest-1204081055 None] Lock "cinder-quobyte-71e00ebe-e1d4-4744-a520-55c8e141ed16" acquired by "delete_volume" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:54:14 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a76d983-e339-497c-a95d-3288abd6855b]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:54:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-60211c67-71bf-45c4-84bf-acf04cf56a03 tempest-VolumesGetTest-1204081055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-71e00ebe-e1d4-4744-a520-55c8e141ed16 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:14 devstack sudo[97782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-71e00ebe-e1d4-4744-a520-55c8e141ed16 Sep 28 11:54:14 devstack sudo[97782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:15 devstack sudo[97782]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-60211c67-71bf-45c4-84bf-acf04cf56a03 tempest-VolumesGetTest-1204081055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-71e00ebe-e1d4-4744-a520-55c8e141ed16" returned: 0 in 0.370s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-60211c67-71bf-45c4-84bf-acf04cf56a03 tempest-VolumesGetTest-1204081055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-71e00ebe-e1d4-4744-a520-55c8e141ed16 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:15 devstack sudo[97787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-71e00ebe-e1d4-4744-a520-55c8e141ed16 Sep 28 11:54:15 devstack sudo[97787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:15 devstack sudo[97787]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-60211c67-71bf-45c4-84bf-acf04cf56a03 tempest-VolumesGetTest-1204081055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-71e00ebe-e1d4-4744-a520-55c8e141ed16" returned: 0 in 0.274s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-60211c67-71bf-45c4-84bf-acf04cf56a03 tempest-VolumesGetTest-1204081055 None] Lock "cinder-quobyte-71e00ebe-e1d4-4744-a520-55c8e141ed16" released by "delete_volume" :: held 0.689s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:54:15 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-60211c67-71bf-45c4-84bf-acf04cf56a03 tempest-VolumesGetTest-1204081055 None] Created reservations ['6aa47f57-6738-4d6f-9cc9-25186be962ad', '081deac8-046b-48df-aa1b-3bb12f6b107f', 'b8a98eef-252b-455e-a346-c3109d84377d', '4d911ff6-52ba-41cd-a294-a65d5701448d'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:54:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-60211c67-71bf-45c4-84bf-acf04cf56a03 tempest-VolumesGetTest-1204081055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:54:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-60211c67-71bf-45c4-84bf-acf04cf56a03 tempest-VolumesGetTest-1204081055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:54:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-60211c67-71bf-45c4-84bf-acf04cf56a03 tempest-VolumesGetTest-1204081055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:54:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-60211c67-71bf-45c4-84bf-acf04cf56a03 tempest-VolumesGetTest-1204081055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:54:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-60211c67-71bf-45c4-84bf-acf04cf56a03 tempest-VolumesGetTest-1204081055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:54:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-60211c67-71bf-45c4-84bf-acf04cf56a03 tempest-VolumesGetTest-1204081055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:15 devstack sudo[97796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:54:15 devstack sudo[97796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:15 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-82a988e1-dc51-4a07-b54e-d806659a0600 tempest-VolumesTestJSON-109379566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:54:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-82a988e1-dc51-4a07-b54e-d806659a0600 tempest-VolumesTestJSON-109379566 None] Flow 'volume_create_manager' (f7a7caa8-6376-4ed2-b330-066590cc136d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:54:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-82a988e1-dc51-4a07-b54e-d806659a0600 tempest-VolumesTestJSON-109379566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c6aec8d-b735-4f3a-b323-6ab0ef41567b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-82a988e1-dc51-4a07-b54e-d806659a0600 tempest-VolumesTestJSON-109379566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c6aec8d-b735-4f3a-b323-6ab0ef41567b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-453195220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4470ca5b-cdfc-4c46-a955-a65e32f3b6ee,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='347c3e9d3f634a0193e70eae4f038541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:54:16Z,use_quota=True,user_id='3293ead5155b40468c0538050c5c3c60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-82a988e1-dc51-4a07-b54e-d806659a0600 tempest-VolumesTestJSON-109379566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (138c7ee2-c935-49b9-aaac-92542762e7ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-82a988e1-dc51-4a07-b54e-d806659a0600 tempest-VolumesTestJSON-109379566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (138c7ee2-c935-49b9-aaac-92542762e7ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-82a988e1-dc51-4a07-b54e-d806659a0600 tempest-VolumesTestJSON-109379566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93e3cd80-a41e-4c53-ba56-d69957339d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-82a988e1-dc51-4a07-b54e-d806659a0600 tempest-VolumesTestJSON-109379566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93e3cd80-a41e-4c53-ba56-d69957339d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4470ca5b-cdfc-4c46-a955-a65e32f3b6ee', 'volume_name': 'volume-4470ca5b-cdfc-4c46-a955-a65e32f3b6ee', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-82a988e1-dc51-4a07-b54e-d806659a0600 tempest-VolumesTestJSON-109379566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc592827-de3a-4e1b-8f10-8f4b00b2eace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-82a988e1-dc51-4a07-b54e-d806659a0600 tempest-VolumesTestJSON-109379566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc592827-de3a-4e1b-8f10-8f4b00b2eace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-82a988e1-dc51-4a07-b54e-d806659a0600 tempest-VolumesTestJSON-109379566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2495dab-8cea-41f8-a9cd-a8bd8057470f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:15 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-82a988e1-dc51-4a07-b54e-d806659a0600 tempest-VolumesTestJSON-109379566 None] Volume 4470ca5b-cdfc-4c46-a955-a65e32f3b6ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4470ca5b-cdfc-4c46-a955-a65e32f3b6ee', 'volume_size': 1} Sep 28 11:54:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-82a988e1-dc51-4a07-b54e-d806659a0600 tempest-VolumesTestJSON-109379566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:54:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-82a988e1-dc51-4a07-b54e-d806659a0600 tempest-VolumesTestJSON-109379566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:54:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-82a988e1-dc51-4a07-b54e-d806659a0600 tempest-VolumesTestJSON-109379566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-453195220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4470ca5b-cdfc-4c46-a955-a65e32f3b6ee,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='347c3e9d3f634a0193e70eae4f038541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:54:16Z,use_quota=True,user_id='3293ead5155b40468c0538050c5c3c60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:54:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-82a988e1-dc51-4a07-b54e-d806659a0600 tempest-VolumesTestJSON-109379566 None] Creating volume 4470ca5b-cdfc-4c46-a955-a65e32f3b6ee {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:54:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-82a988e1-dc51-4a07-b54e-d806659a0600 tempest-VolumesTestJSON-109379566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:54:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-82a988e1-dc51-4a07-b54e-d806659a0600 tempest-VolumesTestJSON-109379566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:54:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-82a988e1-dc51-4a07-b54e-d806659a0600 tempest-VolumesTestJSON-109379566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:54:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-82a988e1-dc51-4a07-b54e-d806659a0600 tempest-VolumesTestJSON-109379566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:54:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-82a988e1-dc51-4a07-b54e-d806659a0600 tempest-VolumesTestJSON-109379566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:54:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-82a988e1-dc51-4a07-b54e-d806659a0600 tempest-VolumesTestJSON-109379566 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:54:15 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-82a988e1-dc51-4a07-b54e-d806659a0600 tempest-VolumesTestJSON-109379566 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:54:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-82a988e1-dc51-4a07-b54e-d806659a0600 tempest-VolumesTestJSON-109379566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4470ca5b-cdfc-4c46-a955-a65e32f3b6ee 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:15 devstack sudo[97796]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-60211c67-71bf-45c4-84bf-acf04cf56a03 tempest-VolumesGetTest-1204081055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.282s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:15 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-60211c67-71bf-45c4-84bf-acf04cf56a03 tempest-VolumesGetTest-1204081055 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:54:15 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-60211c67-71bf-45c4-84bf-acf04cf56a03 tempest-VolumesGetTest-1204081055 None] Deleted volume successfully. Sep 28 11:54:15 devstack sudo[97799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4470ca5b-cdfc-4c46-a955-a65e32f3b6ee 1073741824 Sep 28 11:54:15 devstack sudo[97799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-60211c67-71bf-45c4-84bf-acf04cf56a03 tempest-VolumesGetTest-1204081055 None] Lock "cinder-71e00ebe-e1d4-4744-a520-55c8e141ed16-delete_volume" released by "delete_volume" :: held 1.193s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:54:16 devstack sudo[97799]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:16 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-c51348ac-45d6-4ee3-a33a-45b83c50b746 tempest-VolumesGetTest-1204081055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:54:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c51348ac-45d6-4ee3-a33a-45b83c50b746 tempest-VolumesGetTest-1204081055 None] Flow 'volume_create_manager' (68a4f029-fb11-4caf-afec-92b6e54a964b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:54:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c51348ac-45d6-4ee3-a33a-45b83c50b746 tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d389fa41-ba4e-489f-bf50-e460262b342d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-82a988e1-dc51-4a07-b54e-d806659a0600 tempest-VolumesTestJSON-109379566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4470ca5b-cdfc-4c46-a955-a65e32f3b6ee 1073741824" returned: 0 in 0.487s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c51348ac-45d6-4ee3-a33a-45b83c50b746 tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d389fa41-ba4e-489f-bf50-e460262b342d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-783288965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=405a8345-cdca-442c-839e-20a9d7730958,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8790c17115e54fa0ba110c487f5a135e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:54:16Z,use_quota=True,user_id='1bf577ca5c394deebd5591e73249b349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c51348ac-45d6-4ee3-a33a-45b83c50b746 tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12e9d77b-0444-494a-8b3f-e793b42e95c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c51348ac-45d6-4ee3-a33a-45b83c50b746 tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12e9d77b-0444-494a-8b3f-e793b42e95c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c51348ac-45d6-4ee3-a33a-45b83c50b746 tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8d0eccb-a855-4ca3-8fa0-4e55feb01e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c51348ac-45d6-4ee3-a33a-45b83c50b746 tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8d0eccb-a855-4ca3-8fa0-4e55feb01e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '405a8345-cdca-442c-839e-20a9d7730958', 'volume_name': 'volume-405a8345-cdca-442c-839e-20a9d7730958', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c51348ac-45d6-4ee3-a33a-45b83c50b746 tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ed3b172-1a43-476b-bf53-b72078f88d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c51348ac-45d6-4ee3-a33a-45b83c50b746 tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ed3b172-1a43-476b-bf53-b72078f88d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c51348ac-45d6-4ee3-a33a-45b83c50b746 tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b5594d9-7cca-473b-80cf-3144fc735c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:16 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-c51348ac-45d6-4ee3-a33a-45b83c50b746 tempest-VolumesGetTest-1204081055 None] Volume 405a8345-cdca-442c-839e-20a9d7730958: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-405a8345-cdca-442c-839e-20a9d7730958', 'volume_size': 1} Sep 28 11:54:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c51348ac-45d6-4ee3-a33a-45b83c50b746 tempest-VolumesGetTest-1204081055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:54:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-82a988e1-dc51-4a07-b54e-d806659a0600 tempest-VolumesTestJSON-109379566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4470ca5b-cdfc-4c46-a955-a65e32f3b6ee {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:16 devstack sudo[97805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4470ca5b-cdfc-4c46-a955-a65e32f3b6ee Sep 28 11:54:16 devstack sudo[97805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:16 devstack sudo[97805]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-82a988e1-dc51-4a07-b54e-d806659a0600 tempest-VolumesTestJSON-109379566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4470ca5b-cdfc-4c46-a955-a65e32f3b6ee" returned: 0 in 0.253s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-82a988e1-dc51-4a07-b54e-d806659a0600 tempest-VolumesTestJSON-109379566 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:54:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-82a988e1-dc51-4a07-b54e-d806659a0600 tempest-VolumesTestJSON-109379566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:54:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c51348ac-45d6-4ee3-a33a-45b83c50b746 tempest-VolumesGetTest-1204081055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.280s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:54:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c51348ac-45d6-4ee3-a33a-45b83c50b746 tempest-VolumesGetTest-1204081055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-783288965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=405a8345-cdca-442c-839e-20a9d7730958,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8790c17115e54fa0ba110c487f5a135e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:54:16Z,use_quota=True,user_id='1bf577ca5c394deebd5591e73249b349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:54:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-c51348ac-45d6-4ee3-a33a-45b83c50b746 tempest-VolumesGetTest-1204081055 None] Creating volume 405a8345-cdca-442c-839e-20a9d7730958 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:54:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c51348ac-45d6-4ee3-a33a-45b83c50b746 tempest-VolumesGetTest-1204081055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:54:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c51348ac-45d6-4ee3-a33a-45b83c50b746 tempest-VolumesGetTest-1204081055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:54:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c51348ac-45d6-4ee3-a33a-45b83c50b746 tempest-VolumesGetTest-1204081055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:54:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c51348ac-45d6-4ee3-a33a-45b83c50b746 tempest-VolumesGetTest-1204081055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:54:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c51348ac-45d6-4ee3-a33a-45b83c50b746 tempest-VolumesGetTest-1204081055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:54:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c51348ac-45d6-4ee3-a33a-45b83c50b746 tempest-VolumesGetTest-1204081055 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:54:16 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-c51348ac-45d6-4ee3-a33a-45b83c50b746 tempest-VolumesGetTest-1204081055 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:54:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c51348ac-45d6-4ee3-a33a-45b83c50b746 tempest-VolumesGetTest-1204081055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-405a8345-cdca-442c-839e-20a9d7730958 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:16 devstack sudo[97808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-405a8345-cdca-442c-839e-20a9d7730958 1073741824 Sep 28 11:54:16 devstack sudo[97808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-82a988e1-dc51-4a07-b54e-d806659a0600 tempest-VolumesTestJSON-109379566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2495dab-8cea-41f8-a9cd-a8bd8057470f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4470ca5b-cdfc-4c46-a955-a65e32f3b6ee', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-82a988e1-dc51-4a07-b54e-d806659a0600 tempest-VolumesTestJSON-109379566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af6660fc-c949-4cf8-be98-b9fd45063148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:16 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-82a988e1-dc51-4a07-b54e-d806659a0600 tempest-VolumesTestJSON-109379566 None] Volume volume-4470ca5b-cdfc-4c46-a955-a65e32f3b6ee (4470ca5b-cdfc-4c46-a955-a65e32f3b6ee): created successfully Sep 28 11:54:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-82a988e1-dc51-4a07-b54e-d806659a0600 tempest-VolumesTestJSON-109379566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af6660fc-c949-4cf8-be98-b9fd45063148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-82a988e1-dc51-4a07-b54e-d806659a0600 tempest-VolumesTestJSON-109379566 None] Flow 'volume_create_manager' (f7a7caa8-6376-4ed2-b330-066590cc136d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:54:16 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-82a988e1-dc51-4a07-b54e-d806659a0600 tempest-VolumesTestJSON-109379566 None] Created volume successfully. Sep 28 11:54:17 devstack sudo[97808]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c51348ac-45d6-4ee3-a33a-45b83c50b746 tempest-VolumesGetTest-1204081055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-405a8345-cdca-442c-839e-20a9d7730958 1073741824" returned: 0 in 0.416s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c51348ac-45d6-4ee3-a33a-45b83c50b746 tempest-VolumesGetTest-1204081055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-405a8345-cdca-442c-839e-20a9d7730958 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:17 devstack sudo[97813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-405a8345-cdca-442c-839e-20a9d7730958 Sep 28 11:54:17 devstack sudo[97813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:17 devstack sudo[97813]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c51348ac-45d6-4ee3-a33a-45b83c50b746 tempest-VolumesGetTest-1204081055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-405a8345-cdca-442c-839e-20a9d7730958" returned: 0 in 0.239s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c51348ac-45d6-4ee3-a33a-45b83c50b746 tempest-VolumesGetTest-1204081055 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:54:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c51348ac-45d6-4ee3-a33a-45b83c50b746 tempest-VolumesGetTest-1204081055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:54:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c51348ac-45d6-4ee3-a33a-45b83c50b746 tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b5594d9-7cca-473b-80cf-3144fc735c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-405a8345-cdca-442c-839e-20a9d7730958', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c51348ac-45d6-4ee3-a33a-45b83c50b746 tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d35c97ed-2f6b-4adb-827f-f992a7487ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:17 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-c51348ac-45d6-4ee3-a33a-45b83c50b746 tempest-VolumesGetTest-1204081055 None] Volume volume-405a8345-cdca-442c-839e-20a9d7730958 (405a8345-cdca-442c-839e-20a9d7730958): created successfully Sep 28 11:54:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c51348ac-45d6-4ee3-a33a-45b83c50b746 tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d35c97ed-2f6b-4adb-827f-f992a7487ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c51348ac-45d6-4ee3-a33a-45b83c50b746 tempest-VolumesGetTest-1204081055 None] Flow 'volume_create_manager' (68a4f029-fb11-4caf-afec-92b6e54a964b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:54:17 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-c51348ac-45d6-4ee3-a33a-45b83c50b746 tempest-VolumesGetTest-1204081055 None] Created volume successfully. Sep 28 11:54:18 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-535b5a20-9f82-40d2-8c35-ab3e7b5a918f tempest-VolumesTestJSON-109379566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:54:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-535b5a20-9f82-40d2-8c35-ab3e7b5a918f tempest-VolumesTestJSON-109379566 None] Flow 'volume_create_manager' (653ab200-60ad-4133-af05-3b113ce2dcc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:54:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-535b5a20-9f82-40d2-8c35-ab3e7b5a918f tempest-VolumesTestJSON-109379566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fb54cdd-5ef1-472c-ad4b-037a11884d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-535b5a20-9f82-40d2-8c35-ab3e7b5a918f tempest-VolumesTestJSON-109379566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fb54cdd-5ef1-472c-ad4b-037a11884d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:54:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-880620189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=385beeec-84c1-4925-815c-08d81bea0e38,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='347c3e9d3f634a0193e70eae4f038541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:54:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:54:18Z,use_quota=True,user_id='3293ead5155b40468c0538050c5c3c60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-535b5a20-9f82-40d2-8c35-ab3e7b5a918f tempest-VolumesTestJSON-109379566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (824446e5-ebf6-4a77-9a05-de3faa143b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-535b5a20-9f82-40d2-8c35-ab3e7b5a918f tempest-VolumesTestJSON-109379566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (824446e5-ebf6-4a77-9a05-de3faa143b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-535b5a20-9f82-40d2-8c35-ab3e7b5a918f tempest-VolumesTestJSON-109379566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (721f6245-91e3-4d58-964b-3e8b2abaf5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-535b5a20-9f82-40d2-8c35-ab3e7b5a918f tempest-VolumesTestJSON-109379566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (721f6245-91e3-4d58-964b-3e8b2abaf5d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '385beeec-84c1-4925-815c-08d81bea0e38', 'volume_name': 'volume-385beeec-84c1-4925-815c-08d81bea0e38', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-535b5a20-9f82-40d2-8c35-ab3e7b5a918f tempest-VolumesTestJSON-109379566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60b68102-7659-4fb7-afd1-10ad289f56bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-535b5a20-9f82-40d2-8c35-ab3e7b5a918f tempest-VolumesTestJSON-109379566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60b68102-7659-4fb7-afd1-10ad289f56bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-535b5a20-9f82-40d2-8c35-ab3e7b5a918f tempest-VolumesTestJSON-109379566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32ca044d-3720-4064-b6e4-12be06b4935e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:18 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-535b5a20-9f82-40d2-8c35-ab3e7b5a918f tempest-VolumesTestJSON-109379566 None] Volume 385beeec-84c1-4925-815c-08d81bea0e38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-385beeec-84c1-4925-815c-08d81bea0e38', 'volume_size': 1} Sep 28 11:54:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-535b5a20-9f82-40d2-8c35-ab3e7b5a918f tempest-VolumesTestJSON-109379566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:54:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-535b5a20-9f82-40d2-8c35-ab3e7b5a918f tempest-VolumesTestJSON-109379566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:54:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-535b5a20-9f82-40d2-8c35-ab3e7b5a918f tempest-VolumesTestJSON-109379566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:54:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-880620189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=385beeec-84c1-4925-815c-08d81bea0e38,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='347c3e9d3f634a0193e70eae4f038541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:54:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:54:18Z,use_quota=True,user_id='3293ead5155b40468c0538050c5c3c60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:54:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-535b5a20-9f82-40d2-8c35-ab3e7b5a918f tempest-VolumesTestJSON-109379566 None] Creating volume 385beeec-84c1-4925-815c-08d81bea0e38 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:54:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-535b5a20-9f82-40d2-8c35-ab3e7b5a918f tempest-VolumesTestJSON-109379566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:54:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-535b5a20-9f82-40d2-8c35-ab3e7b5a918f tempest-VolumesTestJSON-109379566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:54:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-535b5a20-9f82-40d2-8c35-ab3e7b5a918f tempest-VolumesTestJSON-109379566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:54:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-535b5a20-9f82-40d2-8c35-ab3e7b5a918f tempest-VolumesTestJSON-109379566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:54:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-535b5a20-9f82-40d2-8c35-ab3e7b5a918f tempest-VolumesTestJSON-109379566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:54:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-535b5a20-9f82-40d2-8c35-ab3e7b5a918f tempest-VolumesTestJSON-109379566 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:54:18 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-535b5a20-9f82-40d2-8c35-ab3e7b5a918f tempest-VolumesTestJSON-109379566 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:54:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-535b5a20-9f82-40d2-8c35-ab3e7b5a918f tempest-VolumesTestJSON-109379566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-385beeec-84c1-4925-815c-08d81bea0e38 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:18 devstack sudo[97816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-385beeec-84c1-4925-815c-08d81bea0e38 1073741824 Sep 28 11:54:18 devstack sudo[97816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:18 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:54:18 devstack sudo[97816]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] Flow 'volume_create_manager' (d92fa089-011d-4700-8836-8d11894c1cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:54:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4c98cc4-29d0-41a2-b89b-e0c621583860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-535b5a20-9f82-40d2-8c35-ab3e7b5a918f tempest-VolumesTestJSON-109379566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-385beeec-84c1-4925-815c-08d81bea0e38 1073741824" returned: 0 in 0.526s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4c98cc4-29d0-41a2-b89b-e0c621583860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:54:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1779573278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c1f7adb-33ab-4e3e-8f10-7fe6d98f602f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8790c17115e54fa0ba110c487f5a135e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:54:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=405a8345-cdca-442c-839e-20a9d7730958,status='creating',terminated_at=None,updated_at=2026-09-28T09:54:19Z,use_quota=True,user_id='1bf577ca5c394deebd5591e73249b349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbb6593d-d2ff-4f8e-a4a7-8c5db6600ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbb6593d-d2ff-4f8e-a4a7-8c5db6600ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb71a2bb-2b8b-4c92-a7f3-7a1669a8de76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb71a2bb-2b8b-4c92-a7f3-7a1669a8de76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '1c1f7adb-33ab-4e3e-8f10-7fe6d98f602f', 'volume_name': 'volume-1c1f7adb-33ab-4e3e-8f10-7fe6d98f602f', 'volume_size': 1, 'source_volid': '405a8345-cdca-442c-839e-20a9d7730958', 'source_volstatus': 'available'}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (259ff86f-66e3-4f60-b77c-7619ece44dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (259ff86f-66e3-4f60-b77c-7619ece44dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0102fdec-c394-489a-91c0-99352ff3b323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:18 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] Volume 1c1f7adb-33ab-4e3e-8f10-7fe6d98f602f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-1c1f7adb-33ab-4e3e-8f10-7fe6d98f602f', 'volume_size': 1, 'source_volid': '405a8345-cdca-442c-839e-20a9d7730958', 'source_volstatus': 'available'} Sep 28 11:54:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:54:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-535b5a20-9f82-40d2-8c35-ab3e7b5a918f tempest-VolumesTestJSON-109379566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-385beeec-84c1-4925-815c-08d81bea0e38 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:18 devstack sudo[97822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-385beeec-84c1-4925-815c-08d81bea0e38 Sep 28 11:54:18 devstack sudo[97822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:19 devstack sudo[97822]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-535b5a20-9f82-40d2-8c35-ab3e7b5a918f tempest-VolumesTestJSON-109379566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-385beeec-84c1-4925-815c-08d81bea0e38" returned: 0 in 0.242s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-535b5a20-9f82-40d2-8c35-ab3e7b5a918f tempest-VolumesTestJSON-109379566 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:54:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-535b5a20-9f82-40d2-8c35-ab3e7b5a918f tempest-VolumesTestJSON-109379566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:54:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.257s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:54:19 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] Cloning volume 405a8345-cdca-442c-839e-20a9d7730958 to volume 1c1f7adb-33ab-4e3e-8f10-7fe6d98f602f Sep 28 11:54:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-535b5a20-9f82-40d2-8c35-ab3e7b5a918f tempest-VolumesTestJSON-109379566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32ca044d-3720-4064-b6e4-12be06b4935e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-385beeec-84c1-4925-815c-08d81bea0e38', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-535b5a20-9f82-40d2-8c35-ab3e7b5a918f tempest-VolumesTestJSON-109379566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35e59468-251c-4807-8656-cff3732a69cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:19 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-535b5a20-9f82-40d2-8c35-ab3e7b5a918f tempest-VolumesTestJSON-109379566 None] Volume volume-385beeec-84c1-4925-815c-08d81bea0e38 (385beeec-84c1-4925-815c-08d81bea0e38): created successfully Sep 28 11:54:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-535b5a20-9f82-40d2-8c35-ab3e7b5a918f tempest-VolumesTestJSON-109379566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35e59468-251c-4807-8656-cff3732a69cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-535b5a20-9f82-40d2-8c35-ab3e7b5a918f tempest-VolumesTestJSON-109379566 None] Flow 'volume_create_manager' (653ab200-60ad-4133-af05-3b113ce2dcc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:54:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] Creating offline snapshot 5b10ac04-8150-4df2-861a-256322843e53 of volume 405a8345-cdca-442c-839e-20a9d7730958 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 11:54:19 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-535b5a20-9f82-40d2-8c35-ab3e7b5a918f tempest-VolumesTestJSON-109379566 None] Created volume successfully. Sep 28 11:54:19 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[605472ab-43f7-411f-8039-bf565c6e7497]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:54:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-405a8345-cdca-442c-839e-20a9d7730958 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:19 devstack sudo[97825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-405a8345-cdca-442c-839e-20a9d7730958 Sep 28 11:54:19 devstack sudo[97825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:19 devstack sudo[97825]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-405a8345-cdca-442c-839e-20a9d7730958" returned: 0 in 0.363s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-405a8345-cdca-442c-839e-20a9d7730958,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-405a8345-cdca-442c-839e-20a9d7730958.5b10ac04-8150-4df2-861a-256322843e53 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:19 devstack sudo[97830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-405a8345-cdca-442c-839e-20a9d7730958,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-405a8345-cdca-442c-839e-20a9d7730958.5b10ac04-8150-4df2-861a-256322843e53 1G Sep 28 11:54:19 devstack sudo[97830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:20 devstack sudo[97830]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-405a8345-cdca-442c-839e-20a9d7730958,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-405a8345-cdca-442c-839e-20a9d7730958.5b10ac04-8150-4df2-861a-256322843e53 1G" returned: 0 in 0.409s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-405a8345-cdca-442c-839e-20a9d7730958 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-405a8345-cdca-442c-839e-20a9d7730958.5b10ac04-8150-4df2-861a-256322843e53 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:20 devstack sudo[97836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-405a8345-cdca-442c-839e-20a9d7730958 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-405a8345-cdca-442c-839e-20a9d7730958.5b10ac04-8150-4df2-861a-256322843e53 Sep 28 11:54:20 devstack sudo[97836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:20 devstack sudo[97836]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-405a8345-cdca-442c-839e-20a9d7730958 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-405a8345-cdca-442c-839e-20a9d7730958.5b10ac04-8150-4df2-861a-256322843e53" returned: 0 in 0.350s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:20 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-405a8345-cdca-442c-839e-20a9d7730958.5b10ac04-8150-4df2-861a-256322843e53 is being set with open permissions: ugo+rw Sep 28 11:54:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-405a8345-cdca-442c-839e-20a9d7730958.5b10ac04-8150-4df2-861a-256322843e53 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:20 devstack sudo[97842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-405a8345-cdca-442c-839e-20a9d7730958.5b10ac04-8150-4df2-861a-256322843e53 Sep 28 11:54:20 devstack sudo[97842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:20 devstack sudo[97842]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-405a8345-cdca-442c-839e-20a9d7730958.5b10ac04-8150-4df2-861a-256322843e53" returned: 0 in 0.265s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-405a8345-cdca-442c-839e-20a9d7730958.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:20 devstack sudo[97845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-405a8345-cdca-442c-839e-20a9d7730958.info Sep 28 11:54:20 devstack sudo[97845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:21 devstack sudo[97845]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-405a8345-cdca-442c-839e-20a9d7730958.info" returned: 0 in 0.304s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:21 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-405a8345-cdca-442c-839e-20a9d7730958.info is being set with open permissions: ugo+rw Sep 28 11:54:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-405a8345-cdca-442c-839e-20a9d7730958.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:21 devstack sudo[97848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-405a8345-cdca-442c-839e-20a9d7730958.info Sep 28 11:54:21 devstack sudo[97848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-91769373-88ac-452c-84fa-d5765e0e6d6f tempest-VolumesTestJSON-109379566 None] Acquiring lock "cinder-385beeec-84c1-4925-815c-08d81bea0e38-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:54:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-91769373-88ac-452c-84fa-d5765e0e6d6f tempest-VolumesTestJSON-109379566 None] Lock "cinder-385beeec-84c1-4925-815c-08d81bea0e38-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:54:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-91769373-88ac-452c-84fa-d5765e0e6d6f tempest-VolumesTestJSON-109379566 None] Acquiring lock "cinder-quobyte-385beeec-84c1-4925-815c-08d81bea0e38" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:54:21 devstack sudo[97848]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-91769373-88ac-452c-84fa-d5765e0e6d6f tempest-VolumesTestJSON-109379566 None] Lock "cinder-quobyte-385beeec-84c1-4925-815c-08d81bea0e38" acquired by "delete_volume" :: waited 0.032s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:54:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-405a8345-cdca-442c-839e-20a9d7730958.info" returned: 0 in 0.323s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] Acquiring lock "cinder-quobyte-1c1f7adb-33ab-4e3e-8f10-7fe6d98f602f" by "_copy_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:54:21 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[33afbce2-7403-40af-b8bf-ecbf7f395fb7]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:54:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-91769373-88ac-452c-84fa-d5765e0e6d6f tempest-VolumesTestJSON-109379566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-385beeec-84c1-4925-815c-08d81bea0e38 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] Lock "cinder-quobyte-1c1f7adb-33ab-4e3e-8f10-7fe6d98f602f" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:54:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] snapshot: 5b10ac04-8150-4df2-861a-256322843e53, volume: 1c1f7adb-33ab-4e3e-8f10-7fe6d98f602f, {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 11:54:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:54:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:54:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:54:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:54:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:54:21 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b80e13a-62a8-43bf-8e90-d636dc19a45b]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:54:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-405a8345-cdca-442c-839e-20a9d7730958.5b10ac04-8150-4df2-861a-256322843e53 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:21 devstack sudo[97851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-385beeec-84c1-4925-815c-08d81bea0e38 Sep 28 11:54:21 devstack sudo[97851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:21 devstack sudo[97852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-405a8345-cdca-442c-839e-20a9d7730958.5b10ac04-8150-4df2-861a-256322843e53 Sep 28 11:54:21 devstack sudo[97852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:21 devstack sudo[97851]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-91769373-88ac-452c-84fa-d5765e0e6d6f tempest-VolumesTestJSON-109379566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-385beeec-84c1-4925-815c-08d81bea0e38" returned: 0 in 0.390s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-91769373-88ac-452c-84fa-d5765e0e6d6f tempest-VolumesTestJSON-109379566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-385beeec-84c1-4925-815c-08d81bea0e38 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:21 devstack sudo[97860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-385beeec-84c1-4925-815c-08d81bea0e38 Sep 28 11:54:21 devstack sudo[97860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:21 devstack sudo[97852]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-405a8345-cdca-442c-839e-20a9d7730958.5b10ac04-8150-4df2-861a-256322843e53" returned: 0 in 0.392s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-405a8345-cdca-442c-839e-20a9d7730958(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 11:54:21 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d2dfee-ba06-43e5-b859-a6c8f51bc4b7]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:54:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-405a8345-cdca-442c-839e-20a9d7730958 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:21 devstack sudo[97863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-405a8345-cdca-442c-839e-20a9d7730958 Sep 28 11:54:21 devstack sudo[97863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:22 devstack sudo[97860]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-91769373-88ac-452c-84fa-d5765e0e6d6f tempest-VolumesTestJSON-109379566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-385beeec-84c1-4925-815c-08d81bea0e38" returned: 0 in 0.278s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-91769373-88ac-452c-84fa-d5765e0e6d6f tempest-VolumesTestJSON-109379566 None] Lock "cinder-quobyte-385beeec-84c1-4925-815c-08d81bea0e38" released by "delete_volume" :: held 0.718s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:54:22 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-91769373-88ac-452c-84fa-d5765e0e6d6f tempest-VolumesTestJSON-109379566 None] Created reservations ['bcba3e12-9d6b-4d40-a438-a2991cf97941', '3ca29901-b855-4849-b804-7b164dac94aa', 'c97e0df6-d1b7-4f14-9d63-84d7bb29495e', '09585931-c360-49a8-b585-99a4c8b33049'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:54:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-91769373-88ac-452c-84fa-d5765e0e6d6f tempest-VolumesTestJSON-109379566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:54:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-91769373-88ac-452c-84fa-d5765e0e6d6f tempest-VolumesTestJSON-109379566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:54:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-91769373-88ac-452c-84fa-d5765e0e6d6f tempest-VolumesTestJSON-109379566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:54:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-91769373-88ac-452c-84fa-d5765e0e6d6f tempest-VolumesTestJSON-109379566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:54:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-91769373-88ac-452c-84fa-d5765e0e6d6f tempest-VolumesTestJSON-109379566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:54:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-91769373-88ac-452c-84fa-d5765e0e6d6f tempest-VolumesTestJSON-109379566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:22 devstack sudo[97868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:54:22 devstack sudo[97868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:22 devstack sudo[97863]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-405a8345-cdca-442c-839e-20a9d7730958" returned: 0 in 0.389s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-405a8345-cdca-442c-839e-20a9d7730958 {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 11:54:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] Creating direct copy from snapshot {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 11:54:22 devstack cinder-volume[86916]: DEBUG cinder.utils [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] Path /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1c1f7adb-33ab-4e3e-8f10-7fe6d98f602f not found in is_blk_device check {{(pid=86916) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 11:54:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-405a8345-cdca-442c-839e-20a9d7730958 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1c1f7adb-33ab-4e3e-8f10-7fe6d98f602f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:22 devstack sudo[97873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-405a8345-cdca-442c-839e-20a9d7730958 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1c1f7adb-33ab-4e3e-8f10-7fe6d98f602f Sep 28 11:54:22 devstack sudo[97873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ff98cd72-5169-4cb9-850b-7e0abb33002f tempest-VolumesTestJSON-109379566 None] Acquiring lock "cinder-4470ca5b-cdfc-4c46-a955-a65e32f3b6ee-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:54:22 devstack sudo[97868]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-91769373-88ac-452c-84fa-d5765e0e6d6f tempest-VolumesTestJSON-109379566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.286s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:22 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-91769373-88ac-452c-84fa-d5765e0e6d6f tempest-VolumesTestJSON-109379566 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:54:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ff98cd72-5169-4cb9-850b-7e0abb33002f tempest-VolumesTestJSON-109379566 None] Lock "cinder-4470ca5b-cdfc-4c46-a955-a65e32f3b6ee-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:54:22 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-91769373-88ac-452c-84fa-d5765e0e6d6f tempest-VolumesTestJSON-109379566 None] Deleted volume successfully. Sep 28 11:54:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-91769373-88ac-452c-84fa-d5765e0e6d6f tempest-VolumesTestJSON-109379566 None] Lock "cinder-385beeec-84c1-4925-815c-08d81bea0e38-delete_volume" released by "delete_volume" :: held 1.287s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:54:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ff98cd72-5169-4cb9-850b-7e0abb33002f tempest-VolumesTestJSON-109379566 None] Acquiring lock "cinder-quobyte-4470ca5b-cdfc-4c46-a955-a65e32f3b6ee" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:54:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ff98cd72-5169-4cb9-850b-7e0abb33002f tempest-VolumesTestJSON-109379566 None] Lock "cinder-quobyte-4470ca5b-cdfc-4c46-a955-a65e32f3b6ee" acquired by "delete_volume" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:54:22 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e2b084-c73e-4f9c-935d-bf872a2395e4]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:54:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ff98cd72-5169-4cb9-850b-7e0abb33002f tempest-VolumesTestJSON-109379566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4470ca5b-cdfc-4c46-a955-a65e32f3b6ee {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:22 devstack sudo[97879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4470ca5b-cdfc-4c46-a955-a65e32f3b6ee Sep 28 11:54:22 devstack sudo[97879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:23 devstack sudo[97879]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ff98cd72-5169-4cb9-850b-7e0abb33002f tempest-VolumesTestJSON-109379566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4470ca5b-cdfc-4c46-a955-a65e32f3b6ee" returned: 0 in 0.574s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ff98cd72-5169-4cb9-850b-7e0abb33002f tempest-VolumesTestJSON-109379566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4470ca5b-cdfc-4c46-a955-a65e32f3b6ee {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:23 devstack sudo[97895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4470ca5b-cdfc-4c46-a955-a65e32f3b6ee Sep 28 11:54:23 devstack sudo[97895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:23 devstack sudo[97895]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ff98cd72-5169-4cb9-850b-7e0abb33002f tempest-VolumesTestJSON-109379566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4470ca5b-cdfc-4c46-a955-a65e32f3b6ee" returned: 0 in 0.559s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ff98cd72-5169-4cb9-850b-7e0abb33002f tempest-VolumesTestJSON-109379566 None] Lock "cinder-quobyte-4470ca5b-cdfc-4c46-a955-a65e32f3b6ee" released by "delete_volume" :: held 1.221s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:54:23 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-ff98cd72-5169-4cb9-850b-7e0abb33002f tempest-VolumesTestJSON-109379566 None] Created reservations ['cfa96327-4108-45a8-9a32-83c110ff3bd8', '0a4fa628-6b1d-40c2-b558-02cd6015e81c', 'c88263ca-a525-45dd-816d-f13c9260ce63', '49300826-e76c-48ab-9c1e-7e11a0fc5b5f'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:54:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ff98cd72-5169-4cb9-850b-7e0abb33002f tempest-VolumesTestJSON-109379566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:54:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ff98cd72-5169-4cb9-850b-7e0abb33002f tempest-VolumesTestJSON-109379566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:54:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ff98cd72-5169-4cb9-850b-7e0abb33002f tempest-VolumesTestJSON-109379566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:54:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ff98cd72-5169-4cb9-850b-7e0abb33002f tempest-VolumesTestJSON-109379566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:54:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ff98cd72-5169-4cb9-850b-7e0abb33002f tempest-VolumesTestJSON-109379566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:54:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ff98cd72-5169-4cb9-850b-7e0abb33002f tempest-VolumesTestJSON-109379566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:24 devstack sudo[97920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:54:24 devstack sudo[97920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:24 devstack sudo[97920]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ff98cd72-5169-4cb9-850b-7e0abb33002f tempest-VolumesTestJSON-109379566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.505s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:24 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-ff98cd72-5169-4cb9-850b-7e0abb33002f tempest-VolumesTestJSON-109379566 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:54:24 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-ff98cd72-5169-4cb9-850b-7e0abb33002f tempest-VolumesTestJSON-109379566 None] Deleted volume successfully. Sep 28 11:54:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ff98cd72-5169-4cb9-850b-7e0abb33002f tempest-VolumesTestJSON-109379566 None] Lock "cinder-4470ca5b-cdfc-4c46-a955-a65e32f3b6ee-delete_volume" released by "delete_volume" :: held 2.249s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:54:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3f7fedc6-bc94-4cc7-81b5-e99a9d8ae820 tempest-VolumesTestJSON-109379566 None] Acquiring lock "cinder-c7b19507-413b-4080-9fc7-8fe588eccbdb-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:54:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3f7fedc6-bc94-4cc7-81b5-e99a9d8ae820 tempest-VolumesTestJSON-109379566 None] Lock "cinder-c7b19507-413b-4080-9fc7-8fe588eccbdb-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:54:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3f7fedc6-bc94-4cc7-81b5-e99a9d8ae820 tempest-VolumesTestJSON-109379566 None] Acquiring lock "cinder-quobyte-c7b19507-413b-4080-9fc7-8fe588eccbdb" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:54:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3f7fedc6-bc94-4cc7-81b5-e99a9d8ae820 tempest-VolumesTestJSON-109379566 None] Lock "cinder-quobyte-c7b19507-413b-4080-9fc7-8fe588eccbdb" acquired by "delete_volume" :: waited 0.030s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:54:25 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1669ec2-f479-4ea2-b95a-25e050294cd8]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:54:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3f7fedc6-bc94-4cc7-81b5-e99a9d8ae820 tempest-VolumesTestJSON-109379566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c7b19507-413b-4080-9fc7-8fe588eccbdb {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:25 devstack sudo[97924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c7b19507-413b-4080-9fc7-8fe588eccbdb Sep 28 11:54:25 devstack sudo[97924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:26 devstack sudo[97924]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3f7fedc6-bc94-4cc7-81b5-e99a9d8ae820 tempest-VolumesTestJSON-109379566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c7b19507-413b-4080-9fc7-8fe588eccbdb" returned: 0 in 0.895s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3f7fedc6-bc94-4cc7-81b5-e99a9d8ae820 tempest-VolumesTestJSON-109379566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c7b19507-413b-4080-9fc7-8fe588eccbdb {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:26 devstack sudo[97932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c7b19507-413b-4080-9fc7-8fe588eccbdb Sep 28 11:54:26 devstack sudo[97932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:26 devstack sudo[97932]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3f7fedc6-bc94-4cc7-81b5-e99a9d8ae820 tempest-VolumesTestJSON-109379566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c7b19507-413b-4080-9fc7-8fe588eccbdb" returned: 0 in 0.578s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3f7fedc6-bc94-4cc7-81b5-e99a9d8ae820 tempest-VolumesTestJSON-109379566 None] Lock "cinder-quobyte-c7b19507-413b-4080-9fc7-8fe588eccbdb" released by "delete_volume" :: held 1.597s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:54:26 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-3f7fedc6-bc94-4cc7-81b5-e99a9d8ae820 tempest-VolumesTestJSON-109379566 None] Created reservations ['40ebfb04-7e46-48f2-9e79-31625d5f5513', 'ca49ee85-188d-4ab7-9e0b-74a974d67e7e', 'cc186f6a-a7de-4357-b123-1b83fbd08975', 'fc49c9d9-3b7d-4878-b0f2-696c6668bb4a'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:54:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3f7fedc6-bc94-4cc7-81b5-e99a9d8ae820 tempest-VolumesTestJSON-109379566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:54:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3f7fedc6-bc94-4cc7-81b5-e99a9d8ae820 tempest-VolumesTestJSON-109379566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:54:26 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3f7fedc6-bc94-4cc7-81b5-e99a9d8ae820 tempest-VolumesTestJSON-109379566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:54:26 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3f7fedc6-bc94-4cc7-81b5-e99a9d8ae820 tempest-VolumesTestJSON-109379566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:54:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3f7fedc6-bc94-4cc7-81b5-e99a9d8ae820 tempest-VolumesTestJSON-109379566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:54:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3f7fedc6-bc94-4cc7-81b5-e99a9d8ae820 tempest-VolumesTestJSON-109379566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:26 devstack sudo[97936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:54:26 devstack sudo[97936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:27 devstack sudo[97936]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3f7fedc6-bc94-4cc7-81b5-e99a9d8ae820 tempest-VolumesTestJSON-109379566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.434s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:27 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-3f7fedc6-bc94-4cc7-81b5-e99a9d8ae820 tempest-VolumesTestJSON-109379566 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:54:27 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-3f7fedc6-bc94-4cc7-81b5-e99a9d8ae820 tempest-VolumesTestJSON-109379566 None] Deleted volume successfully. Sep 28 11:54:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3f7fedc6-bc94-4cc7-81b5-e99a9d8ae820 tempest-VolumesTestJSON-109379566 None] Lock "cinder-c7b19507-413b-4080-9fc7-8fe588eccbdb-delete_volume" released by "delete_volume" :: held 2.424s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:54:31 devstack sudo[97873]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-405a8345-cdca-442c-839e-20a9d7730958 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1c1f7adb-33ab-4e3e-8f10-7fe6d98f602f" returned: 0 in 8.913s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:31 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] Image conversion details: src /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-405a8345-cdca-442c-839e-20a9d7730958, size 1024.00 MB, duration 8.91 sec, destination /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1c1f7adb-33ab-4e3e-8f10-7fe6d98f602f {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 11:54:31 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] Converted 1024.00 MB image at 114.87 MB/s Sep 28 11:54:31 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1c1f7adb-33ab-4e3e-8f10-7fe6d98f602f is being set with open permissions: ugo+rw Sep 28 11:54:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1c1f7adb-33ab-4e3e-8f10-7fe6d98f602f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:31 devstack sudo[97943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1c1f7adb-33ab-4e3e-8f10-7fe6d98f602f Sep 28 11:54:31 devstack sudo[97943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:31 devstack sudo[97943]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1c1f7adb-33ab-4e3e-8f10-7fe6d98f602f" returned: 0 in 0.282s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] Lock "cinder-quobyte-1c1f7adb-33ab-4e3e-8f10-7fe6d98f602f" released by "_copy_volume_from_snapshot" :: held 10.072s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:54:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] Acquiring lock "cinder-quobyte-5b10ac04-8150-4df2-861a-256322843e53" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:54:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] Lock "cinder-quobyte-5b10ac04-8150-4df2-861a-256322843e53" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:54:31 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] Deleting offline snapshot 5b10ac04-8150-4df2-861a-256322843e53 of volume 405a8345-cdca-442c-839e-20a9d7730958 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 11:54:31 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] snapshot_file for this snap is: volume-405a8345-cdca-442c-839e-20a9d7730958.5b10ac04-8150-4df2-861a-256322843e53 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 11:54:31 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[5159c1d1-b528-47de-9313-70419bce0b91]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:54:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-405a8345-cdca-442c-839e-20a9d7730958.5b10ac04-8150-4df2-861a-256322843e53 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:31 devstack sudo[97946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-405a8345-cdca-442c-839e-20a9d7730958.5b10ac04-8150-4df2-861a-256322843e53 Sep 28 11:54:31 devstack sudo[97946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:31 devstack sudo[97946]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-405a8345-cdca-442c-839e-20a9d7730958.5b10ac04-8150-4df2-861a-256322843e53" returned: 0 in 0.397s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:31 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-405a8345-cdca-442c-839e-20a9d7730958(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 11:54:31 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09aa9e8-06dc-4ed1-9c3d-7450acd7792f]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:54:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-405a8345-cdca-442c-839e-20a9d7730958 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:32 devstack sudo[97951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-405a8345-cdca-442c-839e-20a9d7730958 Sep 28 11:54:32 devstack sudo[97951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:32 devstack sudo[97951]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-405a8345-cdca-442c-839e-20a9d7730958" returned: 0 in 0.582s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-405a8345-cdca-442c-839e-20a9d7730958.5b10ac04-8150-4df2-861a-256322843e53 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:32 devstack sudo[97956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-405a8345-cdca-442c-839e-20a9d7730958.5b10ac04-8150-4df2-861a-256322843e53 Sep 28 11:54:32 devstack sudo[97956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:32 devstack sudo[97956]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-405a8345-cdca-442c-839e-20a9d7730958.5b10ac04-8150-4df2-861a-256322843e53" returned: 0 in 0.375s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-405a8345-cdca-442c-839e-20a9d7730958.5b10ac04-8150-4df2-861a-256322843e53 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:32 devstack sudo[97962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-405a8345-cdca-442c-839e-20a9d7730958.5b10ac04-8150-4df2-861a-256322843e53 Sep 28 11:54:32 devstack sudo[97962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:33 devstack sudo[97962]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-405a8345-cdca-442c-839e-20a9d7730958.5b10ac04-8150-4df2-861a-256322843e53" returned: 0 in 0.276s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] Lock "cinder-quobyte-5b10ac04-8150-4df2-861a-256322843e53" released by "_delete_snapshot" :: held 1.772s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:54:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.104s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:54:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0102fdec-c394-489a-91c0-99352ff3b323) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c1f7adb-33ab-4e3e-8f10-7fe6d98f602f', 'volume_size': 1, 'source_volid': '405a8345-cdca-442c-839e-20a9d7730958', 'source_volstatus': 'available'}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fab9edf-620b-4a5c-810e-e78a6e83cb90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:33 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] Volume volume-1c1f7adb-33ab-4e3e-8f10-7fe6d98f602f (1c1f7adb-33ab-4e3e-8f10-7fe6d98f602f): created successfully Sep 28 11:54:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fab9edf-620b-4a5c-810e-e78a6e83cb90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] Flow 'volume_create_manager' (d92fa089-011d-4700-8836-8d11894c1cc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:54:33 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-55a9526b-3c0b-4888-addb-0b455679da9c tempest-VolumesGetTest-1204081055 None] Created volume successfully. Sep 28 11:54:33 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-24744dde-2102-409a-a15d-f15a1d5e20ca tempest-GroupSnapshotsTest-23458081 None] Group tempest-GroupSnapshotsTest-Group-1888613945: creating Sep 28 11:54:33 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-24744dde-2102-409a-a15d-f15a1d5e20ca tempest-GroupSnapshotsTest-23458081 None] Group tempest-GroupSnapshotsTest-Group-1888613945: created successfully Sep 28 11:54:33 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-24744dde-2102-409a-a15d-f15a1d5e20ca tempest-GroupSnapshotsTest-23458081 None] Create group completed successfully. Sep 28 11:54:34 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=139,cinder:UPDATE=160,cinder:DELETE=9,cinder:INSERT=48 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 11:54:35 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bb24585-3577-48a0-85c1-1c6d2c8d465d tempest-VolumesGetTest-1204081055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:54:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8bb24585-3577-48a0-85c1-1c6d2c8d465d tempest-VolumesGetTest-1204081055 None] Flow 'volume_create_manager' (d526955f-bffc-4ab4-bdbc-2e71b4aba508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:54:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8bb24585-3577-48a0-85c1-1c6d2c8d465d tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c1ce67f-d223-427f-8e8c-affbd5b83fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8bb24585-3577-48a0-85c1-1c6d2c8d465d tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c1ce67f-d223-427f-8e8c-affbd5b83fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:54:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1812236984',display_name='tempest-VolumesGetTest-Volume-376502114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=971dc915-0f03-4e78-9e0a-599c0a58ab43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8790c17115e54fa0ba110c487f5a135e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:54:35Z,use_quota=True,user_id='1bf577ca5c394deebd5591e73249b349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8bb24585-3577-48a0-85c1-1c6d2c8d465d tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b196a2b2-ddd5-4862-ba13-8c4e72fb774d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8bb24585-3577-48a0-85c1-1c6d2c8d465d tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b196a2b2-ddd5-4862-ba13-8c4e72fb774d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8bb24585-3577-48a0-85c1-1c6d2c8d465d tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9d9b389-4ec0-4180-84c3-564451f15e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8bb24585-3577-48a0-85c1-1c6d2c8d465d tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9d9b389-4ec0-4180-84c3-564451f15e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '971dc915-0f03-4e78-9e0a-599c0a58ab43', 'volume_name': 'volume-971dc915-0f03-4e78-9e0a-599c0a58ab43', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8bb24585-3577-48a0-85c1-1c6d2c8d465d tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4289cb38-08d6-4f78-92f8-0803be5c3285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8bb24585-3577-48a0-85c1-1c6d2c8d465d tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4289cb38-08d6-4f78-92f8-0803be5c3285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8bb24585-3577-48a0-85c1-1c6d2c8d465d tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e39a654-8a8e-4998-82ce-5a6a5cd9e2c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:35 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-8bb24585-3577-48a0-85c1-1c6d2c8d465d tempest-VolumesGetTest-1204081055 None] Volume 971dc915-0f03-4e78-9e0a-599c0a58ab43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-971dc915-0f03-4e78-9e0a-599c0a58ab43', 'volume_size': 1} Sep 28 11:54:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8bb24585-3577-48a0-85c1-1c6d2c8d465d tempest-VolumesGetTest-1204081055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:54:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8bb24585-3577-48a0-85c1-1c6d2c8d465d tempest-VolumesGetTest-1204081055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:54:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8bb24585-3577-48a0-85c1-1c6d2c8d465d tempest-VolumesGetTest-1204081055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:54:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1812236984',display_name='tempest-VolumesGetTest-Volume-376502114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=971dc915-0f03-4e78-9e0a-599c0a58ab43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8790c17115e54fa0ba110c487f5a135e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:54:35Z,use_quota=True,user_id='1bf577ca5c394deebd5591e73249b349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:54:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-8bb24585-3577-48a0-85c1-1c6d2c8d465d tempest-VolumesGetTest-1204081055 None] Creating volume 971dc915-0f03-4e78-9e0a-599c0a58ab43 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:54:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8bb24585-3577-48a0-85c1-1c6d2c8d465d tempest-VolumesGetTest-1204081055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:54:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8bb24585-3577-48a0-85c1-1c6d2c8d465d tempest-VolumesGetTest-1204081055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:54:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8bb24585-3577-48a0-85c1-1c6d2c8d465d tempest-VolumesGetTest-1204081055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:54:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8bb24585-3577-48a0-85c1-1c6d2c8d465d tempest-VolumesGetTest-1204081055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:54:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8bb24585-3577-48a0-85c1-1c6d2c8d465d tempest-VolumesGetTest-1204081055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:54:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8bb24585-3577-48a0-85c1-1c6d2c8d465d tempest-VolumesGetTest-1204081055 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:54:35 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-8bb24585-3577-48a0-85c1-1c6d2c8d465d tempest-VolumesGetTest-1204081055 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:54:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8bb24585-3577-48a0-85c1-1c6d2c8d465d tempest-VolumesGetTest-1204081055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971dc915-0f03-4e78-9e0a-599c0a58ab43 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:35 devstack sudo[97968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971dc915-0f03-4e78-9e0a-599c0a58ab43 1073741824 Sep 28 11:54:35 devstack sudo[97968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:35 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1b70174-c48f-4be8-b1eb-00b3f7935943 tempest-GroupSnapshotsTest-23458081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:54:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f1b70174-c48f-4be8-b1eb-00b3f7935943 tempest-GroupSnapshotsTest-23458081 None] Flow 'volume_create_manager' (f2d7fc17-6137-4fed-abb4-82b684f1850b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:54:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f1b70174-c48f-4be8-b1eb-00b3f7935943 tempest-GroupSnapshotsTest-23458081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cf3d920-a8ae-4e1b-9357-3329de6b8840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:35 devstack sudo[97968]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8bb24585-3577-48a0-85c1-1c6d2c8d465d tempest-VolumesGetTest-1204081055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971dc915-0f03-4e78-9e0a-599c0a58ab43 1073741824" returned: 0 in 0.632s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f1b70174-c48f-4be8-b1eb-00b3f7935943 tempest-GroupSnapshotsTest-23458081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cf3d920-a8ae-4e1b-9357-3329de6b8840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-387232365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=536349df-397d-4d91-ad2a-b60a8efc494e,host='devstack@QuobyteHD#QuobyteHD',id=971aa7f3-dba6-4bba-bc4a-128455014b01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a07ca7e03959469d880233b762aff5e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:54:36Z,use_quota=True,user_id='64f68e6fac7a438bb9698da7ee17003e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe659422-9fd0-4af6-b501-5ac83f2aeb4d),volume_type_id=fe659422-9fd0-4af6-b501-5ac83f2aeb4d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f1b70174-c48f-4be8-b1eb-00b3f7935943 tempest-GroupSnapshotsTest-23458081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be4fcd13-0ca5-459c-ae72-4d3a724d79f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f1b70174-c48f-4be8-b1eb-00b3f7935943 tempest-GroupSnapshotsTest-23458081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be4fcd13-0ca5-459c-ae72-4d3a724d79f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f1b70174-c48f-4be8-b1eb-00b3f7935943 tempest-GroupSnapshotsTest-23458081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30129016-bfaf-4f15-8a57-e5021b0cf683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f1b70174-c48f-4be8-b1eb-00b3f7935943 tempest-GroupSnapshotsTest-23458081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30129016-bfaf-4f15-8a57-e5021b0cf683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '971aa7f3-dba6-4bba-bc4a-128455014b01', 'volume_name': 'volume-971aa7f3-dba6-4bba-bc4a-128455014b01', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f1b70174-c48f-4be8-b1eb-00b3f7935943 tempest-GroupSnapshotsTest-23458081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e369e437-5a0b-4842-989a-362cbfb14670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f1b70174-c48f-4be8-b1eb-00b3f7935943 tempest-GroupSnapshotsTest-23458081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e369e437-5a0b-4842-989a-362cbfb14670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f1b70174-c48f-4be8-b1eb-00b3f7935943 tempest-GroupSnapshotsTest-23458081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bf6c44b-641e-445c-84a4-385e08e25fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:35 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-f1b70174-c48f-4be8-b1eb-00b3f7935943 tempest-GroupSnapshotsTest-23458081 None] Volume 971aa7f3-dba6-4bba-bc4a-128455014b01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-971aa7f3-dba6-4bba-bc4a-128455014b01', 'volume_size': 1} Sep 28 11:54:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f1b70174-c48f-4be8-b1eb-00b3f7935943 tempest-GroupSnapshotsTest-23458081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:54:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8bb24585-3577-48a0-85c1-1c6d2c8d465d tempest-VolumesGetTest-1204081055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971dc915-0f03-4e78-9e0a-599c0a58ab43 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:35 devstack sudo[97978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971dc915-0f03-4e78-9e0a-599c0a58ab43 Sep 28 11:54:35 devstack sudo[97978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:36 devstack sudo[97978]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8bb24585-3577-48a0-85c1-1c6d2c8d465d tempest-VolumesGetTest-1204081055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971dc915-0f03-4e78-9e0a-599c0a58ab43" returned: 0 in 0.298s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8bb24585-3577-48a0-85c1-1c6d2c8d465d tempest-VolumesGetTest-1204081055 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:54:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8bb24585-3577-48a0-85c1-1c6d2c8d465d tempest-VolumesGetTest-1204081055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:54:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f1b70174-c48f-4be8-b1eb-00b3f7935943 tempest-GroupSnapshotsTest-23458081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.340s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:54:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f1b70174-c48f-4be8-b1eb-00b3f7935943 tempest-GroupSnapshotsTest-23458081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=536349df-397d-4d91-ad2a-b60a8efc494e,created_at=2026-09-28T09:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-387232365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=536349df-397d-4d91-ad2a-b60a8efc494e,host='devstack@QuobyteHD#QuobyteHD',id=971aa7f3-dba6-4bba-bc4a-128455014b01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a07ca7e03959469d880233b762aff5e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:54:36Z,use_quota=True,user_id='64f68e6fac7a438bb9698da7ee17003e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe659422-9fd0-4af6-b501-5ac83f2aeb4d),volume_type_id=fe659422-9fd0-4af6-b501-5ac83f2aeb4d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:54:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-f1b70174-c48f-4be8-b1eb-00b3f7935943 tempest-GroupSnapshotsTest-23458081 None] Creating volume 971aa7f3-dba6-4bba-bc4a-128455014b01 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:54:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f1b70174-c48f-4be8-b1eb-00b3f7935943 tempest-GroupSnapshotsTest-23458081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:54:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f1b70174-c48f-4be8-b1eb-00b3f7935943 tempest-GroupSnapshotsTest-23458081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:54:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f1b70174-c48f-4be8-b1eb-00b3f7935943 tempest-GroupSnapshotsTest-23458081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:54:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f1b70174-c48f-4be8-b1eb-00b3f7935943 tempest-GroupSnapshotsTest-23458081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:54:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f1b70174-c48f-4be8-b1eb-00b3f7935943 tempest-GroupSnapshotsTest-23458081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:54:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f1b70174-c48f-4be8-b1eb-00b3f7935943 tempest-GroupSnapshotsTest-23458081 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:54:36 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-f1b70174-c48f-4be8-b1eb-00b3f7935943 tempest-GroupSnapshotsTest-23458081 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:54:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f1b70174-c48f-4be8-b1eb-00b3f7935943 tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971aa7f3-dba6-4bba-bc4a-128455014b01 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:36 devstack sudo[97989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971aa7f3-dba6-4bba-bc4a-128455014b01 1073741824 Sep 28 11:54:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8bb24585-3577-48a0-85c1-1c6d2c8d465d tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e39a654-8a8e-4998-82ce-5a6a5cd9e2c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-971dc915-0f03-4e78-9e0a-599c0a58ab43', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:36 devstack sudo[97989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8bb24585-3577-48a0-85c1-1c6d2c8d465d tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1087536-c74b-4679-bd94-294a5338509b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:36 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-8bb24585-3577-48a0-85c1-1c6d2c8d465d tempest-VolumesGetTest-1204081055 None] Volume volume-971dc915-0f03-4e78-9e0a-599c0a58ab43 (971dc915-0f03-4e78-9e0a-599c0a58ab43): created successfully Sep 28 11:54:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8bb24585-3577-48a0-85c1-1c6d2c8d465d tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1087536-c74b-4679-bd94-294a5338509b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8bb24585-3577-48a0-85c1-1c6d2c8d465d tempest-VolumesGetTest-1204081055 None] Flow 'volume_create_manager' (d526955f-bffc-4ab4-bdbc-2e71b4aba508) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:54:36 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-8bb24585-3577-48a0-85c1-1c6d2c8d465d tempest-VolumesGetTest-1204081055 None] Created volume successfully. Sep 28 11:54:36 devstack sudo[97989]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f1b70174-c48f-4be8-b1eb-00b3f7935943 tempest-GroupSnapshotsTest-23458081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971aa7f3-dba6-4bba-bc4a-128455014b01 1073741824" returned: 0 in 0.642s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f1b70174-c48f-4be8-b1eb-00b3f7935943 tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971aa7f3-dba6-4bba-bc4a-128455014b01 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:36 devstack sudo[98001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971aa7f3-dba6-4bba-bc4a-128455014b01 Sep 28 11:54:36 devstack sudo[98001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:37 devstack sudo[98001]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f1b70174-c48f-4be8-b1eb-00b3f7935943 tempest-GroupSnapshotsTest-23458081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971aa7f3-dba6-4bba-bc4a-128455014b01" returned: 0 in 0.307s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f1b70174-c48f-4be8-b1eb-00b3f7935943 tempest-GroupSnapshotsTest-23458081 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:54:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f1b70174-c48f-4be8-b1eb-00b3f7935943 tempest-GroupSnapshotsTest-23458081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:54:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f1b70174-c48f-4be8-b1eb-00b3f7935943 tempest-GroupSnapshotsTest-23458081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bf6c44b-641e-445c-84a4-385e08e25fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-971aa7f3-dba6-4bba-bc4a-128455014b01', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f1b70174-c48f-4be8-b1eb-00b3f7935943 tempest-GroupSnapshotsTest-23458081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93ca5725-257e-4e64-bd08-c4372a80e806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:37 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-f1b70174-c48f-4be8-b1eb-00b3f7935943 tempest-GroupSnapshotsTest-23458081 None] Volume volume-971aa7f3-dba6-4bba-bc4a-128455014b01 (971aa7f3-dba6-4bba-bc4a-128455014b01): created successfully Sep 28 11:54:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f1b70174-c48f-4be8-b1eb-00b3f7935943 tempest-GroupSnapshotsTest-23458081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93ca5725-257e-4e64-bd08-c4372a80e806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f1b70174-c48f-4be8-b1eb-00b3f7935943 tempest-GroupSnapshotsTest-23458081 None] Flow 'volume_create_manager' (f2d7fc17-6137-4fed-abb4-82b684f1850b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:54:37 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-f1b70174-c48f-4be8-b1eb-00b3f7935943 tempest-GroupSnapshotsTest-23458081 None] Created volume successfully. Sep 28 11:54:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-302b812c-b4b9-4f14-95f7-296a532e1929 tempest-VolumesGetTest-1204081055 None] Acquiring lock "cinder-971dc915-0f03-4e78-9e0a-599c0a58ab43-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:54:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-302b812c-b4b9-4f14-95f7-296a532e1929 tempest-VolumesGetTest-1204081055 None] Lock "cinder-971dc915-0f03-4e78-9e0a-599c0a58ab43-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:54:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-302b812c-b4b9-4f14-95f7-296a532e1929 tempest-VolumesGetTest-1204081055 None] Acquiring lock "cinder-quobyte-971dc915-0f03-4e78-9e0a-599c0a58ab43" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:54:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-302b812c-b4b9-4f14-95f7-296a532e1929 tempest-VolumesGetTest-1204081055 None] Lock "cinder-quobyte-971dc915-0f03-4e78-9e0a-599c0a58ab43" acquired by "delete_volume" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:54:37 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[d413ca2c-2e71-4496-bad2-5ea69fb2d810]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:54:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-302b812c-b4b9-4f14-95f7-296a532e1929 tempest-VolumesGetTest-1204081055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971dc915-0f03-4e78-9e0a-599c0a58ab43 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:37 devstack sudo[98004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971dc915-0f03-4e78-9e0a-599c0a58ab43 Sep 28 11:54:37 devstack sudo[98004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:37 devstack sudo[98004]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-302b812c-b4b9-4f14-95f7-296a532e1929 tempest-VolumesGetTest-1204081055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971dc915-0f03-4e78-9e0a-599c0a58ab43" returned: 0 in 0.399s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-302b812c-b4b9-4f14-95f7-296a532e1929 tempest-VolumesGetTest-1204081055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971dc915-0f03-4e78-9e0a-599c0a58ab43 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:37 devstack sudo[98011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971dc915-0f03-4e78-9e0a-599c0a58ab43 Sep 28 11:54:37 devstack sudo[98011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-302b812c-b4b9-4f14-95f7-296a532e1929 tempest-VolumesGetTest-1204081055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971dc915-0f03-4e78-9e0a-599c0a58ab43" returned: 0 in 0.285s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:38 devstack sudo[98011]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-302b812c-b4b9-4f14-95f7-296a532e1929 tempest-VolumesGetTest-1204081055 None] Lock "cinder-quobyte-971dc915-0f03-4e78-9e0a-599c0a58ab43" released by "delete_volume" :: held 0.749s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:54:38 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-302b812c-b4b9-4f14-95f7-296a532e1929 tempest-VolumesGetTest-1204081055 None] Created reservations ['d87ac24b-9161-4201-bae3-d4cdf927a734', '7b0e946c-e629-4cac-a5e4-c38b5d8b7b00', 'eee3cb02-5a7f-4527-a41c-a92e34071bea', '8fdcdcc6-9f05-46fe-9422-a7ebe5c7e731'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:54:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-302b812c-b4b9-4f14-95f7-296a532e1929 tempest-VolumesGetTest-1204081055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:54:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-302b812c-b4b9-4f14-95f7-296a532e1929 tempest-VolumesGetTest-1204081055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:54:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-302b812c-b4b9-4f14-95f7-296a532e1929 tempest-VolumesGetTest-1204081055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:54:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-302b812c-b4b9-4f14-95f7-296a532e1929 tempest-VolumesGetTest-1204081055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:54:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-302b812c-b4b9-4f14-95f7-296a532e1929 tempest-VolumesGetTest-1204081055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:54:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-302b812c-b4b9-4f14-95f7-296a532e1929 tempest-VolumesGetTest-1204081055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:38 devstack sudo[98030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:54:38 devstack sudo[98030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:38 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 11:54:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:54:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:54:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:54:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:54:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:54:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:38 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-d45566a3-81ca-4ae6-9947-203fef1e1e39 tempest-GroupSnapshotsTest-23458081 None] GroupSnapshot 09e5b4cc-f0dd-4479-950b-1deec14ddac7: creating. Sep 28 11:54:38 devstack sudo[98051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:54:38 devstack sudo[98051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-82a45363-6273-43cf-93ca-46a8a6f23cc0 tempest-VolumesGetTest-1204081055 None] Acquiring lock "cinder-1c1f7adb-33ab-4e3e-8f10-7fe6d98f602f-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:54:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d45566a3-81ca-4ae6-9947-203fef1e1e39 tempest-GroupSnapshotsTest-23458081 None] Group snapshot 09e5b4cc-f0dd-4479-950b-1deec14ddac7: creating. {{(pid=86916) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 11:54:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-82a45363-6273-43cf-93ca-46a8a6f23cc0 tempest-VolumesGetTest-1204081055 None] Lock "cinder-1c1f7adb-33ab-4e3e-8f10-7fe6d98f602f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:54:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d45566a3-81ca-4ae6-9947-203fef1e1e39 tempest-GroupSnapshotsTest-23458081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:54:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d45566a3-81ca-4ae6-9947-203fef1e1e39 tempest-GroupSnapshotsTest-23458081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:54:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-d45566a3-81ca-4ae6-9947-203fef1e1e39 tempest-GroupSnapshotsTest-23458081 None] Creating offline snapshot b683b343-d8d3-4ec6-91e4-c494e83da63b of volume 971aa7f3-dba6-4bba-bc4a-128455014b01 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 11:54:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-82a45363-6273-43cf-93ca-46a8a6f23cc0 tempest-VolumesGetTest-1204081055 None] Acquiring lock "cinder-quobyte-1c1f7adb-33ab-4e3e-8f10-7fe6d98f602f" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:54:38 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01f62b9-311c-4680-82d6-a525d58bd054]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:54:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d45566a3-81ca-4ae6-9947-203fef1e1e39 tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971aa7f3-dba6-4bba-bc4a-128455014b01 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:38 devstack sudo[98030]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-302b812c-b4b9-4f14-95f7-296a532e1929 tempest-VolumesGetTest-1204081055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.603s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:38 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-302b812c-b4b9-4f14-95f7-296a532e1929 tempest-VolumesGetTest-1204081055 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:54:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-82a45363-6273-43cf-93ca-46a8a6f23cc0 tempest-VolumesGetTest-1204081055 None] Lock "cinder-quobyte-1c1f7adb-33ab-4e3e-8f10-7fe6d98f602f" acquired by "delete_volume" :: waited 0.091s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:54:39 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-302b812c-b4b9-4f14-95f7-296a532e1929 tempest-VolumesGetTest-1204081055 None] Deleted volume successfully. Sep 28 11:54:39 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2aa879-ccb3-4501-856d-6c6a57bcda95]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:54:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-82a45363-6273-43cf-93ca-46a8a6f23cc0 tempest-VolumesGetTest-1204081055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1c1f7adb-33ab-4e3e-8f10-7fe6d98f602f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-302b812c-b4b9-4f14-95f7-296a532e1929 tempest-VolumesGetTest-1204081055 None] Lock "cinder-971dc915-0f03-4e78-9e0a-599c0a58ab43-delete_volume" released by "delete_volume" :: held 1.846s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:54:39 devstack sudo[98063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971aa7f3-dba6-4bba-bc4a-128455014b01 Sep 28 11:54:39 devstack sudo[98063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:39 devstack sudo[98051]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.567s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:39 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:54:39 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 11:54:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] thread count: 28 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 11:54:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] thread info: [<_MainThread(MainThread, started 135408582168704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 11:54:39 devstack sudo[98069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1c1f7adb-33ab-4e3e-8f10-7fe6d98f602f Sep 28 11:54:39 devstack sudo[98069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:39 devstack sudo[98063]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d45566a3-81ca-4ae6-9947-203fef1e1e39 tempest-GroupSnapshotsTest-23458081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971aa7f3-dba6-4bba-bc4a-128455014b01" returned: 0 in 0.665s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d45566a3-81ca-4ae6-9947-203fef1e1e39 tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971aa7f3-dba6-4bba-bc4a-128455014b01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971aa7f3-dba6-4bba-bc4a-128455014b01.b683b343-d8d3-4ec6-91e4-c494e83da63b 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:39 devstack sudo[98090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971aa7f3-dba6-4bba-bc4a-128455014b01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971aa7f3-dba6-4bba-bc4a-128455014b01.b683b343-d8d3-4ec6-91e4-c494e83da63b 1G Sep 28 11:54:39 devstack sudo[98090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:39 devstack sudo[98069]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-82a45363-6273-43cf-93ca-46a8a6f23cc0 tempest-VolumesGetTest-1204081055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1c1f7adb-33ab-4e3e-8f10-7fe6d98f602f" returned: 0 in 0.625s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-82a45363-6273-43cf-93ca-46a8a6f23cc0 tempest-VolumesGetTest-1204081055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1c1f7adb-33ab-4e3e-8f10-7fe6d98f602f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:39 devstack sudo[98100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1c1f7adb-33ab-4e3e-8f10-7fe6d98f602f Sep 28 11:54:39 devstack sudo[98100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:40 devstack sudo[98100]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-82a45363-6273-43cf-93ca-46a8a6f23cc0 tempest-VolumesGetTest-1204081055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1c1f7adb-33ab-4e3e-8f10-7fe6d98f602f" returned: 0 in 0.324s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-82a45363-6273-43cf-93ca-46a8a6f23cc0 tempest-VolumesGetTest-1204081055 None] Lock "cinder-quobyte-1c1f7adb-33ab-4e3e-8f10-7fe6d98f602f" released by "delete_volume" :: held 1.049s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:54:40 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-82a45363-6273-43cf-93ca-46a8a6f23cc0 tempest-VolumesGetTest-1204081055 None] Created reservations ['802444ba-b48c-4ad7-913a-3759bcae8560', '7f37a092-b82a-4354-a5fb-77d871165be2', '7b17e5c4-3824-430c-b965-6ddc13e37806', '61217d99-fbf1-4db8-af36-fd2caea6b582'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:54:40 devstack sudo[98090]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d45566a3-81ca-4ae6-9947-203fef1e1e39 tempest-GroupSnapshotsTest-23458081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971aa7f3-dba6-4bba-bc4a-128455014b01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971aa7f3-dba6-4bba-bc4a-128455014b01.b683b343-d8d3-4ec6-91e4-c494e83da63b 1G" returned: 0 in 0.522s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d45566a3-81ca-4ae6-9947-203fef1e1e39 tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-971aa7f3-dba6-4bba-bc4a-128455014b01 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971aa7f3-dba6-4bba-bc4a-128455014b01.b683b343-d8d3-4ec6-91e4-c494e83da63b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:40 devstack sudo[98122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-971aa7f3-dba6-4bba-bc4a-128455014b01 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971aa7f3-dba6-4bba-bc4a-128455014b01.b683b343-d8d3-4ec6-91e4-c494e83da63b Sep 28 11:54:40 devstack sudo[98122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-82a45363-6273-43cf-93ca-46a8a6f23cc0 tempest-VolumesGetTest-1204081055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:54:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-82a45363-6273-43cf-93ca-46a8a6f23cc0 tempest-VolumesGetTest-1204081055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:54:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-82a45363-6273-43cf-93ca-46a8a6f23cc0 tempest-VolumesGetTest-1204081055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:54:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-82a45363-6273-43cf-93ca-46a8a6f23cc0 tempest-VolumesGetTest-1204081055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:54:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-82a45363-6273-43cf-93ca-46a8a6f23cc0 tempest-VolumesGetTest-1204081055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:54:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-82a45363-6273-43cf-93ca-46a8a6f23cc0 tempest-VolumesGetTest-1204081055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:40 devstack sudo[98124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:54:40 devstack sudo[98124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:40 devstack sudo[98122]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d45566a3-81ca-4ae6-9947-203fef1e1e39 tempest-GroupSnapshotsTest-23458081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-971aa7f3-dba6-4bba-bc4a-128455014b01 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971aa7f3-dba6-4bba-bc4a-128455014b01.b683b343-d8d3-4ec6-91e4-c494e83da63b" returned: 0 in 0.322s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:40 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-d45566a3-81ca-4ae6-9947-203fef1e1e39 tempest-GroupSnapshotsTest-23458081 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971aa7f3-dba6-4bba-bc4a-128455014b01.b683b343-d8d3-4ec6-91e4-c494e83da63b is being set with open permissions: ugo+rw: NotImplementedError Sep 28 11:54:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d45566a3-81ca-4ae6-9947-203fef1e1e39 tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971aa7f3-dba6-4bba-bc4a-128455014b01.b683b343-d8d3-4ec6-91e4-c494e83da63b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:40 devstack sudo[98124]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-82a45363-6273-43cf-93ca-46a8a6f23cc0 tempest-VolumesGetTest-1204081055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.265s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:40 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-82a45363-6273-43cf-93ca-46a8a6f23cc0 tempest-VolumesGetTest-1204081055 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:54:40 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-82a45363-6273-43cf-93ca-46a8a6f23cc0 tempest-VolumesGetTest-1204081055 None] Deleted volume successfully. Sep 28 11:54:40 devstack sudo[98131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971aa7f3-dba6-4bba-bc4a-128455014b01.b683b343-d8d3-4ec6-91e4-c494e83da63b Sep 28 11:54:40 devstack sudo[98131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-82a45363-6273-43cf-93ca-46a8a6f23cc0 tempest-VolumesGetTest-1204081055 None] Lock "cinder-1c1f7adb-33ab-4e3e-8f10-7fe6d98f602f-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:54:40 devstack sudo[98131]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d45566a3-81ca-4ae6-9947-203fef1e1e39 tempest-GroupSnapshotsTest-23458081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971aa7f3-dba6-4bba-bc4a-128455014b01.b683b343-d8d3-4ec6-91e4-c494e83da63b" returned: 0 in 0.264s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d45566a3-81ca-4ae6-9947-203fef1e1e39 tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971aa7f3-dba6-4bba-bc4a-128455014b01.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:40 devstack sudo[98134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971aa7f3-dba6-4bba-bc4a-128455014b01.info Sep 28 11:54:40 devstack sudo[98134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:41 devstack sudo[98134]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d45566a3-81ca-4ae6-9947-203fef1e1e39 tempest-GroupSnapshotsTest-23458081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971aa7f3-dba6-4bba-bc4a-128455014b01.info" returned: 0 in 0.322s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:41 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-d45566a3-81ca-4ae6-9947-203fef1e1e39 tempest-GroupSnapshotsTest-23458081 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971aa7f3-dba6-4bba-bc4a-128455014b01.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 11:54:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d45566a3-81ca-4ae6-9947-203fef1e1e39 tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971aa7f3-dba6-4bba-bc4a-128455014b01.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:41 devstack sudo[98139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971aa7f3-dba6-4bba-bc4a-128455014b01.info Sep 28 11:54:41 devstack sudo[98139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3a4a98c8-b026-4ad3-9998-41ff81e42972 tempest-VolumesGetTest-1204081055 None] Acquiring lock "cinder-405a8345-cdca-442c-839e-20a9d7730958-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:54:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3a4a98c8-b026-4ad3-9998-41ff81e42972 tempest-VolumesGetTest-1204081055 None] Lock "cinder-405a8345-cdca-442c-839e-20a9d7730958-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:54:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3a4a98c8-b026-4ad3-9998-41ff81e42972 tempest-VolumesGetTest-1204081055 None] Acquiring lock "cinder-quobyte-405a8345-cdca-442c-839e-20a9d7730958" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:54:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3a4a98c8-b026-4ad3-9998-41ff81e42972 tempest-VolumesGetTest-1204081055 None] Lock "cinder-quobyte-405a8345-cdca-442c-839e-20a9d7730958" acquired by "delete_volume" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:54:41 devstack sudo[98139]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d45566a3-81ca-4ae6-9947-203fef1e1e39 tempest-GroupSnapshotsTest-23458081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971aa7f3-dba6-4bba-bc4a-128455014b01.info" returned: 0 in 0.369s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d45566a3-81ca-4ae6-9947-203fef1e1e39 tempest-GroupSnapshotsTest-23458081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.628s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:54:41 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ecbde1-53d7-41d4-af34-651a05dcf023]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:54:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3a4a98c8-b026-4ad3-9998-41ff81e42972 tempest-VolumesGetTest-1204081055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-405a8345-cdca-442c-839e-20a9d7730958 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:41 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-d45566a3-81ca-4ae6-9947-203fef1e1e39 tempest-GroupSnapshotsTest-23458081 None] group_snapshot 09e5b4cc-f0dd-4479-950b-1deec14ddac7: created successfully Sep 28 11:54:41 devstack sudo[98142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-405a8345-cdca-442c-839e-20a9d7730958 Sep 28 11:54:41 devstack sudo[98142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:41 devstack sudo[98142]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3a4a98c8-b026-4ad3-9998-41ff81e42972 tempest-VolumesGetTest-1204081055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-405a8345-cdca-442c-839e-20a9d7730958" returned: 0 in 0.384s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3a4a98c8-b026-4ad3-9998-41ff81e42972 tempest-VolumesGetTest-1204081055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-405a8345-cdca-442c-839e-20a9d7730958 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:41 devstack sudo[98147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-405a8345-cdca-442c-839e-20a9d7730958 Sep 28 11:54:41 devstack sudo[98147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:42 devstack sudo[98147]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3a4a98c8-b026-4ad3-9998-41ff81e42972 tempest-VolumesGetTest-1204081055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-405a8345-cdca-442c-839e-20a9d7730958" returned: 0 in 0.395s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:42 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3a4a98c8-b026-4ad3-9998-41ff81e42972 tempest-VolumesGetTest-1204081055 None] Lock "cinder-quobyte-405a8345-cdca-442c-839e-20a9d7730958" released by "delete_volume" :: held 0.868s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:54:42 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-3a4a98c8-b026-4ad3-9998-41ff81e42972 tempest-VolumesGetTest-1204081055 None] Created reservations ['acbf3e33-6b9e-4089-9e31-86dd9e885dbd', '660ac3f4-d2d9-49d3-b6dd-2dfd71b4edb2', '2d9624a7-bf22-4d2d-8bda-6d4f94664e90', 'ed6ecc24-0362-4a77-bf06-d0eb89083dc7'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:54:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3a4a98c8-b026-4ad3-9998-41ff81e42972 tempest-VolumesGetTest-1204081055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:54:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3a4a98c8-b026-4ad3-9998-41ff81e42972 tempest-VolumesGetTest-1204081055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:54:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3a4a98c8-b026-4ad3-9998-41ff81e42972 tempest-VolumesGetTest-1204081055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:54:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3a4a98c8-b026-4ad3-9998-41ff81e42972 tempest-VolumesGetTest-1204081055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:54:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3a4a98c8-b026-4ad3-9998-41ff81e42972 tempest-VolumesGetTest-1204081055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:54:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3a4a98c8-b026-4ad3-9998-41ff81e42972 tempest-VolumesGetTest-1204081055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:42 devstack sudo[98150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:54:42 devstack sudo[98150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:42 devstack sudo[98150]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3a4a98c8-b026-4ad3-9998-41ff81e42972 tempest-VolumesGetTest-1204081055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.342s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:42 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-3a4a98c8-b026-4ad3-9998-41ff81e42972 tempest-VolumesGetTest-1204081055 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:54:42 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-3a4a98c8-b026-4ad3-9998-41ff81e42972 tempest-VolumesGetTest-1204081055 None] Deleted volume successfully. Sep 28 11:54:42 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3a4a98c8-b026-4ad3-9998-41ff81e42972 tempest-VolumesGetTest-1204081055 None] Lock "cinder-405a8345-cdca-442c-839e-20a9d7730958-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:54:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fda7c9e0-5691-4c32-bc7a-c21828df594f tempest-GroupSnapshotsTest-23458081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:54:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fda7c9e0-5691-4c32-bc7a-c21828df594f tempest-GroupSnapshotsTest-23458081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:54:43 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fda7c9e0-5691-4c32-bc7a-c21828df594f tempest-GroupSnapshotsTest-23458081 None] Acquiring lock "cinder-quobyte-b683b343-d8d3-4ec6-91e4-c494e83da63b-4fea46be-e7ac-4136-9bd9-e7d2e408b2bf" by "_create_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:54:43 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fda7c9e0-5691-4c32-bc7a-c21828df594f tempest-GroupSnapshotsTest-23458081 None] Lock "cinder-quobyte-b683b343-d8d3-4ec6-91e4-c494e83da63b-4fea46be-e7ac-4136-9bd9-e7d2e408b2bf" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:54:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-fda7c9e0-5691-4c32-bc7a-c21828df594f tempest-GroupSnapshotsTest-23458081 None] Creating volume 4fea46be-e7ac-4136-9bd9-e7d2e408b2bf from snapshot b683b343-d8d3-4ec6-91e4-c494e83da63b {{(pid=86916) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 11:54:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fda7c9e0-5691-4c32-bc7a-c21828df594f tempest-GroupSnapshotsTest-23458081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:54:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fda7c9e0-5691-4c32-bc7a-c21828df594f tempest-GroupSnapshotsTest-23458081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:54:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-fda7c9e0-5691-4c32-bc7a-c21828df594f tempest-GroupSnapshotsTest-23458081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:54:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-fda7c9e0-5691-4c32-bc7a-c21828df594f tempest-GroupSnapshotsTest-23458081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:54:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fda7c9e0-5691-4c32-bc7a-c21828df594f tempest-GroupSnapshotsTest-23458081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:54:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-fda7c9e0-5691-4c32-bc7a-c21828df594f tempest-GroupSnapshotsTest-23458081 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:54:43 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fda7c9e0-5691-4c32-bc7a-c21828df594f tempest-GroupSnapshotsTest-23458081 None] Acquiring lock "cinder-quobyte-4fea46be-e7ac-4136-9bd9-e7d2e408b2bf" by "_copy_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:54:43 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fda7c9e0-5691-4c32-bc7a-c21828df594f tempest-GroupSnapshotsTest-23458081 None] Lock "cinder-quobyte-4fea46be-e7ac-4136-9bd9-e7d2e408b2bf" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:54:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-fda7c9e0-5691-4c32-bc7a-c21828df594f tempest-GroupSnapshotsTest-23458081 None] snapshot: b683b343-d8d3-4ec6-91e4-c494e83da63b, volume: 4fea46be-e7ac-4136-9bd9-e7d2e408b2bf, {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 11:54:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fda7c9e0-5691-4c32-bc7a-c21828df594f tempest-GroupSnapshotsTest-23458081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:54:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fda7c9e0-5691-4c32-bc7a-c21828df594f tempest-GroupSnapshotsTest-23458081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:54:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-fda7c9e0-5691-4c32-bc7a-c21828df594f tempest-GroupSnapshotsTest-23458081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:54:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-fda7c9e0-5691-4c32-bc7a-c21828df594f tempest-GroupSnapshotsTest-23458081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:54:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fda7c9e0-5691-4c32-bc7a-c21828df594f tempest-GroupSnapshotsTest-23458081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:54:43 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c83fcb-0a34-45a0-ad3f-6e0fc830ddf9]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:54:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fda7c9e0-5691-4c32-bc7a-c21828df594f tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971aa7f3-dba6-4bba-bc4a-128455014b01.b683b343-d8d3-4ec6-91e4-c494e83da63b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:43 devstack sudo[98153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971aa7f3-dba6-4bba-bc4a-128455014b01.b683b343-d8d3-4ec6-91e4-c494e83da63b Sep 28 11:54:43 devstack sudo[98153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:43 devstack sudo[98153]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fda7c9e0-5691-4c32-bc7a-c21828df594f tempest-GroupSnapshotsTest-23458081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971aa7f3-dba6-4bba-bc4a-128455014b01.b683b343-d8d3-4ec6-91e4-c494e83da63b" returned: 0 in 0.682s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-fda7c9e0-5691-4c32-bc7a-c21828df594f tempest-GroupSnapshotsTest-23458081 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-971aa7f3-dba6-4bba-bc4a-128455014b01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 11:54:43 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b59e48e-e689-41e4-9ea1-b92da3755542]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:54:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fda7c9e0-5691-4c32-bc7a-c21828df594f tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971aa7f3-dba6-4bba-bc4a-128455014b01 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:43 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:54:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] Flow 'volume_create_manager' (18f1b9dc-e1ee-46d7-8a45-ff1a5b85a86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:54:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36848f70-9bf1-4ead-b54f-70d33e1f3f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36848f70-9bf1-4ead-b54f-70d33e1f3f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:54:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1793743497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cbeade3-4aca-479d-a3d4-e8c27e778376,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8790c17115e54fa0ba110c487f5a135e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:54:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:54:44Z,use_quota=True,user_id='1bf577ca5c394deebd5591e73249b349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4ec82be-a755-4b96-827f-ed66159becae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4ec82be-a755-4b96-827f-ed66159becae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b31fc144-6f23-421b-89a6-070a86a990cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:44 devstack sudo[98159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971aa7f3-dba6-4bba-bc4a-128455014b01 Sep 28 11:54:44 devstack sudo[98159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:44 devstack cinder-volume[86916]: DEBUG cinder.image.glance [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] Creating Keystone auth plugin from conf {{(pid=86916) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 11:54:44 devstack sudo[98159]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fda7c9e0-5691-4c32-bc7a-c21828df594f tempest-GroupSnapshotsTest-23458081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971aa7f3-dba6-4bba-bc4a-128455014b01" returned: 0 in 0.485s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:44 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-fda7c9e0-5691-4c32-bc7a-c21828df594f tempest-GroupSnapshotsTest-23458081 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971aa7f3-dba6-4bba-bc4a-128455014b01 {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 11:54:44 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-fda7c9e0-5691-4c32-bc7a-c21828df594f tempest-GroupSnapshotsTest-23458081 None] Creating direct copy from snapshot {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 11:54:44 devstack cinder-volume[86916]: DEBUG cinder.utils [None req-fda7c9e0-5691-4c32-bc7a-c21828df594f tempest-GroupSnapshotsTest-23458081 None] Path /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fea46be-e7ac-4136-9bd9-e7d2e408b2bf not found in is_blk_device check {{(pid=86916) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 11:54:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fda7c9e0-5691-4c32-bc7a-c21828df594f tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971aa7f3-dba6-4bba-bc4a-128455014b01 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fea46be-e7ac-4136-9bd9-e7d2e408b2bf {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:44 devstack sudo[98165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971aa7f3-dba6-4bba-bc4a-128455014b01 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fea46be-e7ac-4136-9bd9-e7d2e408b2bf Sep 28 11:54:44 devstack sudo[98165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b31fc144-6f23-421b-89a6-070a86a990cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1cbeade3-4aca-479d-a3d4-e8c27e778376', 'volume_name': 'volume-1cbeade3-4aca-479d-a3d4-e8c27e778376', 'volume_size': 1, 'image_id': '5400a738-7bf7-408f-b314-8b5954ac2b81', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5400a738-7bf7-408f-b314-8b5954ac2b81', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0c8ef073bf9e4608b40db55c7aa6c23c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5400a738-7bf7-408f-b314-8b5954ac2b81', 'created_at': datetime.datetime(2026, 9, 28, 9, 39, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 9, 39, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5400a738-7bf7-408f-b314-8b5954ac2b81/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2b0a921-f8a3-434f-855c-8fe776bd8c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2b0a921-f8a3-434f-855c-8fe776bd8c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d34ba84-612d-431b-b5bf-ce44a33cd677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:44 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] Volume 1cbeade3-4aca-479d-a3d4-e8c27e778376: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1cbeade3-4aca-479d-a3d4-e8c27e778376', 'volume_size': 1, 'image_id': '5400a738-7bf7-408f-b314-8b5954ac2b81', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5400a738-7bf7-408f-b314-8b5954ac2b81', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0c8ef073bf9e4608b40db55c7aa6c23c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5400a738-7bf7-408f-b314-8b5954ac2b81', 'created_at': datetime.datetime(2026, 9, 28, 9, 39, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 9, 39, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5400a738-7bf7-408f-b314-8b5954ac2b81/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 11:54:44 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] Trying to clone 1cbeade3-4aca-479d-a3d4-e8c27e778376 from image 5400a738-7bf7-408f-b314-8b5954ac2b81 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5400a738-7bf7-408f-b314-8b5954ac2b81', 'metadata': {}}]). {{(pid=86916) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 11:54:45 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_w5mbzez7devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 11:54:45 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] Image download 20.69 MB at 20.69 MB/s Sep 28 11:54:45 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[40692211-4aad-438a-b42a-e5c065c25806]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:54:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_w5mbzez7devstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:45 devstack sudo[98172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_w5mbzez7devstack@QuobyteHD Sep 28 11:54:45 devstack sudo[98172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:45 devstack sudo[98172]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_w5mbzez7devstack@QuobyteHD" returned: 0 in 0.843s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:46 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] Temporary image 5400a738-7bf7-408f-b314-8b5954ac2b81 is fetched for user 1bf577ca5c394deebd5591e73249b349. {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 11:54:46 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb285a7-5338-442c-ac96-77c3aff3cc5c]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:54:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_w5mbzez7devstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:46 devstack sudo[98184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_w5mbzez7devstack@QuobyteHD Sep 28 11:54:46 devstack sudo[98184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:46 devstack sudo[98184]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_w5mbzez7devstack@QuobyteHD" returned: 0 in 0.592s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:54:52 devstack sudo[98165]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fda7c9e0-5691-4c32-bc7a-c21828df594f tempest-GroupSnapshotsTest-23458081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971aa7f3-dba6-4bba-bc4a-128455014b01 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fea46be-e7ac-4136-9bd9-e7d2e408b2bf" returned: 0 in 7.735s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:52 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-fda7c9e0-5691-4c32-bc7a-c21828df594f tempest-GroupSnapshotsTest-23458081 None] Image conversion details: src /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971aa7f3-dba6-4bba-bc4a-128455014b01, size 1024.00 MB, duration 7.74 sec, destination /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fea46be-e7ac-4136-9bd9-e7d2e408b2bf {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 11:54:52 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-fda7c9e0-5691-4c32-bc7a-c21828df594f tempest-GroupSnapshotsTest-23458081 None] Converted 1024.00 MB image at 132.37 MB/s Sep 28 11:54:52 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-fda7c9e0-5691-4c32-bc7a-c21828df594f tempest-GroupSnapshotsTest-23458081 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fea46be-e7ac-4136-9bd9-e7d2e408b2bf is being set with open permissions: ugo+rw: NotImplementedError Sep 28 11:54:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fda7c9e0-5691-4c32-bc7a-c21828df594f tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fea46be-e7ac-4136-9bd9-e7d2e408b2bf {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:52 devstack sudo[98192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fea46be-e7ac-4136-9bd9-e7d2e408b2bf Sep 28 11:54:52 devstack sudo[98192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:52 devstack sudo[98192]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fda7c9e0-5691-4c32-bc7a-c21828df594f tempest-GroupSnapshotsTest-23458081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fea46be-e7ac-4136-9bd9-e7d2e408b2bf" returned: 0 in 0.244s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:52 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fda7c9e0-5691-4c32-bc7a-c21828df594f tempest-GroupSnapshotsTest-23458081 None] Lock "cinder-quobyte-4fea46be-e7ac-4136-9bd9-e7d2e408b2bf" released by "_copy_volume_from_snapshot" :: held 9.286s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:54:52 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fda7c9e0-5691-4c32-bc7a-c21828df594f tempest-GroupSnapshotsTest-23458081 None] Lock "cinder-quobyte-b683b343-d8d3-4ec6-91e4-c494e83da63b-4fea46be-e7ac-4136-9bd9-e7d2e408b2bf" released by "_create_volume_from_snapshot" :: held 9.370s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:54:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fda7c9e0-5691-4c32-bc7a-c21828df594f tempest-GroupSnapshotsTest-23458081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.395s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:54:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.638s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:54:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:54:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1793743497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cbeade3-4aca-479d-a3d4-e8c27e778376,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8790c17115e54fa0ba110c487f5a135e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:54:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:54:44Z,use_quota=True,user_id='1bf577ca5c394deebd5591e73249b349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:54:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] Creating volume 1cbeade3-4aca-479d-a3d4-e8c27e778376 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:54:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:54:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:54:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:54:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:54:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:54:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:54:52 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:54:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1cbeade3-4aca-479d-a3d4-e8c27e778376 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:52 devstack sudo[98195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1cbeade3-4aca-479d-a3d4-e8c27e778376 1073741824 Sep 28 11:54:52 devstack sudo[98195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:52 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-fda7c9e0-5691-4c32-bc7a-c21828df594f tempest-GroupSnapshotsTest-23458081 None] Create group from source-snapshot-09e5b4cc-f0dd-4479-950b-1deec14ddac7 completed successfully. Sep 28 11:54:52 devstack sudo[98195]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1cbeade3-4aca-479d-a3d4-e8c27e778376 1073741824" returned: 0 in 0.455s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1cbeade3-4aca-479d-a3d4-e8c27e778376 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:52 devstack sudo[98200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1cbeade3-4aca-479d-a3d4-e8c27e778376 Sep 28 11:54:52 devstack sudo[98200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:53 devstack sudo[98200]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1cbeade3-4aca-479d-a3d4-e8c27e778376" returned: 0 in 0.239s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:54:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:54:53 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] Attempting download of 5400a738-7bf7-408f-b314-8b5954ac2b81 ((None, [{'url': 'file:///opt/stack/data/glance/images/5400a738-7bf7-408f-b314-8b5954ac2b81', 'metadata': {}}])) to volume 1cbeade3-4aca-479d-a3d4-e8c27e778376. {{(pid=86916) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 11:54:53 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebde6df6-0c02-4684-b2bc-dd22a3d2c3bb]: (4, 'raw') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:54:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5400a738-7bf7-408f-b314-8b5954ac2b81_co1hog60 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:53 devstack sudo[98203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5400a738-7bf7-408f-b314-8b5954ac2b81_co1hog60 Sep 28 11:54:53 devstack sudo[98203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:53 devstack sudo[98203]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5400a738-7bf7-408f-b314-8b5954ac2b81_co1hog60" returned: 0 in 0.350s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5400a738-7bf7-408f-b314-8b5954ac2b81_co1hog60 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:53 devstack sudo[98209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5400a738-7bf7-408f-b314-8b5954ac2b81_co1hog60 Sep 28 11:54:53 devstack sudo[98209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:54 devstack sudo[98209]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5400a738-7bf7-408f-b314-8b5954ac2b81_co1hog60" returned: 1 in 0.393s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5400a738-7bf7-408f-b314-8b5954ac2b81_co1hog60' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 11:54:54 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2d0422-f5e8-4a01-ae82-5eafe570d34d]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:54:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_w5mbzez7devstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:54 devstack sudo[98233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_w5mbzez7devstack@QuobyteHD Sep 28 11:54:54 devstack sudo[98233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4a78cf0d-2147-40cc-bbe9-286b9f619c16 tempest-GroupSnapshotsTest-23458081 None] Acquiring lock "cinder-quobyte-4fea46be-e7ac-4136-9bd9-e7d2e408b2bf" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:54:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4a78cf0d-2147-40cc-bbe9-286b9f619c16 tempest-GroupSnapshotsTest-23458081 None] Lock "cinder-quobyte-4fea46be-e7ac-4136-9bd9-e7d2e408b2bf" acquired by "delete_volume" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:54:54 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[6736fc8b-1e95-4840-9c20-3aedc9596456]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:54:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4a78cf0d-2147-40cc-bbe9-286b9f619c16 tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fea46be-e7ac-4136-9bd9-e7d2e408b2bf {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:54 devstack sudo[98235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fea46be-e7ac-4136-9bd9-e7d2e408b2bf Sep 28 11:54:54 devstack sudo[98235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:54 devstack sudo[98233]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_w5mbzez7devstack@QuobyteHD" returned: 0 in 0.348s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:54 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] 5400a738-7bf7-408f-b314-8b5954ac2b81 was qcow2, converting to qcow2 {{(pid=86916) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 11:54:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_w5mbzez7devstack@QuobyteHD /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1cbeade3-4aca-479d-a3d4-e8c27e778376 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:54 devstack sudo[98240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_w5mbzez7devstack@QuobyteHD /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1cbeade3-4aca-479d-a3d4-e8c27e778376 Sep 28 11:54:54 devstack sudo[98240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:54 devstack sudo[98235]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4a78cf0d-2147-40cc-bbe9-286b9f619c16 tempest-GroupSnapshotsTest-23458081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fea46be-e7ac-4136-9bd9-e7d2e408b2bf" returned: 0 in 0.368s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4a78cf0d-2147-40cc-bbe9-286b9f619c16 tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fea46be-e7ac-4136-9bd9-e7d2e408b2bf {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:54 devstack sudo[98248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fea46be-e7ac-4136-9bd9-e7d2e408b2bf Sep 28 11:54:54 devstack sudo[98248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:54 devstack sudo[98248]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4a78cf0d-2147-40cc-bbe9-286b9f619c16 tempest-GroupSnapshotsTest-23458081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fea46be-e7ac-4136-9bd9-e7d2e408b2bf" returned: 0 in 0.271s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4a78cf0d-2147-40cc-bbe9-286b9f619c16 tempest-GroupSnapshotsTest-23458081 None] Lock "cinder-quobyte-4fea46be-e7ac-4136-9bd9-e7d2e408b2bf" released by "delete_volume" :: held 0.692s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:54:54 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-4a78cf0d-2147-40cc-bbe9-286b9f619c16 tempest-GroupSnapshotsTest-23458081 None] Created reservations ['b5ee8324-9c49-48e8-bb15-7063d7254730'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:54:55 devstack cinder-volume[86916]: WARNING cinder.quota [None req-4a78cf0d-2147-40cc-bbe9-286b9f619c16 tempest-GroupSnapshotsTest-23458081 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-578826091 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-578826091, it is now deprecated. Please use the default quota class for default quota. Sep 28 11:54:55 devstack cinder-volume[86916]: WARNING cinder.quota [None req-4a78cf0d-2147-40cc-bbe9-286b9f619c16 tempest-GroupSnapshotsTest-23458081 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-578826091 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-578826091, it is now deprecated. Please use the default quota class for default quota. Sep 28 11:54:55 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-4a78cf0d-2147-40cc-bbe9-286b9f619c16 tempest-GroupSnapshotsTest-23458081 None] Created reservations ['67230c38-6380-49c8-aee6-fb0f39cf0082', '1ed34963-e7f9-4216-bbf0-13ae6cddad6a', '88971adb-2576-401a-89dd-f65f6fd1c349', '0da2aa98-ffd4-4176-8068-8405702197d2'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:54:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4a78cf0d-2147-40cc-bbe9-286b9f619c16 tempest-GroupSnapshotsTest-23458081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:54:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4a78cf0d-2147-40cc-bbe9-286b9f619c16 tempest-GroupSnapshotsTest-23458081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:54:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4a78cf0d-2147-40cc-bbe9-286b9f619c16 tempest-GroupSnapshotsTest-23458081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:54:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4a78cf0d-2147-40cc-bbe9-286b9f619c16 tempest-GroupSnapshotsTest-23458081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:54:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4a78cf0d-2147-40cc-bbe9-286b9f619c16 tempest-GroupSnapshotsTest-23458081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:54:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4a78cf0d-2147-40cc-bbe9-286b9f619c16 tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:55 devstack sudo[98258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:54:55 devstack sudo[98258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:55 devstack sudo[98258]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4a78cf0d-2147-40cc-bbe9-286b9f619c16 tempest-GroupSnapshotsTest-23458081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.267s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:55 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-4a78cf0d-2147-40cc-bbe9-286b9f619c16 tempest-GroupSnapshotsTest-23458081 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:54:55 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-4a78cf0d-2147-40cc-bbe9-286b9f619c16 tempest-GroupSnapshotsTest-23458081 None] Delete group completed successfully. Sep 28 11:54:55 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-c3ec13ac-c4b3-4e71-a281-25be870f6ff0 tempest-GroupSnapshotsTest-23458081 None] group_snapshot 09e5b4cc-f0dd-4479-950b-1deec14ddac7: deleting Sep 28 11:54:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c3ec13ac-c4b3-4e71-a281-25be870f6ff0 tempest-GroupSnapshotsTest-23458081 None] group_snapshot 09e5b4cc-f0dd-4479-950b-1deec14ddac7: deleting {{(pid=86916) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 11:54:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c3ec13ac-c4b3-4e71-a281-25be870f6ff0 tempest-GroupSnapshotsTest-23458081 None] Acquiring lock "cinder-quobyte-971aa7f3-dba6-4bba-bc4a-128455014b01" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:54:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c3ec13ac-c4b3-4e71-a281-25be870f6ff0 tempest-GroupSnapshotsTest-23458081 None] Lock "cinder-quobyte-971aa7f3-dba6-4bba-bc4a-128455014b01" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:54:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c3ec13ac-c4b3-4e71-a281-25be870f6ff0 tempest-GroupSnapshotsTest-23458081 None] Acquiring lock "cinder-quobyte-b683b343-d8d3-4ec6-91e4-c494e83da63b" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:54:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c3ec13ac-c4b3-4e71-a281-25be870f6ff0 tempest-GroupSnapshotsTest-23458081 None] Lock "cinder-quobyte-b683b343-d8d3-4ec6-91e4-c494e83da63b" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:54:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-c3ec13ac-c4b3-4e71-a281-25be870f6ff0 tempest-GroupSnapshotsTest-23458081 None] Deleting offline snapshot b683b343-d8d3-4ec6-91e4-c494e83da63b of volume 971aa7f3-dba6-4bba-bc4a-128455014b01 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 11:54:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-c3ec13ac-c4b3-4e71-a281-25be870f6ff0 tempest-GroupSnapshotsTest-23458081 None] snapshot_file for this snap is: volume-971aa7f3-dba6-4bba-bc4a-128455014b01.b683b343-d8d3-4ec6-91e4-c494e83da63b {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 11:54:55 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f7651b-00d5-452a-b170-d5224fed57c6]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:54:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c3ec13ac-c4b3-4e71-a281-25be870f6ff0 tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971aa7f3-dba6-4bba-bc4a-128455014b01.b683b343-d8d3-4ec6-91e4-c494e83da63b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:55 devstack sudo[98261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971aa7f3-dba6-4bba-bc4a-128455014b01.b683b343-d8d3-4ec6-91e4-c494e83da63b Sep 28 11:54:55 devstack sudo[98261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:56 devstack sudo[98261]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c3ec13ac-c4b3-4e71-a281-25be870f6ff0 tempest-GroupSnapshotsTest-23458081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971aa7f3-dba6-4bba-bc4a-128455014b01.b683b343-d8d3-4ec6-91e4-c494e83da63b" returned: 0 in 0.410s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-c3ec13ac-c4b3-4e71-a281-25be870f6ff0 tempest-GroupSnapshotsTest-23458081 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-971aa7f3-dba6-4bba-bc4a-128455014b01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 11:54:56 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e94ba7-5f2a-41d0-97ba-958b90ce4466]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:54:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c3ec13ac-c4b3-4e71-a281-25be870f6ff0 tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971aa7f3-dba6-4bba-bc4a-128455014b01 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:56 devstack sudo[98268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971aa7f3-dba6-4bba-bc4a-128455014b01 Sep 28 11:54:56 devstack sudo[98268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:56 devstack sudo[98240]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_w5mbzez7devstack@QuobyteHD /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1cbeade3-4aca-479d-a3d4-e8c27e778376" returned: 0 in 1.981s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:56 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_w5mbzez7devstack@QuobyteHD, size 112.00 MB, duration 1.98 sec, destination /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1cbeade3-4aca-479d-a3d4-e8c27e778376 {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 11:54:56 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] Converted 112.00 MB image at 56.43 MB/s Sep 28 11:54:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1cbeade3-4aca-479d-a3d4-e8c27e778376 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:56 devstack sudo[98270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1cbeade3-4aca-479d-a3d4-e8c27e778376 1G Sep 28 11:54:56 devstack sudo[98270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:56 devstack sudo[98268]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c3ec13ac-c4b3-4e71-a281-25be870f6ff0 tempest-GroupSnapshotsTest-23458081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971aa7f3-dba6-4bba-bc4a-128455014b01" returned: 0 in 0.631s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c3ec13ac-c4b3-4e71-a281-25be870f6ff0 tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971aa7f3-dba6-4bba-bc4a-128455014b01.b683b343-d8d3-4ec6-91e4-c494e83da63b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:56 devstack sudo[98280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971aa7f3-dba6-4bba-bc4a-128455014b01.b683b343-d8d3-4ec6-91e4-c494e83da63b Sep 28 11:54:56 devstack sudo[98280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:56 devstack sudo[98270]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1cbeade3-4aca-479d-a3d4-e8c27e778376 1G" returned: 0 in 0.383s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:56 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] Downloaded image 5400a738-7bf7-408f-b314-8b5954ac2b81 ((None, [{'url': 'file:///opt/stack/data/glance/images/5400a738-7bf7-408f-b314-8b5954ac2b81', 'metadata': {}}])) to volume 1cbeade3-4aca-479d-a3d4-e8c27e778376 successfully. {{(pid=86916) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 11:54:56 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] Temporary image 5400a738-7bf7-408f-b314-8b5954ac2b81 for user 1bf577ca5c394deebd5591e73249b349 is deleted. {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 11:54:56 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] Marking volume 1cbeade3-4aca-479d-a3d4-e8c27e778376 as bootable. {{(pid=86916) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 11:54:56 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] Copying metadata from image 5400a738-7bf7-408f-b314-8b5954ac2b81 to 1cbeade3-4aca-479d-a3d4-e8c27e778376. {{(pid=86916) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 11:54:56 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] Creating volume glance metadata for volume 1cbeade3-4aca-479d-a3d4-e8c27e778376 backed by image 5400a738-7bf7-408f-b314-8b5954ac2b81 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5400a738-7bf7-408f-b314-8b5954ac2b81', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86916) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 11:54:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d34ba84-612d-431b-b5bf-ce44a33cd677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cbeade3-4aca-479d-a3d4-e8c27e778376', 'volume_size': 1, 'image_id': '5400a738-7bf7-408f-b314-8b5954ac2b81', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5400a738-7bf7-408f-b314-8b5954ac2b81', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0c8ef073bf9e4608b40db55c7aa6c23c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5400a738-7bf7-408f-b314-8b5954ac2b81', 'created_at': datetime.datetime(2026, 9, 28, 9, 39, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 9, 39, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5400a738-7bf7-408f-b314-8b5954ac2b81/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edb58a20-e83b-4532-8ccc-a34e589c50a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:56 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] Volume volume-1cbeade3-4aca-479d-a3d4-e8c27e778376 (1cbeade3-4aca-479d-a3d4-e8c27e778376): created successfully Sep 28 11:54:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edb58a20-e83b-4532-8ccc-a34e589c50a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] Flow 'volume_create_manager' (18f1b9dc-e1ee-46d7-8a45-ff1a5b85a86b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:54:56 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-f34e3853-39bd-495a-b56f-4081341e2c86 tempest-VolumesGetTest-1204081055 None] Created volume successfully. Sep 28 11:54:57 devstack sudo[98280]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c3ec13ac-c4b3-4e71-a281-25be870f6ff0 tempest-GroupSnapshotsTest-23458081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971aa7f3-dba6-4bba-bc4a-128455014b01.b683b343-d8d3-4ec6-91e4-c494e83da63b" returned: 0 in 0.341s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c3ec13ac-c4b3-4e71-a281-25be870f6ff0 tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971aa7f3-dba6-4bba-bc4a-128455014b01.b683b343-d8d3-4ec6-91e4-c494e83da63b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:57 devstack sudo[98285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971aa7f3-dba6-4bba-bc4a-128455014b01.b683b343-d8d3-4ec6-91e4-c494e83da63b Sep 28 11:54:57 devstack sudo[98285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:57 devstack sudo[98285]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c3ec13ac-c4b3-4e71-a281-25be870f6ff0 tempest-GroupSnapshotsTest-23458081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971aa7f3-dba6-4bba-bc4a-128455014b01.b683b343-d8d3-4ec6-91e4-c494e83da63b" returned: 0 in 0.238s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c3ec13ac-c4b3-4e71-a281-25be870f6ff0 tempest-GroupSnapshotsTest-23458081 None] Lock "cinder-quobyte-b683b343-d8d3-4ec6-91e4-c494e83da63b" released by "_delete_snapshot" :: held 1.734s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:54:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c3ec13ac-c4b3-4e71-a281-25be870f6ff0 tempest-GroupSnapshotsTest-23458081 None] Lock "cinder-quobyte-971aa7f3-dba6-4bba-bc4a-128455014b01" released by "delete_snapshot" :: held 1.760s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:54:57 devstack cinder-volume[86916]: WARNING cinder.quota [None req-c3ec13ac-c4b3-4e71-a281-25be870f6ff0 tempest-GroupSnapshotsTest-23458081 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-578826091 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-578826091, it is now deprecated. Please use the default quota class for default quota. Sep 28 11:54:57 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-c3ec13ac-c4b3-4e71-a281-25be870f6ff0 tempest-GroupSnapshotsTest-23458081 None] Created reservations ['c8946ab5-1800-4cd5-8aa8-dd11783d5244', '90535734-d89c-4e48-a73d-368839991341', 'bf756caf-5335-400d-bcf7-409d3a38d73a', '34eaa572-3ed0-4dd6-a20b-51c286623047'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:54:57 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-c3ec13ac-c4b3-4e71-a281-25be870f6ff0 tempest-GroupSnapshotsTest-23458081 None] group_snapshot 09e5b4cc-f0dd-4479-950b-1deec14ddac7: deleted successfully Sep 28 11:54:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a27280e5-6e34-462b-8cf8-378f8a280272 tempest-GroupSnapshotsTest-23458081 None] Acquiring lock "cinder-quobyte-971aa7f3-dba6-4bba-bc4a-128455014b01" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:54:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a27280e5-6e34-462b-8cf8-378f8a280272 tempest-GroupSnapshotsTest-23458081 None] Lock "cinder-quobyte-971aa7f3-dba6-4bba-bc4a-128455014b01" acquired by "delete_volume" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:54:58 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b456461-8f96-43c1-8570-f05bf6c74071]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:54:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a27280e5-6e34-462b-8cf8-378f8a280272 tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971aa7f3-dba6-4bba-bc4a-128455014b01 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:58 devstack sudo[98288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971aa7f3-dba6-4bba-bc4a-128455014b01 Sep 28 11:54:58 devstack sudo[98288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:58 devstack sudo[98288]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a27280e5-6e34-462b-8cf8-378f8a280272 tempest-GroupSnapshotsTest-23458081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971aa7f3-dba6-4bba-bc4a-128455014b01" returned: 0 in 0.402s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a27280e5-6e34-462b-8cf8-378f8a280272 tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971aa7f3-dba6-4bba-bc4a-128455014b01 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:58 devstack sudo[98293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971aa7f3-dba6-4bba-bc4a-128455014b01 Sep 28 11:54:58 devstack sudo[98293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:58 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-a39a8a3e-4299-4341-93d5-f2e707cf8cfc tempest-VolumesGetTest-1204081055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:54:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a39a8a3e-4299-4341-93d5-f2e707cf8cfc tempest-VolumesGetTest-1204081055 None] Flow 'volume_create_manager' (1c77f292-bb69-49a6-957f-6e71f395ec43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:54:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a39a8a3e-4299-4341-93d5-f2e707cf8cfc tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72c420a3-ee81-45ae-a509-79461b2ba727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a39a8a3e-4299-4341-93d5-f2e707cf8cfc tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72c420a3-ee81-45ae-a509-79461b2ba727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:54:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1993368940',display_name='tempest-VolumesGetTest-Volume-342731212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61f8684f-41da-4309-b012-9d627e6d3683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8790c17115e54fa0ba110c487f5a135e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:54:59Z,use_quota=True,user_id='1bf577ca5c394deebd5591e73249b349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a39a8a3e-4299-4341-93d5-f2e707cf8cfc tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (310ccc71-c697-4e80-b3ed-4e0df6fc55d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a39a8a3e-4299-4341-93d5-f2e707cf8cfc tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (310ccc71-c697-4e80-b3ed-4e0df6fc55d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a39a8a3e-4299-4341-93d5-f2e707cf8cfc tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9501179-2aa9-48d0-b38a-67d2c51647ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a39a8a3e-4299-4341-93d5-f2e707cf8cfc tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9501179-2aa9-48d0-b38a-67d2c51647ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61f8684f-41da-4309-b012-9d627e6d3683', 'volume_name': 'volume-61f8684f-41da-4309-b012-9d627e6d3683', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:58 devstack sudo[98293]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a39a8a3e-4299-4341-93d5-f2e707cf8cfc tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2bce68a-44d6-4570-b1a4-4baadc1a80aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a39a8a3e-4299-4341-93d5-f2e707cf8cfc tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2bce68a-44d6-4570-b1a4-4baadc1a80aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a39a8a3e-4299-4341-93d5-f2e707cf8cfc tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59e80f3a-f186-42a0-ac26-73d407498d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:58 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-a39a8a3e-4299-4341-93d5-f2e707cf8cfc tempest-VolumesGetTest-1204081055 None] Volume 61f8684f-41da-4309-b012-9d627e6d3683: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61f8684f-41da-4309-b012-9d627e6d3683', 'volume_size': 1} Sep 28 11:54:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a39a8a3e-4299-4341-93d5-f2e707cf8cfc tempest-VolumesGetTest-1204081055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:54:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a39a8a3e-4299-4341-93d5-f2e707cf8cfc tempest-VolumesGetTest-1204081055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:54:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a39a8a3e-4299-4341-93d5-f2e707cf8cfc tempest-VolumesGetTest-1204081055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:54:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1993368940',display_name='tempest-VolumesGetTest-Volume-342731212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61f8684f-41da-4309-b012-9d627e6d3683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8790c17115e54fa0ba110c487f5a135e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:54:59Z,use_quota=True,user_id='1bf577ca5c394deebd5591e73249b349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:54:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-a39a8a3e-4299-4341-93d5-f2e707cf8cfc tempest-VolumesGetTest-1204081055 None] Creating volume 61f8684f-41da-4309-b012-9d627e6d3683 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:54:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a39a8a3e-4299-4341-93d5-f2e707cf8cfc tempest-VolumesGetTest-1204081055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:54:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a39a8a3e-4299-4341-93d5-f2e707cf8cfc tempest-VolumesGetTest-1204081055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:54:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a39a8a3e-4299-4341-93d5-f2e707cf8cfc tempest-VolumesGetTest-1204081055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:54:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a39a8a3e-4299-4341-93d5-f2e707cf8cfc tempest-VolumesGetTest-1204081055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:54:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a39a8a3e-4299-4341-93d5-f2e707cf8cfc tempest-VolumesGetTest-1204081055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:54:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a39a8a3e-4299-4341-93d5-f2e707cf8cfc tempest-VolumesGetTest-1204081055 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:54:58 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-a39a8a3e-4299-4341-93d5-f2e707cf8cfc tempest-VolumesGetTest-1204081055 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:54:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a39a8a3e-4299-4341-93d5-f2e707cf8cfc tempest-VolumesGetTest-1204081055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-61f8684f-41da-4309-b012-9d627e6d3683 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a27280e5-6e34-462b-8cf8-378f8a280272 tempest-GroupSnapshotsTest-23458081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-971aa7f3-dba6-4bba-bc4a-128455014b01" returned: 0 in 0.299s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:58 devstack sudo[98296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-61f8684f-41da-4309-b012-9d627e6d3683 1073741824 Sep 28 11:54:58 devstack sudo[98296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a27280e5-6e34-462b-8cf8-378f8a280272 tempest-GroupSnapshotsTest-23458081 None] Lock "cinder-quobyte-971aa7f3-dba6-4bba-bc4a-128455014b01" released by "delete_volume" :: held 0.793s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:54:58 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-a27280e5-6e34-462b-8cf8-378f8a280272 tempest-GroupSnapshotsTest-23458081 None] Created reservations ['67d7c922-af9f-471d-b227-fab0a88d0e3e'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:54:58 devstack cinder-volume[86916]: WARNING cinder.db.api [None req-a27280e5-6e34-462b-8cf8-378f8a280272 tempest-GroupSnapshotsTest-23458081 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-578826091'] Sep 28 11:54:58 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-a27280e5-6e34-462b-8cf8-378f8a280272 tempest-GroupSnapshotsTest-23458081 None] Created reservations ['b4e02c51-eae4-42a3-a79a-b0ddd0d652f4', 'f3733ac7-453d-496a-9582-7a29ff9c6bf4', 'c99c94ab-135f-4a52-b7b5-7d1f24184ec3', 'a4523789-41f8-4d74-bcdc-aa0cb5502f97'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:54:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27280e5-6e34-462b-8cf8-378f8a280272 tempest-GroupSnapshotsTest-23458081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:54:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27280e5-6e34-462b-8cf8-378f8a280272 tempest-GroupSnapshotsTest-23458081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:54:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a27280e5-6e34-462b-8cf8-378f8a280272 tempest-GroupSnapshotsTest-23458081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:54:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a27280e5-6e34-462b-8cf8-378f8a280272 tempest-GroupSnapshotsTest-23458081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:54:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27280e5-6e34-462b-8cf8-378f8a280272 tempest-GroupSnapshotsTest-23458081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:54:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a27280e5-6e34-462b-8cf8-378f8a280272 tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:59 devstack sudo[98300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:54:59 devstack sudo[98300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:59 devstack sudo[98296]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a39a8a3e-4299-4341-93d5-f2e707cf8cfc tempest-VolumesGetTest-1204081055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-61f8684f-41da-4309-b012-9d627e6d3683 1073741824" returned: 0 in 0.474s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:59 devstack sudo[98300]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a27280e5-6e34-462b-8cf8-378f8a280272 tempest-GroupSnapshotsTest-23458081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.274s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:59 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a27280e5-6e34-462b-8cf8-378f8a280272 tempest-GroupSnapshotsTest-23458081 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:54:59 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-a27280e5-6e34-462b-8cf8-378f8a280272 tempest-GroupSnapshotsTest-23458081 None] Delete group completed successfully. Sep 28 11:54:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a39a8a3e-4299-4341-93d5-f2e707cf8cfc tempest-VolumesGetTest-1204081055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-61f8684f-41da-4309-b012-9d627e6d3683 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:54:59 devstack sudo[98305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-61f8684f-41da-4309-b012-9d627e6d3683 Sep 28 11:54:59 devstack sudo[98305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:54:59 devstack sudo[98305]: pam_unix(sudo:session): session closed for user root Sep 28 11:54:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a39a8a3e-4299-4341-93d5-f2e707cf8cfc tempest-VolumesGetTest-1204081055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-61f8684f-41da-4309-b012-9d627e6d3683" returned: 0 in 0.256s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:54:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a39a8a3e-4299-4341-93d5-f2e707cf8cfc tempest-VolumesGetTest-1204081055 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:54:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a39a8a3e-4299-4341-93d5-f2e707cf8cfc tempest-VolumesGetTest-1204081055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:54:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a39a8a3e-4299-4341-93d5-f2e707cf8cfc tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59e80f3a-f186-42a0-ac26-73d407498d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61f8684f-41da-4309-b012-9d627e6d3683', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a39a8a3e-4299-4341-93d5-f2e707cf8cfc tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f768d712-089d-40ee-b2a0-dbb7b6d29181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:54:59 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-a39a8a3e-4299-4341-93d5-f2e707cf8cfc tempest-VolumesGetTest-1204081055 None] Volume volume-61f8684f-41da-4309-b012-9d627e6d3683 (61f8684f-41da-4309-b012-9d627e6d3683): created successfully Sep 28 11:54:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a39a8a3e-4299-4341-93d5-f2e707cf8cfc tempest-VolumesGetTest-1204081055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f768d712-089d-40ee-b2a0-dbb7b6d29181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:54:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a39a8a3e-4299-4341-93d5-f2e707cf8cfc tempest-VolumesGetTest-1204081055 None] Flow 'volume_create_manager' (1c77f292-bb69-49a6-957f-6e71f395ec43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:54:59 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-a39a8a3e-4299-4341-93d5-f2e707cf8cfc tempest-VolumesGetTest-1204081055 None] Created volume successfully. Sep 28 11:54:59 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-978d2a1e-26b1-4f03-9249-e13e895a9956 tempest-GroupSnapshotsTest-23458081 None] Group tempest-GroupSnapshotsTest-Group-319053783: creating Sep 28 11:54:59 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-978d2a1e-26b1-4f03-9249-e13e895a9956 tempest-GroupSnapshotsTest-23458081 None] Group tempest-GroupSnapshotsTest-Group-319053783: created successfully Sep 28 11:54:59 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-978d2a1e-26b1-4f03-9249-e13e895a9956 tempest-GroupSnapshotsTest-23458081 None] Create group completed successfully. Sep 28 11:55:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-de7626bf-7a30-4c1f-9abf-8920bce99a8e tempest-VolumesGetTest-1204081055 None] Acquiring lock "cinder-61f8684f-41da-4309-b012-9d627e6d3683-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:55:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-de7626bf-7a30-4c1f-9abf-8920bce99a8e tempest-VolumesGetTest-1204081055 None] Lock "cinder-61f8684f-41da-4309-b012-9d627e6d3683-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:55:01 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=138,cinder:INSERT=43,cinder:UPDATE=159,cinder:DELETE=15 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 11:55:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-de7626bf-7a30-4c1f-9abf-8920bce99a8e tempest-VolumesGetTest-1204081055 None] Acquiring lock "cinder-quobyte-61f8684f-41da-4309-b012-9d627e6d3683" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:55:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-de7626bf-7a30-4c1f-9abf-8920bce99a8e tempest-VolumesGetTest-1204081055 None] Lock "cinder-quobyte-61f8684f-41da-4309-b012-9d627e6d3683" acquired by "delete_volume" :: waited 0.030s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:55:01 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43d4611-b9ee-4f15-98fc-3f72c1f05efc]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:55:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-de7626bf-7a30-4c1f-9abf-8920bce99a8e tempest-VolumesGetTest-1204081055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-61f8684f-41da-4309-b012-9d627e6d3683 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:01 devstack sudo[98309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-61f8684f-41da-4309-b012-9d627e6d3683 Sep 28 11:55:01 devstack sudo[98309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:01 devstack sudo[98309]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-de7626bf-7a30-4c1f-9abf-8920bce99a8e tempest-VolumesGetTest-1204081055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-61f8684f-41da-4309-b012-9d627e6d3683" returned: 0 in 0.479s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-de7626bf-7a30-4c1f-9abf-8920bce99a8e tempest-VolumesGetTest-1204081055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-61f8684f-41da-4309-b012-9d627e6d3683 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:01 devstack sudo[98318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-61f8684f-41da-4309-b012-9d627e6d3683 Sep 28 11:55:01 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-40357b3d-6d33-4c24-9b71-93ecc3315cb4 tempest-GroupSnapshotsTest-23458081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:55:01 devstack sudo[98318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-40357b3d-6d33-4c24-9b71-93ecc3315cb4 tempest-GroupSnapshotsTest-23458081 None] Flow 'volume_create_manager' (1d6307d7-5478-4143-8762-cff68c3239b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:55:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-40357b3d-6d33-4c24-9b71-93ecc3315cb4 tempest-GroupSnapshotsTest-23458081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04168b72-e680-4c7f-b835-311e5dedaf99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:55:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-40357b3d-6d33-4c24-9b71-93ecc3315cb4 tempest-GroupSnapshotsTest-23458081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04168b72-e680-4c7f-b835-311e5dedaf99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:55:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1800290400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5634aa98-5890-4181-ada3-3fde37893262,host='devstack@QuobyteHD#QuobyteHD',id=dc341f39-57a8-461f-8a1c-50a9d35f1a82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a07ca7e03959469d880233b762aff5e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:55:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:55:02Z,use_quota=True,user_id='64f68e6fac7a438bb9698da7ee17003e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6660eb1-17a3-4c49-9858-04eac53fb34d),volume_type_id=c6660eb1-17a3-4c49-9858-04eac53fb34d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:55:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-40357b3d-6d33-4c24-9b71-93ecc3315cb4 tempest-GroupSnapshotsTest-23458081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91240570-9fa5-4fae-9642-739979213740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:55:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-40357b3d-6d33-4c24-9b71-93ecc3315cb4 tempest-GroupSnapshotsTest-23458081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91240570-9fa5-4fae-9642-739979213740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:55:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-40357b3d-6d33-4c24-9b71-93ecc3315cb4 tempest-GroupSnapshotsTest-23458081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d832e69-68e9-4982-83ef-5438477bd638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:55:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-40357b3d-6d33-4c24-9b71-93ecc3315cb4 tempest-GroupSnapshotsTest-23458081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d832e69-68e9-4982-83ef-5438477bd638) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc341f39-57a8-461f-8a1c-50a9d35f1a82', 'volume_name': 'volume-dc341f39-57a8-461f-8a1c-50a9d35f1a82', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:55:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-40357b3d-6d33-4c24-9b71-93ecc3315cb4 tempest-GroupSnapshotsTest-23458081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eca432c1-9c7f-4065-bf66-5b26fc9f7ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:55:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-40357b3d-6d33-4c24-9b71-93ecc3315cb4 tempest-GroupSnapshotsTest-23458081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eca432c1-9c7f-4065-bf66-5b26fc9f7ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:55:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-40357b3d-6d33-4c24-9b71-93ecc3315cb4 tempest-GroupSnapshotsTest-23458081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b588494-6881-4ca7-aac7-30551e1ec0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:55:01 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-40357b3d-6d33-4c24-9b71-93ecc3315cb4 tempest-GroupSnapshotsTest-23458081 None] Volume dc341f39-57a8-461f-8a1c-50a9d35f1a82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc341f39-57a8-461f-8a1c-50a9d35f1a82', 'volume_size': 1} Sep 28 11:55:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-40357b3d-6d33-4c24-9b71-93ecc3315cb4 tempest-GroupSnapshotsTest-23458081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:55:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-40357b3d-6d33-4c24-9b71-93ecc3315cb4 tempest-GroupSnapshotsTest-23458081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:55:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-40357b3d-6d33-4c24-9b71-93ecc3315cb4 tempest-GroupSnapshotsTest-23458081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5634aa98-5890-4181-ada3-3fde37893262,created_at=2026-09-28T09:55:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1800290400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5634aa98-5890-4181-ada3-3fde37893262,host='devstack@QuobyteHD#QuobyteHD',id=dc341f39-57a8-461f-8a1c-50a9d35f1a82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a07ca7e03959469d880233b762aff5e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:55:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:55:02Z,use_quota=True,user_id='64f68e6fac7a438bb9698da7ee17003e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6660eb1-17a3-4c49-9858-04eac53fb34d),volume_type_id=c6660eb1-17a3-4c49-9858-04eac53fb34d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:55:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-40357b3d-6d33-4c24-9b71-93ecc3315cb4 tempest-GroupSnapshotsTest-23458081 None] Creating volume dc341f39-57a8-461f-8a1c-50a9d35f1a82 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:55:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-40357b3d-6d33-4c24-9b71-93ecc3315cb4 tempest-GroupSnapshotsTest-23458081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:55:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-40357b3d-6d33-4c24-9b71-93ecc3315cb4 tempest-GroupSnapshotsTest-23458081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:55:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-40357b3d-6d33-4c24-9b71-93ecc3315cb4 tempest-GroupSnapshotsTest-23458081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:55:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-40357b3d-6d33-4c24-9b71-93ecc3315cb4 tempest-GroupSnapshotsTest-23458081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:55:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-40357b3d-6d33-4c24-9b71-93ecc3315cb4 tempest-GroupSnapshotsTest-23458081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:55:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-40357b3d-6d33-4c24-9b71-93ecc3315cb4 tempest-GroupSnapshotsTest-23458081 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:55:01 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-40357b3d-6d33-4c24-9b71-93ecc3315cb4 tempest-GroupSnapshotsTest-23458081 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:55:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-40357b3d-6d33-4c24-9b71-93ecc3315cb4 tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dc341f39-57a8-461f-8a1c-50a9d35f1a82 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:01 devstack sudo[98320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dc341f39-57a8-461f-8a1c-50a9d35f1a82 1073741824 Sep 28 11:55:01 devstack sudo[98320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:01 devstack sudo[98318]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-de7626bf-7a30-4c1f-9abf-8920bce99a8e tempest-VolumesGetTest-1204081055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-61f8684f-41da-4309-b012-9d627e6d3683" returned: 0 in 0.365s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-de7626bf-7a30-4c1f-9abf-8920bce99a8e tempest-VolumesGetTest-1204081055 None] Lock "cinder-quobyte-61f8684f-41da-4309-b012-9d627e6d3683" released by "delete_volume" :: held 0.896s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:55:02 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-de7626bf-7a30-4c1f-9abf-8920bce99a8e tempest-VolumesGetTest-1204081055 None] Created reservations ['30702c14-acca-4657-8cb8-9937b6b11a7d', '262f42c2-b065-4b01-84c7-9ffa077b746b', 'cf5939f9-2ea1-48ef-845f-6caf1e68804d', '773ceb88-c6ad-4c2a-b3a8-a54e74c1fecc'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:55:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-de7626bf-7a30-4c1f-9abf-8920bce99a8e tempest-VolumesGetTest-1204081055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:55:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-de7626bf-7a30-4c1f-9abf-8920bce99a8e tempest-VolumesGetTest-1204081055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:55:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-de7626bf-7a30-4c1f-9abf-8920bce99a8e tempest-VolumesGetTest-1204081055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:55:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-de7626bf-7a30-4c1f-9abf-8920bce99a8e tempest-VolumesGetTest-1204081055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:55:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-de7626bf-7a30-4c1f-9abf-8920bce99a8e tempest-VolumesGetTest-1204081055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:55:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-de7626bf-7a30-4c1f-9abf-8920bce99a8e tempest-VolumesGetTest-1204081055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:02 devstack sudo[98326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:55:02 devstack sudo[98326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ce163046-4a00-49c2-8411-c35f8decf23c tempest-VolumesGetTest-1204081055 None] Acquiring lock "cinder-1cbeade3-4aca-479d-a3d4-e8c27e778376-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:55:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ce163046-4a00-49c2-8411-c35f8decf23c tempest-VolumesGetTest-1204081055 None] Lock "cinder-1cbeade3-4aca-479d-a3d4-e8c27e778376-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:55:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ce163046-4a00-49c2-8411-c35f8decf23c tempest-VolumesGetTest-1204081055 None] Acquiring lock "cinder-quobyte-1cbeade3-4aca-479d-a3d4-e8c27e778376" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:55:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ce163046-4a00-49c2-8411-c35f8decf23c tempest-VolumesGetTest-1204081055 None] Lock "cinder-quobyte-1cbeade3-4aca-479d-a3d4-e8c27e778376" acquired by "delete_volume" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:55:02 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80cceba-5aa1-47d0-8989-fe94c58bc3bf]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:55:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ce163046-4a00-49c2-8411-c35f8decf23c tempest-VolumesGetTest-1204081055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1cbeade3-4aca-479d-a3d4-e8c27e778376 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:02 devstack sudo[98320]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-40357b3d-6d33-4c24-9b71-93ecc3315cb4 tempest-GroupSnapshotsTest-23458081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dc341f39-57a8-461f-8a1c-50a9d35f1a82 1073741824" returned: 0 in 0.556s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:02 devstack sudo[98326]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-40357b3d-6d33-4c24-9b71-93ecc3315cb4 tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dc341f39-57a8-461f-8a1c-50a9d35f1a82 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-de7626bf-7a30-4c1f-9abf-8920bce99a8e tempest-VolumesGetTest-1204081055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.328s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:02 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-de7626bf-7a30-4c1f-9abf-8920bce99a8e tempest-VolumesGetTest-1204081055 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:55:02 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-de7626bf-7a30-4c1f-9abf-8920bce99a8e tempest-VolumesGetTest-1204081055 None] Deleted volume successfully. Sep 28 11:55:02 devstack sudo[98331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dc341f39-57a8-461f-8a1c-50a9d35f1a82 Sep 28 11:55:02 devstack sudo[98331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-de7626bf-7a30-4c1f-9abf-8920bce99a8e tempest-VolumesGetTest-1204081055 None] Lock "cinder-61f8684f-41da-4309-b012-9d627e6d3683-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:55:02 devstack sudo[98330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1cbeade3-4aca-479d-a3d4-e8c27e778376 Sep 28 11:55:02 devstack sudo[98330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:02 devstack sudo[98331]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-40357b3d-6d33-4c24-9b71-93ecc3315cb4 tempest-GroupSnapshotsTest-23458081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dc341f39-57a8-461f-8a1c-50a9d35f1a82" returned: 0 in 0.269s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-40357b3d-6d33-4c24-9b71-93ecc3315cb4 tempest-GroupSnapshotsTest-23458081 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:55:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-40357b3d-6d33-4c24-9b71-93ecc3315cb4 tempest-GroupSnapshotsTest-23458081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:55:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-40357b3d-6d33-4c24-9b71-93ecc3315cb4 tempest-GroupSnapshotsTest-23458081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b588494-6881-4ca7-aac7-30551e1ec0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc341f39-57a8-461f-8a1c-50a9d35f1a82', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:55:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-40357b3d-6d33-4c24-9b71-93ecc3315cb4 tempest-GroupSnapshotsTest-23458081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd2d3c42-8e7d-48cc-b02a-9878847a767e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:55:02 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-40357b3d-6d33-4c24-9b71-93ecc3315cb4 tempest-GroupSnapshotsTest-23458081 None] Volume volume-dc341f39-57a8-461f-8a1c-50a9d35f1a82 (dc341f39-57a8-461f-8a1c-50a9d35f1a82): created successfully Sep 28 11:55:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-40357b3d-6d33-4c24-9b71-93ecc3315cb4 tempest-GroupSnapshotsTest-23458081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd2d3c42-8e7d-48cc-b02a-9878847a767e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:55:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-40357b3d-6d33-4c24-9b71-93ecc3315cb4 tempest-GroupSnapshotsTest-23458081 None] Flow 'volume_create_manager' (1d6307d7-5478-4143-8762-cff68c3239b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:55:02 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-40357b3d-6d33-4c24-9b71-93ecc3315cb4 tempest-GroupSnapshotsTest-23458081 None] Created volume successfully. Sep 28 11:55:02 devstack sudo[98330]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ce163046-4a00-49c2-8411-c35f8decf23c tempest-VolumesGetTest-1204081055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1cbeade3-4aca-479d-a3d4-e8c27e778376" returned: 0 in 0.471s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ce163046-4a00-49c2-8411-c35f8decf23c tempest-VolumesGetTest-1204081055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1cbeade3-4aca-479d-a3d4-e8c27e778376 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:02 devstack sudo[98338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1cbeade3-4aca-479d-a3d4-e8c27e778376 Sep 28 11:55:02 devstack sudo[98338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:03 devstack sudo[98338]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ce163046-4a00-49c2-8411-c35f8decf23c tempest-VolumesGetTest-1204081055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1cbeade3-4aca-479d-a3d4-e8c27e778376" returned: 0 in 0.273s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ce163046-4a00-49c2-8411-c35f8decf23c tempest-VolumesGetTest-1204081055 None] Lock "cinder-quobyte-1cbeade3-4aca-479d-a3d4-e8c27e778376" released by "delete_volume" :: held 0.795s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:55:03 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-ce163046-4a00-49c2-8411-c35f8decf23c tempest-VolumesGetTest-1204081055 None] Created reservations ['df321188-77df-4816-8b8e-56704355ded7', '5bfae9dc-6e4d-4d2a-b96e-d2fda84fc524', '2e353092-e5ec-43f0-8614-5fb97fbeaf16', '090a2e8f-df1e-4bda-88f7-6a3f4ad3bfd8'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:55:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ce163046-4a00-49c2-8411-c35f8decf23c tempest-VolumesGetTest-1204081055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:55:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ce163046-4a00-49c2-8411-c35f8decf23c tempest-VolumesGetTest-1204081055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:55:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ce163046-4a00-49c2-8411-c35f8decf23c tempest-VolumesGetTest-1204081055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:55:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ce163046-4a00-49c2-8411-c35f8decf23c tempest-VolumesGetTest-1204081055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:55:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ce163046-4a00-49c2-8411-c35f8decf23c tempest-VolumesGetTest-1204081055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:55:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ce163046-4a00-49c2-8411-c35f8decf23c tempest-VolumesGetTest-1204081055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:03 devstack sudo[98341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:55:03 devstack sudo[98341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:03 devstack sudo[98341]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ce163046-4a00-49c2-8411-c35f8decf23c tempest-VolumesGetTest-1204081055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.290s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:03 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-ce163046-4a00-49c2-8411-c35f8decf23c tempest-VolumesGetTest-1204081055 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:55:03 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-ce163046-4a00-49c2-8411-c35f8decf23c tempest-VolumesGetTest-1204081055 None] Deleted volume successfully. Sep 28 11:55:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ce163046-4a00-49c2-8411-c35f8decf23c tempest-VolumesGetTest-1204081055 None] Lock "cinder-1cbeade3-4aca-479d-a3d4-e8c27e778376-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:55:04 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e73be23-a36a-437f-ba0e-e0e6f575f816 tempest-AttachVolumeTestJSON-1340154457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:55:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8e73be23-a36a-437f-ba0e-e0e6f575f816 tempest-AttachVolumeTestJSON-1340154457 None] Flow 'volume_create_manager' (6879141e-383e-419e-9775-b59e9cb6173f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:55:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8e73be23-a36a-437f-ba0e-e0e6f575f816 tempest-AttachVolumeTestJSON-1340154457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f52b042-ec43-4ece-b8ce-85d5ff54888f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:55:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8e73be23-a36a-437f-ba0e-e0e6f575f816 tempest-AttachVolumeTestJSON-1340154457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f52b042-ec43-4ece-b8ce-85d5ff54888f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-982373471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63660747-ccb3-44a6-bbb8-1d77babc74f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='593a37e7b16141da90cbf6cf071519ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:55:05Z,use_quota=True,user_id='813df1ee376742609bf91a672cfd6306',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:55:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8e73be23-a36a-437f-ba0e-e0e6f575f816 tempest-AttachVolumeTestJSON-1340154457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c893635-82d9-407b-b413-ae188e956663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:55:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8e73be23-a36a-437f-ba0e-e0e6f575f816 tempest-AttachVolumeTestJSON-1340154457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c893635-82d9-407b-b413-ae188e956663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:55:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8e73be23-a36a-437f-ba0e-e0e6f575f816 tempest-AttachVolumeTestJSON-1340154457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7645cc5e-e6b4-4051-b1fe-ebb9f7934ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:55:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8e73be23-a36a-437f-ba0e-e0e6f575f816 tempest-AttachVolumeTestJSON-1340154457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7645cc5e-e6b4-4051-b1fe-ebb9f7934ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63660747-ccb3-44a6-bbb8-1d77babc74f1', 'volume_name': 'volume-63660747-ccb3-44a6-bbb8-1d77babc74f1', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:55:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8e73be23-a36a-437f-ba0e-e0e6f575f816 tempest-AttachVolumeTestJSON-1340154457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe9364ec-53ae-4cb5-b0dc-209f4c7aa004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:55:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8e73be23-a36a-437f-ba0e-e0e6f575f816 tempest-AttachVolumeTestJSON-1340154457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe9364ec-53ae-4cb5-b0dc-209f4c7aa004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:55:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8e73be23-a36a-437f-ba0e-e0e6f575f816 tempest-AttachVolumeTestJSON-1340154457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d45f58fc-5f42-4fa7-b070-1f548e84d945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:55:04 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-8e73be23-a36a-437f-ba0e-e0e6f575f816 tempest-AttachVolumeTestJSON-1340154457 None] Volume 63660747-ccb3-44a6-bbb8-1d77babc74f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63660747-ccb3-44a6-bbb8-1d77babc74f1', 'volume_size': 1} Sep 28 11:55:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8e73be23-a36a-437f-ba0e-e0e6f575f816 tempest-AttachVolumeTestJSON-1340154457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:55:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8e73be23-a36a-437f-ba0e-e0e6f575f816 tempest-AttachVolumeTestJSON-1340154457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:55:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8e73be23-a36a-437f-ba0e-e0e6f575f816 tempest-AttachVolumeTestJSON-1340154457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-982373471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63660747-ccb3-44a6-bbb8-1d77babc74f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='593a37e7b16141da90cbf6cf071519ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:55:05Z,use_quota=True,user_id='813df1ee376742609bf91a672cfd6306',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:55:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-8e73be23-a36a-437f-ba0e-e0e6f575f816 tempest-AttachVolumeTestJSON-1340154457 None] Creating volume 63660747-ccb3-44a6-bbb8-1d77babc74f1 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:55:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8e73be23-a36a-437f-ba0e-e0e6f575f816 tempest-AttachVolumeTestJSON-1340154457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:55:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8e73be23-a36a-437f-ba0e-e0e6f575f816 tempest-AttachVolumeTestJSON-1340154457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:55:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8e73be23-a36a-437f-ba0e-e0e6f575f816 tempest-AttachVolumeTestJSON-1340154457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:55:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8e73be23-a36a-437f-ba0e-e0e6f575f816 tempest-AttachVolumeTestJSON-1340154457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:55:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8e73be23-a36a-437f-ba0e-e0e6f575f816 tempest-AttachVolumeTestJSON-1340154457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:55:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8e73be23-a36a-437f-ba0e-e0e6f575f816 tempest-AttachVolumeTestJSON-1340154457 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:55:04 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-8e73be23-a36a-437f-ba0e-e0e6f575f816 tempest-AttachVolumeTestJSON-1340154457 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:55:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8e73be23-a36a-437f-ba0e-e0e6f575f816 tempest-AttachVolumeTestJSON-1340154457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-63660747-ccb3-44a6-bbb8-1d77babc74f1 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:04 devstack sudo[98676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-63660747-ccb3-44a6-bbb8-1d77babc74f1 1073741824 Sep 28 11:55:04 devstack sudo[98676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:04 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-705838bd-0147-4a03-93db-054896220d8c tempest-GroupSnapshotsTest-23458081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:55:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-705838bd-0147-4a03-93db-054896220d8c tempest-GroupSnapshotsTest-23458081 None] Flow 'volume_create_manager' (33eb77ed-3b6a-4159-9c8e-ad390fb2092a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:55:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-705838bd-0147-4a03-93db-054896220d8c tempest-GroupSnapshotsTest-23458081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d86aefe1-3963-4b38-861c-b30543c65143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:55:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-705838bd-0147-4a03-93db-054896220d8c tempest-GroupSnapshotsTest-23458081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d86aefe1-3963-4b38-861c-b30543c65143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1865295451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5634aa98-5890-4181-ada3-3fde37893262,host='devstack@QuobyteHD#QuobyteHD',id=40358297-bb63-435c-a587-b4a9d03126e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a07ca7e03959469d880233b762aff5e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:55:05Z,use_quota=True,user_id='64f68e6fac7a438bb9698da7ee17003e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6660eb1-17a3-4c49-9858-04eac53fb34d),volume_type_id=c6660eb1-17a3-4c49-9858-04eac53fb34d)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:55:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-705838bd-0147-4a03-93db-054896220d8c tempest-GroupSnapshotsTest-23458081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72a09bb6-8d1f-4c66-ba68-7166ccb2ede3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:55:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-705838bd-0147-4a03-93db-054896220d8c tempest-GroupSnapshotsTest-23458081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72a09bb6-8d1f-4c66-ba68-7166ccb2ede3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:55:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-705838bd-0147-4a03-93db-054896220d8c tempest-GroupSnapshotsTest-23458081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b158eb9a-7c1a-4f84-a9fa-e1198685dd3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:55:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-705838bd-0147-4a03-93db-054896220d8c tempest-GroupSnapshotsTest-23458081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b158eb9a-7c1a-4f84-a9fa-e1198685dd3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40358297-bb63-435c-a587-b4a9d03126e6', 'volume_name': 'volume-40358297-bb63-435c-a587-b4a9d03126e6', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:55:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-705838bd-0147-4a03-93db-054896220d8c tempest-GroupSnapshotsTest-23458081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59776150-cc3f-45e7-92b2-01c2aee4ce48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:55:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-705838bd-0147-4a03-93db-054896220d8c tempest-GroupSnapshotsTest-23458081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59776150-cc3f-45e7-92b2-01c2aee4ce48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:55:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-705838bd-0147-4a03-93db-054896220d8c tempest-GroupSnapshotsTest-23458081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12bb9460-d4b0-417d-b5ba-0000307f11a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:55:04 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-705838bd-0147-4a03-93db-054896220d8c tempest-GroupSnapshotsTest-23458081 None] Volume 40358297-bb63-435c-a587-b4a9d03126e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40358297-bb63-435c-a587-b4a9d03126e6', 'volume_size': 1} Sep 28 11:55:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-705838bd-0147-4a03-93db-054896220d8c tempest-GroupSnapshotsTest-23458081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:55:05 devstack sudo[98676]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8e73be23-a36a-437f-ba0e-e0e6f575f816 tempest-AttachVolumeTestJSON-1340154457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-63660747-ccb3-44a6-bbb8-1d77babc74f1 1073741824" returned: 0 in 0.557s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8e73be23-a36a-437f-ba0e-e0e6f575f816 tempest-AttachVolumeTestJSON-1340154457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-63660747-ccb3-44a6-bbb8-1d77babc74f1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:05 devstack sudo[98684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-63660747-ccb3-44a6-bbb8-1d77babc74f1 Sep 28 11:55:05 devstack sudo[98684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:05 devstack sudo[98684]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8e73be23-a36a-437f-ba0e-e0e6f575f816 tempest-AttachVolumeTestJSON-1340154457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-63660747-ccb3-44a6-bbb8-1d77babc74f1" returned: 0 in 0.283s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8e73be23-a36a-437f-ba0e-e0e6f575f816 tempest-AttachVolumeTestJSON-1340154457 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:55:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8e73be23-a36a-437f-ba0e-e0e6f575f816 tempest-AttachVolumeTestJSON-1340154457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:55:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-705838bd-0147-4a03-93db-054896220d8c tempest-GroupSnapshotsTest-23458081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.672s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:55:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-705838bd-0147-4a03-93db-054896220d8c tempest-GroupSnapshotsTest-23458081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5634aa98-5890-4181-ada3-3fde37893262,created_at=2026-09-28T09:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1865295451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5634aa98-5890-4181-ada3-3fde37893262,host='devstack@QuobyteHD#QuobyteHD',id=40358297-bb63-435c-a587-b4a9d03126e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a07ca7e03959469d880233b762aff5e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:55:05Z,use_quota=True,user_id='64f68e6fac7a438bb9698da7ee17003e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6660eb1-17a3-4c49-9858-04eac53fb34d),volume_type_id=c6660eb1-17a3-4c49-9858-04eac53fb34d)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:55:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-705838bd-0147-4a03-93db-054896220d8c tempest-GroupSnapshotsTest-23458081 None] Creating volume 40358297-bb63-435c-a587-b4a9d03126e6 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:55:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-705838bd-0147-4a03-93db-054896220d8c tempest-GroupSnapshotsTest-23458081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:55:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-705838bd-0147-4a03-93db-054896220d8c tempest-GroupSnapshotsTest-23458081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:55:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-705838bd-0147-4a03-93db-054896220d8c tempest-GroupSnapshotsTest-23458081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:55:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-705838bd-0147-4a03-93db-054896220d8c tempest-GroupSnapshotsTest-23458081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:55:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-705838bd-0147-4a03-93db-054896220d8c tempest-GroupSnapshotsTest-23458081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:55:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-705838bd-0147-4a03-93db-054896220d8c tempest-GroupSnapshotsTest-23458081 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:55:05 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-705838bd-0147-4a03-93db-054896220d8c tempest-GroupSnapshotsTest-23458081 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:55:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-705838bd-0147-4a03-93db-054896220d8c tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-40358297-bb63-435c-a587-b4a9d03126e6 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:05 devstack sudo[98693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-40358297-bb63-435c-a587-b4a9d03126e6 1073741824 Sep 28 11:55:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8e73be23-a36a-437f-ba0e-e0e6f575f816 tempest-AttachVolumeTestJSON-1340154457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d45f58fc-5f42-4fa7-b070-1f548e84d945) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63660747-ccb3-44a6-bbb8-1d77babc74f1', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:55:05 devstack sudo[98693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8e73be23-a36a-437f-ba0e-e0e6f575f816 tempest-AttachVolumeTestJSON-1340154457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dd039f9-4fdc-41f4-a99d-0867ccb7a0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:55:05 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-8e73be23-a36a-437f-ba0e-e0e6f575f816 tempest-AttachVolumeTestJSON-1340154457 None] Volume volume-63660747-ccb3-44a6-bbb8-1d77babc74f1 (63660747-ccb3-44a6-bbb8-1d77babc74f1): created successfully Sep 28 11:55:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8e73be23-a36a-437f-ba0e-e0e6f575f816 tempest-AttachVolumeTestJSON-1340154457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dd039f9-4fdc-41f4-a99d-0867ccb7a0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:55:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8e73be23-a36a-437f-ba0e-e0e6f575f816 tempest-AttachVolumeTestJSON-1340154457 None] Flow 'volume_create_manager' (6879141e-383e-419e-9775-b59e9cb6173f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:55:05 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-8e73be23-a36a-437f-ba0e-e0e6f575f816 tempest-AttachVolumeTestJSON-1340154457 None] Created volume successfully. Sep 28 11:55:06 devstack sudo[98693]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-705838bd-0147-4a03-93db-054896220d8c tempest-GroupSnapshotsTest-23458081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-40358297-bb63-435c-a587-b4a9d03126e6 1073741824" returned: 0 in 0.583s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-705838bd-0147-4a03-93db-054896220d8c tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-40358297-bb63-435c-a587-b4a9d03126e6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:06 devstack sudo[98734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-40358297-bb63-435c-a587-b4a9d03126e6 Sep 28 11:55:06 devstack sudo[98734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:06 devstack sudo[98734]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-705838bd-0147-4a03-93db-054896220d8c tempest-GroupSnapshotsTest-23458081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-40358297-bb63-435c-a587-b4a9d03126e6" returned: 0 in 0.278s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-705838bd-0147-4a03-93db-054896220d8c tempest-GroupSnapshotsTest-23458081 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:55:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-705838bd-0147-4a03-93db-054896220d8c tempest-GroupSnapshotsTest-23458081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:55:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-705838bd-0147-4a03-93db-054896220d8c tempest-GroupSnapshotsTest-23458081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12bb9460-d4b0-417d-b5ba-0000307f11a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40358297-bb63-435c-a587-b4a9d03126e6', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:55:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-705838bd-0147-4a03-93db-054896220d8c tempest-GroupSnapshotsTest-23458081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54be0704-c564-4f22-9247-4785c26b9a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:55:06 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-705838bd-0147-4a03-93db-054896220d8c tempest-GroupSnapshotsTest-23458081 None] Volume volume-40358297-bb63-435c-a587-b4a9d03126e6 (40358297-bb63-435c-a587-b4a9d03126e6): created successfully Sep 28 11:55:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-705838bd-0147-4a03-93db-054896220d8c tempest-GroupSnapshotsTest-23458081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54be0704-c564-4f22-9247-4785c26b9a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:55:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-705838bd-0147-4a03-93db-054896220d8c tempest-GroupSnapshotsTest-23458081 None] Flow 'volume_create_manager' (33eb77ed-3b6a-4159-9c8e-ad390fb2092a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:55:06 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-705838bd-0147-4a03-93db-054896220d8c tempest-GroupSnapshotsTest-23458081 None] Created volume successfully. Sep 28 11:55:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-37a1a0ff-a89c-44b1-890f-354ceb83c89a req-e95604a4-7bc4-448e-a658-4c3be666a95a tempest-AttachVolumeTestJSON-1340154457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:55:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-37a1a0ff-a89c-44b1-890f-354ceb83c89a req-e95604a4-7bc4-448e-a658-4c3be666a95a tempest-AttachVolumeTestJSON-1340154457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:55:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-37a1a0ff-a89c-44b1-890f-354ceb83c89a req-e95604a4-7bc4-448e-a658-4c3be666a95a tempest-AttachVolumeTestJSON-1340154457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:55:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-37a1a0ff-a89c-44b1-890f-354ceb83c89a req-e95604a4-7bc4-448e-a658-4c3be666a95a tempest-AttachVolumeTestJSON-1340154457 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0', 'name': 'volume-63660747-ccb3-44a6-bbb8-1d77babc74f1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5d214186-67c6-4238-b117-78e5e965212d', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 11:55:07 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-37a1a0ff-a89c-44b1-890f-354ceb83c89a req-e95604a4-7bc4-448e-a658-4c3be666a95a tempest-AttachVolumeTestJSON-1340154457 None] attachment_update completed successfully. Sep 28 11:55:07 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-7869bfdd-0d3a-40c0-9a27-971fd0ce5348 tempest-GroupSnapshotsTest-23458081 None] Update group completed successfully. Sep 28 11:55:08 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf48b0df-66b4-43f4-8630-5802b68afd89 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:55:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bf48b0df-66b4-43f4-8630-5802b68afd89 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Flow 'volume_create_manager' (43de59a0-5d74-4bca-b263-bed846de0d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:55:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bf48b0df-66b4-43f4-8630-5802b68afd89 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c36c7203-3cd8-43ac-8c15-df9e1bca7d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:55:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bf48b0df-66b4-43f4-8630-5802b68afd89 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c36c7203-3cd8-43ac-8c15-df9e1bca7d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:55:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1832839112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2218459d-078f-43be-b672-9fad7ae4ae46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='901032eb79b842d3b744766525b74cd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:55:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:55:08Z,use_quota=True,user_id='34ae117c4c2a406487f1e717773250ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:55:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bf48b0df-66b4-43f4-8630-5802b68afd89 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daf68a2a-261a-41d7-bdf2-3d78e2b0d96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:55:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bf48b0df-66b4-43f4-8630-5802b68afd89 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daf68a2a-261a-41d7-bdf2-3d78e2b0d96a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:55:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bf48b0df-66b4-43f4-8630-5802b68afd89 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab447da6-bf9c-4548-93ff-b553e27b3c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:55:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bf48b0df-66b4-43f4-8630-5802b68afd89 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab447da6-bf9c-4548-93ff-b553e27b3c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2218459d-078f-43be-b672-9fad7ae4ae46', 'volume_name': 'volume-2218459d-078f-43be-b672-9fad7ae4ae46', 'volume_size': 2}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:55:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bf48b0df-66b4-43f4-8630-5802b68afd89 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74271c23-1a1b-4555-b8ed-ac4ac96d6aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:55:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bf48b0df-66b4-43f4-8630-5802b68afd89 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74271c23-1a1b-4555-b8ed-ac4ac96d6aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:55:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bf48b0df-66b4-43f4-8630-5802b68afd89 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c0a85f1-eb01-41fa-823a-cbfc8863756e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:55:08 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-bf48b0df-66b4-43f4-8630-5802b68afd89 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Volume 2218459d-078f-43be-b672-9fad7ae4ae46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2218459d-078f-43be-b672-9fad7ae4ae46', 'volume_size': 2} Sep 28 11:55:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bf48b0df-66b4-43f4-8630-5802b68afd89 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:55:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bf48b0df-66b4-43f4-8630-5802b68afd89 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:55:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bf48b0df-66b4-43f4-8630-5802b68afd89 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:55:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1832839112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2218459d-078f-43be-b672-9fad7ae4ae46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='901032eb79b842d3b744766525b74cd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:55:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:55:08Z,use_quota=True,user_id='34ae117c4c2a406487f1e717773250ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:55:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-bf48b0df-66b4-43f4-8630-5802b68afd89 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Creating volume 2218459d-078f-43be-b672-9fad7ae4ae46 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:55:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bf48b0df-66b4-43f4-8630-5802b68afd89 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:55:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bf48b0df-66b4-43f4-8630-5802b68afd89 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:55:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bf48b0df-66b4-43f4-8630-5802b68afd89 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:55:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bf48b0df-66b4-43f4-8630-5802b68afd89 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:55:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bf48b0df-66b4-43f4-8630-5802b68afd89 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:55:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bf48b0df-66b4-43f4-8630-5802b68afd89 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:55:08 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-bf48b0df-66b4-43f4-8630-5802b68afd89 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:55:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bf48b0df-66b4-43f4-8630-5802b68afd89 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2218459d-078f-43be-b672-9fad7ae4ae46 2147483648 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:08 devstack sudo[99163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2218459d-078f-43be-b672-9fad7ae4ae46 2147483648 Sep 28 11:55:08 devstack sudo[99163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:08 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-670eaa96-df59-4fe6-b4f1-33693e179646 tempest-GroupSnapshotsTest-23458081 None] Update group completed successfully. Sep 28 11:55:09 devstack sudo[99163]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bf48b0df-66b4-43f4-8630-5802b68afd89 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2218459d-078f-43be-b672-9fad7ae4ae46 2147483648" returned: 0 in 0.548s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bf48b0df-66b4-43f4-8630-5802b68afd89 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2218459d-078f-43be-b672-9fad7ae4ae46 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:09 devstack sudo[99168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2218459d-078f-43be-b672-9fad7ae4ae46 Sep 28 11:55:09 devstack sudo[99168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:09 devstack sudo[99168]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bf48b0df-66b4-43f4-8630-5802b68afd89 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2218459d-078f-43be-b672-9fad7ae4ae46" returned: 0 in 0.270s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bf48b0df-66b4-43f4-8630-5802b68afd89 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:55:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bf48b0df-66b4-43f4-8630-5802b68afd89 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:55:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bf48b0df-66b4-43f4-8630-5802b68afd89 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c0a85f1-eb01-41fa-823a-cbfc8863756e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2218459d-078f-43be-b672-9fad7ae4ae46', 'volume_size': 2}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:55:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bf48b0df-66b4-43f4-8630-5802b68afd89 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d21aee86-0c30-4ec7-a578-626b0286278e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:55:09 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-bf48b0df-66b4-43f4-8630-5802b68afd89 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Volume volume-2218459d-078f-43be-b672-9fad7ae4ae46 (2218459d-078f-43be-b672-9fad7ae4ae46): created successfully Sep 28 11:55:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bf48b0df-66b4-43f4-8630-5802b68afd89 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d21aee86-0c30-4ec7-a578-626b0286278e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:55:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bf48b0df-66b4-43f4-8630-5802b68afd89 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Flow 'volume_create_manager' (43de59a0-5d74-4bca-b263-bed846de0d45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:55:09 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-bf48b0df-66b4-43f4-8630-5802b68afd89 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Created volume successfully. Sep 28 11:55:09 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-cda26b3f-73f6-4a40-ac04-39920c12ff37 tempest-AttachVolumeTestJSON-1340154457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:55:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cda26b3f-73f6-4a40-ac04-39920c12ff37 tempest-AttachVolumeTestJSON-1340154457 None] Flow 'volume_create_manager' (0495c200-6872-4cdb-a680-44f6ceb0fc08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:55:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cda26b3f-73f6-4a40-ac04-39920c12ff37 tempest-AttachVolumeTestJSON-1340154457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ca7157b-bcc0-4f38-ba14-ef0327148e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:55:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cda26b3f-73f6-4a40-ac04-39920c12ff37 tempest-AttachVolumeTestJSON-1340154457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ca7157b-bcc0-4f38-ba14-ef0327148e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:55:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-603875555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caed743e-05ed-4a75-96ae-c872e66fa2cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='593a37e7b16141da90cbf6cf071519ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:55:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:55:10Z,use_quota=True,user_id='813df1ee376742609bf91a672cfd6306',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:55:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cda26b3f-73f6-4a40-ac04-39920c12ff37 tempest-AttachVolumeTestJSON-1340154457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24031f1c-e81a-4c9c-8f42-1548992eb9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:55:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cda26b3f-73f6-4a40-ac04-39920c12ff37 tempest-AttachVolumeTestJSON-1340154457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24031f1c-e81a-4c9c-8f42-1548992eb9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:55:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cda26b3f-73f6-4a40-ac04-39920c12ff37 tempest-AttachVolumeTestJSON-1340154457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2890e2ea-97d0-4868-aad4-67b80c9013e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:55:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cda26b3f-73f6-4a40-ac04-39920c12ff37 tempest-AttachVolumeTestJSON-1340154457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2890e2ea-97d0-4868-aad4-67b80c9013e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'caed743e-05ed-4a75-96ae-c872e66fa2cb', 'volume_name': 'volume-caed743e-05ed-4a75-96ae-c872e66fa2cb', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:55:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cda26b3f-73f6-4a40-ac04-39920c12ff37 tempest-AttachVolumeTestJSON-1340154457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8058730a-1e76-4abb-abea-ab88410209ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:55:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cda26b3f-73f6-4a40-ac04-39920c12ff37 tempest-AttachVolumeTestJSON-1340154457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8058730a-1e76-4abb-abea-ab88410209ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:55:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cda26b3f-73f6-4a40-ac04-39920c12ff37 tempest-AttachVolumeTestJSON-1340154457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93220a4c-236c-4505-9440-751b61bbc9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:55:10 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-cda26b3f-73f6-4a40-ac04-39920c12ff37 tempest-AttachVolumeTestJSON-1340154457 None] Volume caed743e-05ed-4a75-96ae-c872e66fa2cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-caed743e-05ed-4a75-96ae-c872e66fa2cb', 'volume_size': 1} Sep 28 11:55:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cda26b3f-73f6-4a40-ac04-39920c12ff37 tempest-AttachVolumeTestJSON-1340154457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:55:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cda26b3f-73f6-4a40-ac04-39920c12ff37 tempest-AttachVolumeTestJSON-1340154457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:55:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cda26b3f-73f6-4a40-ac04-39920c12ff37 tempest-AttachVolumeTestJSON-1340154457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:55:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-603875555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caed743e-05ed-4a75-96ae-c872e66fa2cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='593a37e7b16141da90cbf6cf071519ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:55:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:55:10Z,use_quota=True,user_id='813df1ee376742609bf91a672cfd6306',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:55:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-cda26b3f-73f6-4a40-ac04-39920c12ff37 tempest-AttachVolumeTestJSON-1340154457 None] Creating volume caed743e-05ed-4a75-96ae-c872e66fa2cb {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:55:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cda26b3f-73f6-4a40-ac04-39920c12ff37 tempest-AttachVolumeTestJSON-1340154457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:55:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cda26b3f-73f6-4a40-ac04-39920c12ff37 tempest-AttachVolumeTestJSON-1340154457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:55:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cda26b3f-73f6-4a40-ac04-39920c12ff37 tempest-AttachVolumeTestJSON-1340154457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:55:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cda26b3f-73f6-4a40-ac04-39920c12ff37 tempest-AttachVolumeTestJSON-1340154457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:55:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cda26b3f-73f6-4a40-ac04-39920c12ff37 tempest-AttachVolumeTestJSON-1340154457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:55:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cda26b3f-73f6-4a40-ac04-39920c12ff37 tempest-AttachVolumeTestJSON-1340154457 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:55:10 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-cda26b3f-73f6-4a40-ac04-39920c12ff37 tempest-AttachVolumeTestJSON-1340154457 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:55:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cda26b3f-73f6-4a40-ac04-39920c12ff37 tempest-AttachVolumeTestJSON-1340154457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-caed743e-05ed-4a75-96ae-c872e66fa2cb 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:10 devstack sudo[99172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-caed743e-05ed-4a75-96ae-c872e66fa2cb 1073741824 Sep 28 11:55:10 devstack sudo[99172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:10 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-6035948b-65e6-4933-b633-121eb99b5b46 tempest-GroupSnapshotsTest-23458081 None] Update group completed successfully. Sep 28 11:55:10 devstack sudo[99172]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cda26b3f-73f6-4a40-ac04-39920c12ff37 tempest-AttachVolumeTestJSON-1340154457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-caed743e-05ed-4a75-96ae-c872e66fa2cb 1073741824" returned: 0 in 0.474s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cda26b3f-73f6-4a40-ac04-39920c12ff37 tempest-AttachVolumeTestJSON-1340154457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-caed743e-05ed-4a75-96ae-c872e66fa2cb {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:10 devstack sudo[99178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-caed743e-05ed-4a75-96ae-c872e66fa2cb Sep 28 11:55:10 devstack sudo[99178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-51e384ee-40fb-4c9a-bbd4-755ae260b9ea tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:55:10 devstack sudo[99178]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cda26b3f-73f6-4a40-ac04-39920c12ff37 tempest-AttachVolumeTestJSON-1340154457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-caed743e-05ed-4a75-96ae-c872e66fa2cb" returned: 0 in 0.265s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cda26b3f-73f6-4a40-ac04-39920c12ff37 tempest-AttachVolumeTestJSON-1340154457 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:55:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cda26b3f-73f6-4a40-ac04-39920c12ff37 tempest-AttachVolumeTestJSON-1340154457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:55:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-51e384ee-40fb-4c9a-bbd4-755ae260b9ea tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.188s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:55:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cda26b3f-73f6-4a40-ac04-39920c12ff37 tempest-AttachVolumeTestJSON-1340154457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93220a4c-236c-4505-9440-751b61bbc9e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-caed743e-05ed-4a75-96ae-c872e66fa2cb', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:55:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cda26b3f-73f6-4a40-ac04-39920c12ff37 tempest-AttachVolumeTestJSON-1340154457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35891996-fbae-4983-bfac-f811e610ea3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:55:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-51e384ee-40fb-4c9a-bbd4-755ae260b9ea tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Creating offline snapshot 2c921ac3-f941-425c-aa09-43922d1986bd of volume 2218459d-078f-43be-b672-9fad7ae4ae46 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 11:55:10 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-cda26b3f-73f6-4a40-ac04-39920c12ff37 tempest-AttachVolumeTestJSON-1340154457 None] Volume volume-caed743e-05ed-4a75-96ae-c872e66fa2cb (caed743e-05ed-4a75-96ae-c872e66fa2cb): created successfully Sep 28 11:55:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cda26b3f-73f6-4a40-ac04-39920c12ff37 tempest-AttachVolumeTestJSON-1340154457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35891996-fbae-4983-bfac-f811e610ea3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:55:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cda26b3f-73f6-4a40-ac04-39920c12ff37 tempest-AttachVolumeTestJSON-1340154457 None] Flow 'volume_create_manager' (0495c200-6872-4cdb-a680-44f6ceb0fc08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:55:10 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2b5410-c729-45d9-93e1-4feeb591c3db]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:55:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-51e384ee-40fb-4c9a-bbd4-755ae260b9ea tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2218459d-078f-43be-b672-9fad7ae4ae46 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:10 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-cda26b3f-73f6-4a40-ac04-39920c12ff37 tempest-AttachVolumeTestJSON-1340154457 None] Created volume successfully. Sep 28 11:55:11 devstack sudo[99181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2218459d-078f-43be-b672-9fad7ae4ae46 Sep 28 11:55:11 devstack sudo[99181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:11 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e4040006-c807-43c3-b0b2-ecbd190ac5d7 tempest-GroupSnapshotsTest-23458081 None] Update group completed successfully. Sep 28 11:55:11 devstack sudo[99181]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-51e384ee-40fb-4c9a-bbd4-755ae260b9ea tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2218459d-078f-43be-b672-9fad7ae4ae46" returned: 0 in 0.387s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-51e384ee-40fb-4c9a-bbd4-755ae260b9ea tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2218459d-078f-43be-b672-9fad7ae4ae46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2218459d-078f-43be-b672-9fad7ae4ae46.2c921ac3-f941-425c-aa09-43922d1986bd 2G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:11 devstack sudo[99186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2218459d-078f-43be-b672-9fad7ae4ae46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2218459d-078f-43be-b672-9fad7ae4ae46.2c921ac3-f941-425c-aa09-43922d1986bd 2G Sep 28 11:55:11 devstack sudo[99186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:11 devstack sudo[99186]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-51e384ee-40fb-4c9a-bbd4-755ae260b9ea tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2218459d-078f-43be-b672-9fad7ae4ae46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2218459d-078f-43be-b672-9fad7ae4ae46.2c921ac3-f941-425c-aa09-43922d1986bd 2G" returned: 0 in 0.427s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-51e384ee-40fb-4c9a-bbd4-755ae260b9ea tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2218459d-078f-43be-b672-9fad7ae4ae46 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2218459d-078f-43be-b672-9fad7ae4ae46.2c921ac3-f941-425c-aa09-43922d1986bd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:11 devstack sudo[99278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2218459d-078f-43be-b672-9fad7ae4ae46 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2218459d-078f-43be-b672-9fad7ae4ae46.2c921ac3-f941-425c-aa09-43922d1986bd Sep 28 11:55:11 devstack sudo[99278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:12 devstack sudo[99278]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-51e384ee-40fb-4c9a-bbd4-755ae260b9ea tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2218459d-078f-43be-b672-9fad7ae4ae46 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2218459d-078f-43be-b672-9fad7ae4ae46.2c921ac3-f941-425c-aa09-43922d1986bd" returned: 0 in 0.280s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:12 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-51e384ee-40fb-4c9a-bbd4-755ae260b9ea tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2218459d-078f-43be-b672-9fad7ae4ae46.2c921ac3-f941-425c-aa09-43922d1986bd is being set with open permissions: ugo+rw Sep 28 11:55:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-51e384ee-40fb-4c9a-bbd4-755ae260b9ea tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2218459d-078f-43be-b672-9fad7ae4ae46.2c921ac3-f941-425c-aa09-43922d1986bd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:12 devstack sudo[99283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2218459d-078f-43be-b672-9fad7ae4ae46.2c921ac3-f941-425c-aa09-43922d1986bd Sep 28 11:55:12 devstack sudo[99283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:12 devstack sudo[99283]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-51e384ee-40fb-4c9a-bbd4-755ae260b9ea tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2218459d-078f-43be-b672-9fad7ae4ae46.2c921ac3-f941-425c-aa09-43922d1986bd" returned: 0 in 0.260s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-51e384ee-40fb-4c9a-bbd4-755ae260b9ea tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2218459d-078f-43be-b672-9fad7ae4ae46.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:12 devstack sudo[99286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2218459d-078f-43be-b672-9fad7ae4ae46.info Sep 28 11:55:12 devstack sudo[99286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:12 devstack sudo[99286]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-51e384ee-40fb-4c9a-bbd4-755ae260b9ea tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2218459d-078f-43be-b672-9fad7ae4ae46.info" returned: 0 in 0.292s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:12 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-51e384ee-40fb-4c9a-bbd4-755ae260b9ea tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2218459d-078f-43be-b672-9fad7ae4ae46.info is being set with open permissions: ugo+rw Sep 28 11:55:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-51e384ee-40fb-4c9a-bbd4-755ae260b9ea tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2218459d-078f-43be-b672-9fad7ae4ae46.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:12 devstack sudo[99292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2218459d-078f-43be-b672-9fad7ae4ae46.info Sep 28 11:55:12 devstack sudo[99292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:12 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-9b4db866-2e23-4202-861d-5dbbc91c6f08 tempest-GroupSnapshotsTest-23458081 None] GroupSnapshot ecc99dcd-1efa-41ab-92ee-f8e480f7bfdc: creating. Sep 28 11:55:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9b4db866-2e23-4202-861d-5dbbc91c6f08 tempest-GroupSnapshotsTest-23458081 None] Group snapshot ecc99dcd-1efa-41ab-92ee-f8e480f7bfdc: creating. {{(pid=86916) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 11:55:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9b4db866-2e23-4202-861d-5dbbc91c6f08 tempest-GroupSnapshotsTest-23458081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:55:12 devstack sudo[99292]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-51e384ee-40fb-4c9a-bbd4-755ae260b9ea tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2218459d-078f-43be-b672-9fad7ae4ae46.info" returned: 0 in 0.326s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-51e384ee-40fb-4c9a-bbd4-755ae260b9ea tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.117s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:55:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9b4db866-2e23-4202-861d-5dbbc91c6f08 tempest-GroupSnapshotsTest-23458081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.140s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:55:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-9b4db866-2e23-4202-861d-5dbbc91c6f08 tempest-GroupSnapshotsTest-23458081 None] Creating offline snapshot 95d7cf8d-01f2-45c0-bae4-24a998f405ad of volume dc341f39-57a8-461f-8a1c-50a9d35f1a82 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 11:55:13 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-51e384ee-40fb-4c9a-bbd4-755ae260b9ea tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Create snapshot completed successfully Sep 28 11:55:13 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62237cf-5447-4597-b068-4bef11c2dba2]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:55:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9b4db866-2e23-4202-861d-5dbbc91c6f08 tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dc341f39-57a8-461f-8a1c-50a9d35f1a82 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-e2c07e35-2a5d-46bb-85c2-8518f41bda53 req-8ac296ed-2b32-4ea0-94e0-60f99e8b6c44 tempest-AttachVolumeTestJSON-1340154457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:55:13 devstack sudo[99303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dc341f39-57a8-461f-8a1c-50a9d35f1a82 Sep 28 11:55:13 devstack sudo[99303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:13 devstack sudo[99303]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9b4db866-2e23-4202-861d-5dbbc91c6f08 tempest-GroupSnapshotsTest-23458081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dc341f39-57a8-461f-8a1c-50a9d35f1a82" returned: 0 in 0.367s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9b4db866-2e23-4202-861d-5dbbc91c6f08 tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dc341f39-57a8-461f-8a1c-50a9d35f1a82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dc341f39-57a8-461f-8a1c-50a9d35f1a82.95d7cf8d-01f2-45c0-bae4-24a998f405ad 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:13 devstack sudo[99308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dc341f39-57a8-461f-8a1c-50a9d35f1a82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dc341f39-57a8-461f-8a1c-50a9d35f1a82.95d7cf8d-01f2-45c0-bae4-24a998f405ad 1G Sep 28 11:55:13 devstack sudo[99308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:13 devstack sudo[99308]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9b4db866-2e23-4202-861d-5dbbc91c6f08 tempest-GroupSnapshotsTest-23458081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dc341f39-57a8-461f-8a1c-50a9d35f1a82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dc341f39-57a8-461f-8a1c-50a9d35f1a82.95d7cf8d-01f2-45c0-bae4-24a998f405ad 1G" returned: 0 in 0.412s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9b4db866-2e23-4202-861d-5dbbc91c6f08 tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc341f39-57a8-461f-8a1c-50a9d35f1a82 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dc341f39-57a8-461f-8a1c-50a9d35f1a82.95d7cf8d-01f2-45c0-bae4-24a998f405ad {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:13 devstack sudo[99314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc341f39-57a8-461f-8a1c-50a9d35f1a82 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dc341f39-57a8-461f-8a1c-50a9d35f1a82.95d7cf8d-01f2-45c0-bae4-24a998f405ad Sep 28 11:55:13 devstack sudo[99314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-70524c28-48a9-41ba-91af-8298a4f33747 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Acquiring lock "cinder-2c921ac3-f941-425c-aa09-43922d1986bd-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:55:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-70524c28-48a9-41ba-91af-8298a4f33747 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Lock "cinder-2c921ac3-f941-425c-aa09-43922d1986bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:55:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-70524c28-48a9-41ba-91af-8298a4f33747 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Acquiring lock "cinder-quobyte-2218459d-078f-43be-b672-9fad7ae4ae46" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:55:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-70524c28-48a9-41ba-91af-8298a4f33747 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Lock "cinder-quobyte-2218459d-078f-43be-b672-9fad7ae4ae46" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:55:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-70524c28-48a9-41ba-91af-8298a4f33747 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Acquiring lock "cinder-quobyte-2c921ac3-f941-425c-aa09-43922d1986bd" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:55:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-70524c28-48a9-41ba-91af-8298a4f33747 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Lock "cinder-quobyte-2c921ac3-f941-425c-aa09-43922d1986bd" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:55:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-70524c28-48a9-41ba-91af-8298a4f33747 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Deleting offline snapshot 2c921ac3-f941-425c-aa09-43922d1986bd of volume 2218459d-078f-43be-b672-9fad7ae4ae46 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 11:55:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-70524c28-48a9-41ba-91af-8298a4f33747 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] snapshot_file for this snap is: volume-2218459d-078f-43be-b672-9fad7ae4ae46.2c921ac3-f941-425c-aa09-43922d1986bd {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 11:55:14 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ce9a4d-ccf7-4e33-b18b-cbc139560a88]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:55:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-70524c28-48a9-41ba-91af-8298a4f33747 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2218459d-078f-43be-b672-9fad7ae4ae46.2c921ac3-f941-425c-aa09-43922d1986bd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:14 devstack sudo[99314]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9b4db866-2e23-4202-861d-5dbbc91c6f08 tempest-GroupSnapshotsTest-23458081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc341f39-57a8-461f-8a1c-50a9d35f1a82 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dc341f39-57a8-461f-8a1c-50a9d35f1a82.95d7cf8d-01f2-45c0-bae4-24a998f405ad" returned: 0 in 0.311s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:14 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-9b4db866-2e23-4202-861d-5dbbc91c6f08 tempest-GroupSnapshotsTest-23458081 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dc341f39-57a8-461f-8a1c-50a9d35f1a82.95d7cf8d-01f2-45c0-bae4-24a998f405ad is being set with open permissions: ugo+rw: NotImplementedError Sep 28 11:55:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9b4db866-2e23-4202-861d-5dbbc91c6f08 tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dc341f39-57a8-461f-8a1c-50a9d35f1a82.95d7cf8d-01f2-45c0-bae4-24a998f405ad {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:14 devstack sudo[99320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dc341f39-57a8-461f-8a1c-50a9d35f1a82.95d7cf8d-01f2-45c0-bae4-24a998f405ad Sep 28 11:55:14 devstack sudo[99320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:14 devstack sudo[99318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2218459d-078f-43be-b672-9fad7ae4ae46.2c921ac3-f941-425c-aa09-43922d1986bd Sep 28 11:55:14 devstack sudo[99318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:14 devstack sudo[99320]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9b4db866-2e23-4202-861d-5dbbc91c6f08 tempest-GroupSnapshotsTest-23458081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dc341f39-57a8-461f-8a1c-50a9d35f1a82.95d7cf8d-01f2-45c0-bae4-24a998f405ad" returned: 0 in 0.254s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9b4db866-2e23-4202-861d-5dbbc91c6f08 tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dc341f39-57a8-461f-8a1c-50a9d35f1a82.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:14 devstack sudo[99327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dc341f39-57a8-461f-8a1c-50a9d35f1a82.info Sep 28 11:55:14 devstack sudo[99327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:14 devstack sudo[99318]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-70524c28-48a9-41ba-91af-8298a4f33747 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2218459d-078f-43be-b672-9fad7ae4ae46.2c921ac3-f941-425c-aa09-43922d1986bd" returned: 0 in 0.415s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-70524c28-48a9-41ba-91af-8298a4f33747 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2218459d-078f-43be-b672-9fad7ae4ae46(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 11:55:14 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d2048a-cb7d-4236-90b8-120e5891789d]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:55:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-70524c28-48a9-41ba-91af-8298a4f33747 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2218459d-078f-43be-b672-9fad7ae4ae46 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:14 devstack sudo[99330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2218459d-078f-43be-b672-9fad7ae4ae46 Sep 28 11:55:14 devstack sudo[99330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:14 devstack sudo[99327]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9b4db866-2e23-4202-861d-5dbbc91c6f08 tempest-GroupSnapshotsTest-23458081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dc341f39-57a8-461f-8a1c-50a9d35f1a82.info" returned: 0 in 0.273s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:14 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-9b4db866-2e23-4202-861d-5dbbc91c6f08 tempest-GroupSnapshotsTest-23458081 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dc341f39-57a8-461f-8a1c-50a9d35f1a82.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 11:55:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9b4db866-2e23-4202-861d-5dbbc91c6f08 tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dc341f39-57a8-461f-8a1c-50a9d35f1a82.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:14 devstack sudo[99333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dc341f39-57a8-461f-8a1c-50a9d35f1a82.info Sep 28 11:55:14 devstack sudo[99333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:14 devstack sudo[99330]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-70524c28-48a9-41ba-91af-8298a4f33747 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2218459d-078f-43be-b672-9fad7ae4ae46" returned: 0 in 0.377s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-70524c28-48a9-41ba-91af-8298a4f33747 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2218459d-078f-43be-b672-9fad7ae4ae46.2c921ac3-f941-425c-aa09-43922d1986bd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:14 devstack sudo[99338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2218459d-078f-43be-b672-9fad7ae4ae46.2c921ac3-f941-425c-aa09-43922d1986bd Sep 28 11:55:14 devstack sudo[99338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:14 devstack sudo[99333]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9b4db866-2e23-4202-861d-5dbbc91c6f08 tempest-GroupSnapshotsTest-23458081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dc341f39-57a8-461f-8a1c-50a9d35f1a82.info" returned: 0 in 0.291s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9b4db866-2e23-4202-861d-5dbbc91c6f08 tempest-GroupSnapshotsTest-23458081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.026s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:55:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9b4db866-2e23-4202-861d-5dbbc91c6f08 tempest-GroupSnapshotsTest-23458081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:55:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9b4db866-2e23-4202-861d-5dbbc91c6f08 tempest-GroupSnapshotsTest-23458081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:55:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-9b4db866-2e23-4202-861d-5dbbc91c6f08 tempest-GroupSnapshotsTest-23458081 None] Creating offline snapshot cccd1f1c-3f8e-4822-8a62-c5869deb48a7 of volume 40358297-bb63-435c-a587-b4a9d03126e6 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 11:55:15 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80d542e-7c7a-410b-a83a-ee3857ccbbbf]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:55:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9b4db866-2e23-4202-861d-5dbbc91c6f08 tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-40358297-bb63-435c-a587-b4a9d03126e6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:15 devstack sudo[99341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-40358297-bb63-435c-a587-b4a9d03126e6 Sep 28 11:55:15 devstack sudo[99341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:15 devstack sudo[99338]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-70524c28-48a9-41ba-91af-8298a4f33747 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2218459d-078f-43be-b672-9fad7ae4ae46.2c921ac3-f941-425c-aa09-43922d1986bd" returned: 0 in 0.339s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-70524c28-48a9-41ba-91af-8298a4f33747 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2218459d-078f-43be-b672-9fad7ae4ae46.2c921ac3-f941-425c-aa09-43922d1986bd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:15 devstack sudo[99346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2218459d-078f-43be-b672-9fad7ae4ae46.2c921ac3-f941-425c-aa09-43922d1986bd Sep 28 11:55:15 devstack sudo[99346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:15 devstack sudo[99341]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9b4db866-2e23-4202-861d-5dbbc91c6f08 tempest-GroupSnapshotsTest-23458081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-40358297-bb63-435c-a587-b4a9d03126e6" returned: 0 in 0.390s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9b4db866-2e23-4202-861d-5dbbc91c6f08 tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-40358297-bb63-435c-a587-b4a9d03126e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-40358297-bb63-435c-a587-b4a9d03126e6.cccd1f1c-3f8e-4822-8a62-c5869deb48a7 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:15 devstack sudo[99352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-40358297-bb63-435c-a587-b4a9d03126e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-40358297-bb63-435c-a587-b4a9d03126e6.cccd1f1c-3f8e-4822-8a62-c5869deb48a7 1G Sep 28 11:55:15 devstack sudo[99352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:15 devstack sudo[99346]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-70524c28-48a9-41ba-91af-8298a4f33747 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2218459d-078f-43be-b672-9fad7ae4ae46.2c921ac3-f941-425c-aa09-43922d1986bd" returned: 0 in 0.252s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-70524c28-48a9-41ba-91af-8298a4f33747 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Lock "cinder-quobyte-2c921ac3-f941-425c-aa09-43922d1986bd" released by "_delete_snapshot" :: held 1.515s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:55:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-70524c28-48a9-41ba-91af-8298a4f33747 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Lock "cinder-quobyte-2218459d-078f-43be-b672-9fad7ae4ae46" released by "delete_snapshot" :: held 1.538s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:55:15 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-70524c28-48a9-41ba-91af-8298a4f33747 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Created reservations ['f70da700-d278-488b-a947-77a0dc7545b0', 'e318ee0b-4ea0-4f4b-8d6e-852b7440b366', 'd2a17684-993f-4df4-9d72-7de9f5f864cb', 'da6ec302-b68c-4a23-9a6b-54a353625038'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:55:15 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-70524c28-48a9-41ba-91af-8298a4f33747 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Delete snapshot completed successfully. Sep 28 11:55:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-70524c28-48a9-41ba-91af-8298a4f33747 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Lock "cinder-2c921ac3-f941-425c-aa09-43922d1986bd-delete_snapshot" released by "delete_snapshot" :: held 1.690s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:55:15 devstack sudo[99352]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9b4db866-2e23-4202-861d-5dbbc91c6f08 tempest-GroupSnapshotsTest-23458081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-40358297-bb63-435c-a587-b4a9d03126e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-40358297-bb63-435c-a587-b4a9d03126e6.cccd1f1c-3f8e-4822-8a62-c5869deb48a7 1G" returned: 0 in 0.426s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9b4db866-2e23-4202-861d-5dbbc91c6f08 tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40358297-bb63-435c-a587-b4a9d03126e6 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-40358297-bb63-435c-a587-b4a9d03126e6.cccd1f1c-3f8e-4822-8a62-c5869deb48a7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:15 devstack sudo[99363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40358297-bb63-435c-a587-b4a9d03126e6 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-40358297-bb63-435c-a587-b4a9d03126e6.cccd1f1c-3f8e-4822-8a62-c5869deb48a7 Sep 28 11:55:15 devstack sudo[99363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:16 devstack sudo[99363]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9b4db866-2e23-4202-861d-5dbbc91c6f08 tempest-GroupSnapshotsTest-23458081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40358297-bb63-435c-a587-b4a9d03126e6 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-40358297-bb63-435c-a587-b4a9d03126e6.cccd1f1c-3f8e-4822-8a62-c5869deb48a7" returned: 0 in 0.318s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:16 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-9b4db866-2e23-4202-861d-5dbbc91c6f08 tempest-GroupSnapshotsTest-23458081 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-40358297-bb63-435c-a587-b4a9d03126e6.cccd1f1c-3f8e-4822-8a62-c5869deb48a7 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 11:55:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9b4db866-2e23-4202-861d-5dbbc91c6f08 tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-40358297-bb63-435c-a587-b4a9d03126e6.cccd1f1c-3f8e-4822-8a62-c5869deb48a7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-083c97c7-7f60-44cd-8c6e-df04477d8bc3 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Acquiring lock "cinder-2218459d-078f-43be-b672-9fad7ae4ae46-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:55:16 devstack sudo[99368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-40358297-bb63-435c-a587-b4a9d03126e6.cccd1f1c-3f8e-4822-8a62-c5869deb48a7 Sep 28 11:55:16 devstack sudo[99368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-083c97c7-7f60-44cd-8c6e-df04477d8bc3 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Lock "cinder-2218459d-078f-43be-b672-9fad7ae4ae46-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:55:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-083c97c7-7f60-44cd-8c6e-df04477d8bc3 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Acquiring lock "cinder-quobyte-2218459d-078f-43be-b672-9fad7ae4ae46" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:55:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-083c97c7-7f60-44cd-8c6e-df04477d8bc3 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Lock "cinder-quobyte-2218459d-078f-43be-b672-9fad7ae4ae46" acquired by "delete_volume" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:55:16 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[5367963c-da30-40d0-bb54-8e730b643853]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:55:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-083c97c7-7f60-44cd-8c6e-df04477d8bc3 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2218459d-078f-43be-b672-9fad7ae4ae46 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:16 devstack sudo[99370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2218459d-078f-43be-b672-9fad7ae4ae46 Sep 28 11:55:16 devstack sudo[99370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:16 devstack sudo[99368]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9b4db866-2e23-4202-861d-5dbbc91c6f08 tempest-GroupSnapshotsTest-23458081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-40358297-bb63-435c-a587-b4a9d03126e6.cccd1f1c-3f8e-4822-8a62-c5869deb48a7" returned: 0 in 0.268s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9b4db866-2e23-4202-861d-5dbbc91c6f08 tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-40358297-bb63-435c-a587-b4a9d03126e6.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:16 devstack sudo[99373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-40358297-bb63-435c-a587-b4a9d03126e6.info Sep 28 11:55:16 devstack sudo[99373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:16 devstack sudo[99370]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-083c97c7-7f60-44cd-8c6e-df04477d8bc3 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2218459d-078f-43be-b672-9fad7ae4ae46" returned: 0 in 0.405s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-083c97c7-7f60-44cd-8c6e-df04477d8bc3 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2218459d-078f-43be-b672-9fad7ae4ae46 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:16 devstack sudo[99373]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9b4db866-2e23-4202-861d-5dbbc91c6f08 tempest-GroupSnapshotsTest-23458081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-40358297-bb63-435c-a587-b4a9d03126e6.info" returned: 0 in 0.279s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:16 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-9b4db866-2e23-4202-861d-5dbbc91c6f08 tempest-GroupSnapshotsTest-23458081 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-40358297-bb63-435c-a587-b4a9d03126e6.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 11:55:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9b4db866-2e23-4202-861d-5dbbc91c6f08 tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-40358297-bb63-435c-a587-b4a9d03126e6.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:16 devstack sudo[99379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2218459d-078f-43be-b672-9fad7ae4ae46 Sep 28 11:55:16 devstack sudo[99379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:16 devstack sudo[99381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-40358297-bb63-435c-a587-b4a9d03126e6.info Sep 28 11:55:16 devstack sudo[99381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:16 devstack sudo[99379]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-083c97c7-7f60-44cd-8c6e-df04477d8bc3 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2218459d-078f-43be-b672-9fad7ae4ae46" returned: 0 in 0.249s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-083c97c7-7f60-44cd-8c6e-df04477d8bc3 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Lock "cinder-quobyte-2218459d-078f-43be-b672-9fad7ae4ae46" released by "delete_volume" :: held 0.730s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:55:17 devstack sudo[99381]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9b4db866-2e23-4202-861d-5dbbc91c6f08 tempest-GroupSnapshotsTest-23458081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-40358297-bb63-435c-a587-b4a9d03126e6.info" returned: 0 in 0.258s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9b4db866-2e23-4202-861d-5dbbc91c6f08 tempest-GroupSnapshotsTest-23458081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.042s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:55:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-e2c07e35-2a5d-46bb-85c2-8518f41bda53 req-8ac296ed-2b32-4ea0-94e0-60f99e8b6c44 tempest-AttachVolumeTestJSON-1340154457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.970s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:55:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-e2c07e35-2a5d-46bb-85c2-8518f41bda53 req-8ac296ed-2b32-4ea0-94e0-60f99e8b6c44 tempest-AttachVolumeTestJSON-1340154457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:55:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-e2c07e35-2a5d-46bb-85c2-8518f41bda53 req-8ac296ed-2b32-4ea0-94e0-60f99e8b6c44 tempest-AttachVolumeTestJSON-1340154457 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0', 'name': 'volume-caed743e-05ed-4a75-96ae-c872e66fa2cb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd8d4defd-a68f-47f4-8737-bfa3d6b1786c', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 11:55:17 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-083c97c7-7f60-44cd-8c6e-df04477d8bc3 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Created reservations ['84d8bff7-edf5-4052-aadf-b0833d42b90a', '4876dc5b-bcbe-4f83-90cc-9cf551f34be8', '3b2002a6-8dd2-4ea9-85dd-790a64d6cd42', 'ce9bda06-dee4-4a17-bca6-9eb0488934cd'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:55:17 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-e2c07e35-2a5d-46bb-85c2-8518f41bda53 req-8ac296ed-2b32-4ea0-94e0-60f99e8b6c44 tempest-AttachVolumeTestJSON-1340154457 None] attachment_update completed successfully. Sep 28 11:55:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-083c97c7-7f60-44cd-8c6e-df04477d8bc3 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:55:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-083c97c7-7f60-44cd-8c6e-df04477d8bc3 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:55:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-083c97c7-7f60-44cd-8c6e-df04477d8bc3 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:55:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-083c97c7-7f60-44cd-8c6e-df04477d8bc3 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:55:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-083c97c7-7f60-44cd-8c6e-df04477d8bc3 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:55:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-083c97c7-7f60-44cd-8c6e-df04477d8bc3 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:17 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-9b4db866-2e23-4202-861d-5dbbc91c6f08 tempest-GroupSnapshotsTest-23458081 None] group_snapshot ecc99dcd-1efa-41ab-92ee-f8e480f7bfdc: created successfully Sep 28 11:55:17 devstack sudo[99385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:55:17 devstack sudo[99385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:17 devstack sudo[99385]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-083c97c7-7f60-44cd-8c6e-df04477d8bc3 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.323s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:17 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-083c97c7-7f60-44cd-8c6e-df04477d8bc3 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:55:17 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-083c97c7-7f60-44cd-8c6e-df04477d8bc3 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Deleted volume successfully. Sep 28 11:55:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-083c97c7-7f60-44cd-8c6e-df04477d8bc3 tempest-VolumesSnapshotNegativeTestJSON-1285476940 None] Lock "cinder-2218459d-078f-43be-b672-9fad7ae4ae46-delete_volume" released by "delete_volume" :: held 1.429s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:55:18 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-827c2e52-2725-4e92-af5c-46f94ad62ea7 tempest-GroupSnapshotsTest-23458081 None] group_snapshot ecc99dcd-1efa-41ab-92ee-f8e480f7bfdc: deleting Sep 28 11:55:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-827c2e52-2725-4e92-af5c-46f94ad62ea7 tempest-GroupSnapshotsTest-23458081 None] group_snapshot ecc99dcd-1efa-41ab-92ee-f8e480f7bfdc: deleting {{(pid=86916) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 11:55:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-827c2e52-2725-4e92-af5c-46f94ad62ea7 tempest-GroupSnapshotsTest-23458081 None] Acquiring lock "cinder-quobyte-dc341f39-57a8-461f-8a1c-50a9d35f1a82" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:55:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-827c2e52-2725-4e92-af5c-46f94ad62ea7 tempest-GroupSnapshotsTest-23458081 None] Lock "cinder-quobyte-dc341f39-57a8-461f-8a1c-50a9d35f1a82" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:55:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-827c2e52-2725-4e92-af5c-46f94ad62ea7 tempest-GroupSnapshotsTest-23458081 None] Acquiring lock "cinder-quobyte-95d7cf8d-01f2-45c0-bae4-24a998f405ad" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:55:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-827c2e52-2725-4e92-af5c-46f94ad62ea7 tempest-GroupSnapshotsTest-23458081 None] Lock "cinder-quobyte-95d7cf8d-01f2-45c0-bae4-24a998f405ad" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:55:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-827c2e52-2725-4e92-af5c-46f94ad62ea7 tempest-GroupSnapshotsTest-23458081 None] Deleting offline snapshot 95d7cf8d-01f2-45c0-bae4-24a998f405ad of volume dc341f39-57a8-461f-8a1c-50a9d35f1a82 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 11:55:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-827c2e52-2725-4e92-af5c-46f94ad62ea7 tempest-GroupSnapshotsTest-23458081 None] snapshot_file for this snap is: volume-dc341f39-57a8-461f-8a1c-50a9d35f1a82.95d7cf8d-01f2-45c0-bae4-24a998f405ad {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 11:55:18 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[0caff5c5-8fa0-4c5a-b60a-ce4dc1d612ec]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:55:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-827c2e52-2725-4e92-af5c-46f94ad62ea7 tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dc341f39-57a8-461f-8a1c-50a9d35f1a82.95d7cf8d-01f2-45c0-bae4-24a998f405ad {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:18 devstack sudo[99393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dc341f39-57a8-461f-8a1c-50a9d35f1a82.95d7cf8d-01f2-45c0-bae4-24a998f405ad Sep 28 11:55:18 devstack sudo[99393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:18 devstack sudo[99393]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-827c2e52-2725-4e92-af5c-46f94ad62ea7 tempest-GroupSnapshotsTest-23458081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dc341f39-57a8-461f-8a1c-50a9d35f1a82.95d7cf8d-01f2-45c0-bae4-24a998f405ad" returned: 0 in 0.412s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-827c2e52-2725-4e92-af5c-46f94ad62ea7 tempest-GroupSnapshotsTest-23458081 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc341f39-57a8-461f-8a1c-50a9d35f1a82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 11:55:19 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[437256ac-3523-41d3-b452-c7720509cb28]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:55:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-827c2e52-2725-4e92-af5c-46f94ad62ea7 tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dc341f39-57a8-461f-8a1c-50a9d35f1a82 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:19 devstack sudo[99398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dc341f39-57a8-461f-8a1c-50a9d35f1a82 Sep 28 11:55:19 devstack sudo[99398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:19 devstack sudo[99398]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-827c2e52-2725-4e92-af5c-46f94ad62ea7 tempest-GroupSnapshotsTest-23458081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dc341f39-57a8-461f-8a1c-50a9d35f1a82" returned: 0 in 0.436s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-827c2e52-2725-4e92-af5c-46f94ad62ea7 tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dc341f39-57a8-461f-8a1c-50a9d35f1a82.95d7cf8d-01f2-45c0-bae4-24a998f405ad {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:19 devstack sudo[99405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dc341f39-57a8-461f-8a1c-50a9d35f1a82.95d7cf8d-01f2-45c0-bae4-24a998f405ad Sep 28 11:55:19 devstack sudo[99405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:19 devstack sudo[99405]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-827c2e52-2725-4e92-af5c-46f94ad62ea7 tempest-GroupSnapshotsTest-23458081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dc341f39-57a8-461f-8a1c-50a9d35f1a82.95d7cf8d-01f2-45c0-bae4-24a998f405ad" returned: 0 in 0.429s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-827c2e52-2725-4e92-af5c-46f94ad62ea7 tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dc341f39-57a8-461f-8a1c-50a9d35f1a82.95d7cf8d-01f2-45c0-bae4-24a998f405ad {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:19 devstack sudo[99411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dc341f39-57a8-461f-8a1c-50a9d35f1a82.95d7cf8d-01f2-45c0-bae4-24a998f405ad Sep 28 11:55:19 devstack sudo[99411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:20 devstack sudo[99411]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-827c2e52-2725-4e92-af5c-46f94ad62ea7 tempest-GroupSnapshotsTest-23458081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dc341f39-57a8-461f-8a1c-50a9d35f1a82.95d7cf8d-01f2-45c0-bae4-24a998f405ad" returned: 0 in 0.279s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-827c2e52-2725-4e92-af5c-46f94ad62ea7 tempest-GroupSnapshotsTest-23458081 None] Lock "cinder-quobyte-95d7cf8d-01f2-45c0-bae4-24a998f405ad" released by "_delete_snapshot" :: held 1.716s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:55:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-827c2e52-2725-4e92-af5c-46f94ad62ea7 tempest-GroupSnapshotsTest-23458081 None] Lock "cinder-quobyte-dc341f39-57a8-461f-8a1c-50a9d35f1a82" released by "delete_snapshot" :: held 1.744s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:55:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-827c2e52-2725-4e92-af5c-46f94ad62ea7 tempest-GroupSnapshotsTest-23458081 None] Acquiring lock "cinder-quobyte-40358297-bb63-435c-a587-b4a9d03126e6" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:55:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-827c2e52-2725-4e92-af5c-46f94ad62ea7 tempest-GroupSnapshotsTest-23458081 None] Lock "cinder-quobyte-40358297-bb63-435c-a587-b4a9d03126e6" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:55:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-827c2e52-2725-4e92-af5c-46f94ad62ea7 tempest-GroupSnapshotsTest-23458081 None] Acquiring lock "cinder-quobyte-cccd1f1c-3f8e-4822-8a62-c5869deb48a7" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:55:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-827c2e52-2725-4e92-af5c-46f94ad62ea7 tempest-GroupSnapshotsTest-23458081 None] Lock "cinder-quobyte-cccd1f1c-3f8e-4822-8a62-c5869deb48a7" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:55:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-827c2e52-2725-4e92-af5c-46f94ad62ea7 tempest-GroupSnapshotsTest-23458081 None] Deleting offline snapshot cccd1f1c-3f8e-4822-8a62-c5869deb48a7 of volume 40358297-bb63-435c-a587-b4a9d03126e6 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 11:55:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-827c2e52-2725-4e92-af5c-46f94ad62ea7 tempest-GroupSnapshotsTest-23458081 None] snapshot_file for this snap is: volume-40358297-bb63-435c-a587-b4a9d03126e6.cccd1f1c-3f8e-4822-8a62-c5869deb48a7 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 11:55:20 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddff8487-7461-4134-9beb-8527e18c8285]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:55:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-827c2e52-2725-4e92-af5c-46f94ad62ea7 tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-40358297-bb63-435c-a587-b4a9d03126e6.cccd1f1c-3f8e-4822-8a62-c5869deb48a7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:20 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-a0e5c95d-972c-49d9-9d0a-6bb173326822 req-1a1bd530-207b-40bb-ad93-13769f8d2517 tempest-AttachVolumeTestJSON-1340154457 None] Terminate volume connection completed successfully. Sep 28 11:55:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-a0e5c95d-972c-49d9-9d0a-6bb173326822 req-1a1bd530-207b-40bb-ad93-13769f8d2517 tempest-AttachVolumeTestJSON-1340154457 None] Deleting attachment 5d214186-67c6-4238-b117-78e5e965212d. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 11:55:20 devstack sudo[99418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-40358297-bb63-435c-a587-b4a9d03126e6.cccd1f1c-3f8e-4822-8a62-c5869deb48a7 Sep 28 11:55:20 devstack sudo[99418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:20 devstack sudo[99418]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-827c2e52-2725-4e92-af5c-46f94ad62ea7 tempest-GroupSnapshotsTest-23458081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-40358297-bb63-435c-a587-b4a9d03126e6.cccd1f1c-3f8e-4822-8a62-c5869deb48a7" returned: 0 in 0.443s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-827c2e52-2725-4e92-af5c-46f94ad62ea7 tempest-GroupSnapshotsTest-23458081 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40358297-bb63-435c-a587-b4a9d03126e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 11:55:20 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ea0c98-7e52-4777-9249-5425150f6f2c]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:55:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-827c2e52-2725-4e92-af5c-46f94ad62ea7 tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-40358297-bb63-435c-a587-b4a9d03126e6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:20 devstack sudo[99425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-40358297-bb63-435c-a587-b4a9d03126e6 Sep 28 11:55:20 devstack sudo[99425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:21 devstack sudo[99425]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-827c2e52-2725-4e92-af5c-46f94ad62ea7 tempest-GroupSnapshotsTest-23458081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-40358297-bb63-435c-a587-b4a9d03126e6" returned: 0 in 0.441s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-827c2e52-2725-4e92-af5c-46f94ad62ea7 tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-40358297-bb63-435c-a587-b4a9d03126e6.cccd1f1c-3f8e-4822-8a62-c5869deb48a7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:21 devstack sudo[99430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-40358297-bb63-435c-a587-b4a9d03126e6.cccd1f1c-3f8e-4822-8a62-c5869deb48a7 Sep 28 11:55:21 devstack sudo[99430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:21 devstack sudo[99430]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-827c2e52-2725-4e92-af5c-46f94ad62ea7 tempest-GroupSnapshotsTest-23458081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-40358297-bb63-435c-a587-b4a9d03126e6.cccd1f1c-3f8e-4822-8a62-c5869deb48a7" returned: 0 in 0.474s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-827c2e52-2725-4e92-af5c-46f94ad62ea7 tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-40358297-bb63-435c-a587-b4a9d03126e6.cccd1f1c-3f8e-4822-8a62-c5869deb48a7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:21 devstack sudo[99439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-40358297-bb63-435c-a587-b4a9d03126e6.cccd1f1c-3f8e-4822-8a62-c5869deb48a7 Sep 28 11:55:21 devstack sudo[99439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:21 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-e415aa1a-9183-4330-85b6-3a2995259588 req-9177200f-195f-407a-90f7-48f877ac014c tempest-AttachVolumeTestJSON-1340154457 None] Terminate volume connection completed successfully. Sep 28 11:55:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-e415aa1a-9183-4330-85b6-3a2995259588 req-9177200f-195f-407a-90f7-48f877ac014c tempest-AttachVolumeTestJSON-1340154457 None] Deleting attachment d8d4defd-a68f-47f4-8737-bfa3d6b1786c. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 11:55:22 devstack sudo[99439]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-827c2e52-2725-4e92-af5c-46f94ad62ea7 tempest-GroupSnapshotsTest-23458081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-40358297-bb63-435c-a587-b4a9d03126e6.cccd1f1c-3f8e-4822-8a62-c5869deb48a7" returned: 0 in 0.303s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-827c2e52-2725-4e92-af5c-46f94ad62ea7 tempest-GroupSnapshotsTest-23458081 None] Lock "cinder-quobyte-cccd1f1c-3f8e-4822-8a62-c5869deb48a7" released by "_delete_snapshot" :: held 1.809s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:55:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-827c2e52-2725-4e92-af5c-46f94ad62ea7 tempest-GroupSnapshotsTest-23458081 None] Lock "cinder-quobyte-40358297-bb63-435c-a587-b4a9d03126e6" released by "delete_snapshot" :: held 1.833s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:55:22 devstack cinder-volume[86916]: WARNING cinder.quota [None req-827c2e52-2725-4e92-af5c-46f94ad62ea7 tempest-GroupSnapshotsTest-23458081 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-390422286 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-390422286, it is now deprecated. Please use the default quota class for default quota. Sep 28 11:55:22 devstack cinder-volume[86916]: WARNING cinder.quota [None req-827c2e52-2725-4e92-af5c-46f94ad62ea7 tempest-GroupSnapshotsTest-23458081 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-390422286 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-390422286, it is now deprecated. Please use the default quota class for default quota. Sep 28 11:55:22 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-827c2e52-2725-4e92-af5c-46f94ad62ea7 tempest-GroupSnapshotsTest-23458081 None] Created reservations ['a60fec4e-dce1-4362-9a2e-5f97de42bc45', 'ac9e4b4c-406a-4de2-bb27-8b237d401845', 'a38f00f4-86f7-447c-8475-c330f65e03b6', 'c3660374-40e7-42d7-9c81-4cd2b1494c9e'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:55:22 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-827c2e52-2725-4e92-af5c-46f94ad62ea7 tempest-GroupSnapshotsTest-23458081 None] Created reservations ['4164f890-4a92-4c72-97f9-a44d6367be2d', 'fbf3cb3e-f575-48f1-a27c-d1a79fbcf779', 'de9fa662-179c-4b1e-bf56-645854cbf04e', '2f82a428-6942-4141-8664-31e1849fd24a'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:55:22 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-827c2e52-2725-4e92-af5c-46f94ad62ea7 tempest-GroupSnapshotsTest-23458081 None] group_snapshot ecc99dcd-1efa-41ab-92ee-f8e480f7bfdc: deleted successfully Sep 28 11:55:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2b43b4e1-aba9-4521-9dea-f3b791a87a95 tempest-GroupSnapshotsTest-23458081 None] Acquiring lock "cinder-quobyte-40358297-bb63-435c-a587-b4a9d03126e6" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:55:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2b43b4e1-aba9-4521-9dea-f3b791a87a95 tempest-GroupSnapshotsTest-23458081 None] Lock "cinder-quobyte-40358297-bb63-435c-a587-b4a9d03126e6" acquired by "delete_volume" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:55:23 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5189c1-a551-432a-93e6-c7557284023c]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:55:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2b43b4e1-aba9-4521-9dea-f3b791a87a95 tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-40358297-bb63-435c-a587-b4a9d03126e6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:23 devstack sudo[99476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-40358297-bb63-435c-a587-b4a9d03126e6 Sep 28 11:55:23 devstack sudo[99476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:24 devstack sudo[99476]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2b43b4e1-aba9-4521-9dea-f3b791a87a95 tempest-GroupSnapshotsTest-23458081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-40358297-bb63-435c-a587-b4a9d03126e6" returned: 0 in 0.679s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2b43b4e1-aba9-4521-9dea-f3b791a87a95 tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-40358297-bb63-435c-a587-b4a9d03126e6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:24 devstack sudo[99497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-40358297-bb63-435c-a587-b4a9d03126e6 Sep 28 11:55:24 devstack sudo[99497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:24 devstack sudo[99497]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2b43b4e1-aba9-4521-9dea-f3b791a87a95 tempest-GroupSnapshotsTest-23458081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-40358297-bb63-435c-a587-b4a9d03126e6" returned: 0 in 0.302s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2b43b4e1-aba9-4521-9dea-f3b791a87a95 tempest-GroupSnapshotsTest-23458081 None] Lock "cinder-quobyte-40358297-bb63-435c-a587-b4a9d03126e6" released by "delete_volume" :: held 1.083s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:55:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2b43b4e1-aba9-4521-9dea-f3b791a87a95 tempest-GroupSnapshotsTest-23458081 None] Acquiring lock "cinder-quobyte-dc341f39-57a8-461f-8a1c-50a9d35f1a82" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:55:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2b43b4e1-aba9-4521-9dea-f3b791a87a95 tempest-GroupSnapshotsTest-23458081 None] Lock "cinder-quobyte-dc341f39-57a8-461f-8a1c-50a9d35f1a82" acquired by "delete_volume" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:55:24 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[897dbf8d-3a75-4441-b039-2e183f261a75]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:55:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2b43b4e1-aba9-4521-9dea-f3b791a87a95 tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dc341f39-57a8-461f-8a1c-50a9d35f1a82 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:24 devstack sudo[99500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dc341f39-57a8-461f-8a1c-50a9d35f1a82 Sep 28 11:55:24 devstack sudo[99500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:25 devstack sudo[99500]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2b43b4e1-aba9-4521-9dea-f3b791a87a95 tempest-GroupSnapshotsTest-23458081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dc341f39-57a8-461f-8a1c-50a9d35f1a82" returned: 0 in 0.449s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2b43b4e1-aba9-4521-9dea-f3b791a87a95 tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dc341f39-57a8-461f-8a1c-50a9d35f1a82 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:25 devstack sudo[99506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dc341f39-57a8-461f-8a1c-50a9d35f1a82 Sep 28 11:55:25 devstack sudo[99506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:25 devstack sudo[99506]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2b43b4e1-aba9-4521-9dea-f3b791a87a95 tempest-GroupSnapshotsTest-23458081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dc341f39-57a8-461f-8a1c-50a9d35f1a82" returned: 0 in 0.279s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2b43b4e1-aba9-4521-9dea-f3b791a87a95 tempest-GroupSnapshotsTest-23458081 None] Lock "cinder-quobyte-dc341f39-57a8-461f-8a1c-50a9d35f1a82" released by "delete_volume" :: held 0.833s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:55:25 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-2b43b4e1-aba9-4521-9dea-f3b791a87a95 tempest-GroupSnapshotsTest-23458081 None] Created reservations ['c785ac99-227e-4a2c-8b98-4d59e75264b6'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:55:25 devstack cinder-volume[86916]: WARNING cinder.quota [None req-2b43b4e1-aba9-4521-9dea-f3b791a87a95 tempest-GroupSnapshotsTest-23458081 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-390422286 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-390422286, it is now deprecated. Please use the default quota class for default quota. Sep 28 11:55:25 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-2b43b4e1-aba9-4521-9dea-f3b791a87a95 tempest-GroupSnapshotsTest-23458081 None] Created reservations ['b81a206b-29dd-4dac-a1db-f4517b6f8b30', 'a0013424-b8db-4b81-a85e-4af8a64d6708', 'f8617daf-680c-46ad-8b28-8aa833fde26a', 'e3681b45-de91-47a4-9e7f-005ae6a21895'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:55:25 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-2b43b4e1-aba9-4521-9dea-f3b791a87a95 tempest-GroupSnapshotsTest-23458081 None] Created reservations ['31d5fa28-b044-4d7c-ad58-3c27387cd405', '8a1ce1ab-0b96-4d38-8676-5a6f97545b42', '9f1101ea-014c-48e9-b15a-7674e46687fc', '3e9d98b5-1724-4f58-8a64-43b2acd82b52'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:55:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2b43b4e1-aba9-4521-9dea-f3b791a87a95 tempest-GroupSnapshotsTest-23458081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:55:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2b43b4e1-aba9-4521-9dea-f3b791a87a95 tempest-GroupSnapshotsTest-23458081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:55:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2b43b4e1-aba9-4521-9dea-f3b791a87a95 tempest-GroupSnapshotsTest-23458081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:55:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2b43b4e1-aba9-4521-9dea-f3b791a87a95 tempest-GroupSnapshotsTest-23458081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:55:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2b43b4e1-aba9-4521-9dea-f3b791a87a95 tempest-GroupSnapshotsTest-23458081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:55:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2b43b4e1-aba9-4521-9dea-f3b791a87a95 tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:26 devstack sudo[99512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:55:26 devstack sudo[99512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:26 devstack sudo[99512]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2b43b4e1-aba9-4521-9dea-f3b791a87a95 tempest-GroupSnapshotsTest-23458081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.311s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:26 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-2b43b4e1-aba9-4521-9dea-f3b791a87a95 tempest-GroupSnapshotsTest-23458081 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:55:26 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-2b43b4e1-aba9-4521-9dea-f3b791a87a95 tempest-GroupSnapshotsTest-23458081 None] Delete group completed successfully. Sep 28 11:55:27 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-0b4d8349-db50-460c-8463-0f1e62283e7a tempest-GroupSnapshotsTest-23458081 None] Group tempest-GroupSnapshotsTest-Group-699276641: creating Sep 28 11:55:27 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-0b4d8349-db50-460c-8463-0f1e62283e7a tempest-GroupSnapshotsTest-23458081 None] Group tempest-GroupSnapshotsTest-Group-699276641: created successfully Sep 28 11:55:27 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-0b4d8349-db50-460c-8463-0f1e62283e7a tempest-GroupSnapshotsTest-23458081 None] Create group completed successfully. Sep 28 11:55:28 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8c31a176-0a16-4a79-bb16-509f67103882 tempest-AttachVolumeTestJSON-1340154457 None] Acquiring lock "cinder-caed743e-05ed-4a75-96ae-c872e66fa2cb-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:55:28 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8c31a176-0a16-4a79-bb16-509f67103882 tempest-AttachVolumeTestJSON-1340154457 None] Lock "cinder-caed743e-05ed-4a75-96ae-c872e66fa2cb-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:55:28 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8c31a176-0a16-4a79-bb16-509f67103882 tempest-AttachVolumeTestJSON-1340154457 None] Acquiring lock "cinder-quobyte-caed743e-05ed-4a75-96ae-c872e66fa2cb" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:55:28 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8c31a176-0a16-4a79-bb16-509f67103882 tempest-AttachVolumeTestJSON-1340154457 None] Lock "cinder-quobyte-caed743e-05ed-4a75-96ae-c872e66fa2cb" acquired by "delete_volume" :: waited 0.031s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:55:28 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5b3fed-552d-470c-baa3-28b5ba01d972]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:55:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8c31a176-0a16-4a79-bb16-509f67103882 tempest-AttachVolumeTestJSON-1340154457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-caed743e-05ed-4a75-96ae-c872e66fa2cb {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:29 devstack sudo[99515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-caed743e-05ed-4a75-96ae-c872e66fa2cb Sep 28 11:55:29 devstack sudo[99515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:29 devstack sudo[99515]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8c31a176-0a16-4a79-bb16-509f67103882 tempest-AttachVolumeTestJSON-1340154457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-caed743e-05ed-4a75-96ae-c872e66fa2cb" returned: 0 in 0.559s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8c31a176-0a16-4a79-bb16-509f67103882 tempest-AttachVolumeTestJSON-1340154457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-caed743e-05ed-4a75-96ae-c872e66fa2cb {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:29 devstack sudo[99520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-caed743e-05ed-4a75-96ae-c872e66fa2cb Sep 28 11:55:29 devstack sudo[99520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:29 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-47bdb96d-4ffe-4840-831d-1cf989976993 tempest-GroupSnapshotsTest-23458081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:55:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-47bdb96d-4ffe-4840-831d-1cf989976993 tempest-GroupSnapshotsTest-23458081 None] Flow 'volume_create_manager' (92575cef-557f-47f2-8eb4-faebea8ad956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:55:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-47bdb96d-4ffe-4840-831d-1cf989976993 tempest-GroupSnapshotsTest-23458081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c24a8ec9-4dce-459f-808f-53febe91baa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:55:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-47bdb96d-4ffe-4840-831d-1cf989976993 tempest-GroupSnapshotsTest-23458081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c24a8ec9-4dce-459f-808f-53febe91baa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:55:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1613766383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c815b660-88ae-435b-ae0a-fdc9638a0d33,host='devstack@QuobyteHD#QuobyteHD',id=d71c4fd1-5956-464a-9b59-275a90c79b2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a07ca7e03959469d880233b762aff5e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:55:29Z,use_quota=True,user_id='64f68e6fac7a438bb9698da7ee17003e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb56d6f-15fb-423e-ae7d-6cb0d4f5003e),volume_type_id=7eb56d6f-15fb-423e-ae7d-6cb0d4f5003e)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:55:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-47bdb96d-4ffe-4840-831d-1cf989976993 tempest-GroupSnapshotsTest-23458081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e9e5052-5002-4999-98bd-f773be20dbbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:55:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-47bdb96d-4ffe-4840-831d-1cf989976993 tempest-GroupSnapshotsTest-23458081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e9e5052-5002-4999-98bd-f773be20dbbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:55:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-47bdb96d-4ffe-4840-831d-1cf989976993 tempest-GroupSnapshotsTest-23458081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41823d2b-14ad-4e48-9bfc-705b4b912059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:55:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-47bdb96d-4ffe-4840-831d-1cf989976993 tempest-GroupSnapshotsTest-23458081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41823d2b-14ad-4e48-9bfc-705b4b912059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd71c4fd1-5956-464a-9b59-275a90c79b2f', 'volume_name': 'volume-d71c4fd1-5956-464a-9b59-275a90c79b2f', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:55:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-47bdb96d-4ffe-4840-831d-1cf989976993 tempest-GroupSnapshotsTest-23458081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90c0d076-3d8b-484b-a20d-f3e8e9eb2541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:55:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-47bdb96d-4ffe-4840-831d-1cf989976993 tempest-GroupSnapshotsTest-23458081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90c0d076-3d8b-484b-a20d-f3e8e9eb2541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:55:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-47bdb96d-4ffe-4840-831d-1cf989976993 tempest-GroupSnapshotsTest-23458081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bc5b5f8-3356-49df-a981-e5f80873034a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:55:29 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-47bdb96d-4ffe-4840-831d-1cf989976993 tempest-GroupSnapshotsTest-23458081 None] Volume d71c4fd1-5956-464a-9b59-275a90c79b2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d71c4fd1-5956-464a-9b59-275a90c79b2f', 'volume_size': 1} Sep 28 11:55:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-47bdb96d-4ffe-4840-831d-1cf989976993 tempest-GroupSnapshotsTest-23458081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:55:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-47bdb96d-4ffe-4840-831d-1cf989976993 tempest-GroupSnapshotsTest-23458081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:55:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-47bdb96d-4ffe-4840-831d-1cf989976993 tempest-GroupSnapshotsTest-23458081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c815b660-88ae-435b-ae0a-fdc9638a0d33,created_at=2026-09-28T09:55:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1613766383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c815b660-88ae-435b-ae0a-fdc9638a0d33,host='devstack@QuobyteHD#QuobyteHD',id=d71c4fd1-5956-464a-9b59-275a90c79b2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a07ca7e03959469d880233b762aff5e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:55:29Z,use_quota=True,user_id='64f68e6fac7a438bb9698da7ee17003e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb56d6f-15fb-423e-ae7d-6cb0d4f5003e),volume_type_id=7eb56d6f-15fb-423e-ae7d-6cb0d4f5003e)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:55:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-47bdb96d-4ffe-4840-831d-1cf989976993 tempest-GroupSnapshotsTest-23458081 None] Creating volume d71c4fd1-5956-464a-9b59-275a90c79b2f {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:55:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-47bdb96d-4ffe-4840-831d-1cf989976993 tempest-GroupSnapshotsTest-23458081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:55:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-47bdb96d-4ffe-4840-831d-1cf989976993 tempest-GroupSnapshotsTest-23458081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:55:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-47bdb96d-4ffe-4840-831d-1cf989976993 tempest-GroupSnapshotsTest-23458081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:55:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-47bdb96d-4ffe-4840-831d-1cf989976993 tempest-GroupSnapshotsTest-23458081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:55:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-47bdb96d-4ffe-4840-831d-1cf989976993 tempest-GroupSnapshotsTest-23458081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:55:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-47bdb96d-4ffe-4840-831d-1cf989976993 tempest-GroupSnapshotsTest-23458081 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:55:29 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-47bdb96d-4ffe-4840-831d-1cf989976993 tempest-GroupSnapshotsTest-23458081 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:55:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-47bdb96d-4ffe-4840-831d-1cf989976993 tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d71c4fd1-5956-464a-9b59-275a90c79b2f 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:29 devstack sudo[99522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d71c4fd1-5956-464a-9b59-275a90c79b2f 1073741824 Sep 28 11:55:29 devstack sudo[99522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:29 devstack sudo[99520]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8c31a176-0a16-4a79-bb16-509f67103882 tempest-AttachVolumeTestJSON-1340154457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-caed743e-05ed-4a75-96ae-c872e66fa2cb" returned: 0 in 0.337s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8c31a176-0a16-4a79-bb16-509f67103882 tempest-AttachVolumeTestJSON-1340154457 None] Lock "cinder-quobyte-caed743e-05ed-4a75-96ae-c872e66fa2cb" released by "delete_volume" :: held 1.009s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:55:29 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-8c31a176-0a16-4a79-bb16-509f67103882 tempest-AttachVolumeTestJSON-1340154457 None] Created reservations ['dc8cd05c-4bc5-4afe-929d-8bd5ebfbad05', 'fd75b367-05d6-46fa-a80d-20b71bc2e562', 'a357b764-2a88-4a21-b18e-88ffb6a03d6a', '42c0e6bd-cfb7-4bc7-8c67-1285b3a36167'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:55:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8c31a176-0a16-4a79-bb16-509f67103882 tempest-AttachVolumeTestJSON-1340154457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:55:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8c31a176-0a16-4a79-bb16-509f67103882 tempest-AttachVolumeTestJSON-1340154457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:55:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8c31a176-0a16-4a79-bb16-509f67103882 tempest-AttachVolumeTestJSON-1340154457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:55:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8c31a176-0a16-4a79-bb16-509f67103882 tempest-AttachVolumeTestJSON-1340154457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:55:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8c31a176-0a16-4a79-bb16-509f67103882 tempest-AttachVolumeTestJSON-1340154457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:55:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8c31a176-0a16-4a79-bb16-509f67103882 tempest-AttachVolumeTestJSON-1340154457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:30 devstack sudo[99529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:55:30 devstack sudo[99529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:30 devstack sudo[99522]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-47bdb96d-4ffe-4840-831d-1cf989976993 tempest-GroupSnapshotsTest-23458081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d71c4fd1-5956-464a-9b59-275a90c79b2f 1073741824" returned: 0 in 0.595s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-47bdb96d-4ffe-4840-831d-1cf989976993 tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d71c4fd1-5956-464a-9b59-275a90c79b2f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:30 devstack sudo[99533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d71c4fd1-5956-464a-9b59-275a90c79b2f Sep 28 11:55:30 devstack sudo[99533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:30 devstack sudo[99529]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8c31a176-0a16-4a79-bb16-509f67103882 tempest-AttachVolumeTestJSON-1340154457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.281s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:30 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-8c31a176-0a16-4a79-bb16-509f67103882 tempest-AttachVolumeTestJSON-1340154457 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:55:30 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-8c31a176-0a16-4a79-bb16-509f67103882 tempest-AttachVolumeTestJSON-1340154457 None] Deleted volume successfully. Sep 28 11:55:30 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8c31a176-0a16-4a79-bb16-509f67103882 tempest-AttachVolumeTestJSON-1340154457 None] Lock "cinder-caed743e-05ed-4a75-96ae-c872e66fa2cb-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:55:30 devstack sudo[99533]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-47bdb96d-4ffe-4840-831d-1cf989976993 tempest-GroupSnapshotsTest-23458081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d71c4fd1-5956-464a-9b59-275a90c79b2f" returned: 0 in 0.292s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-47bdb96d-4ffe-4840-831d-1cf989976993 tempest-GroupSnapshotsTest-23458081 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:55:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-47bdb96d-4ffe-4840-831d-1cf989976993 tempest-GroupSnapshotsTest-23458081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:55:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-47bdb96d-4ffe-4840-831d-1cf989976993 tempest-GroupSnapshotsTest-23458081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bc5b5f8-3356-49df-a981-e5f80873034a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d71c4fd1-5956-464a-9b59-275a90c79b2f', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:55:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-47bdb96d-4ffe-4840-831d-1cf989976993 tempest-GroupSnapshotsTest-23458081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbf27352-c4ae-4c81-a63e-0188ae329599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:55:30 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-47bdb96d-4ffe-4840-831d-1cf989976993 tempest-GroupSnapshotsTest-23458081 None] Volume volume-d71c4fd1-5956-464a-9b59-275a90c79b2f (d71c4fd1-5956-464a-9b59-275a90c79b2f): created successfully Sep 28 11:55:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-47bdb96d-4ffe-4840-831d-1cf989976993 tempest-GroupSnapshotsTest-23458081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbf27352-c4ae-4c81-a63e-0188ae329599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:55:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-47bdb96d-4ffe-4840-831d-1cf989976993 tempest-GroupSnapshotsTest-23458081 None] Flow 'volume_create_manager' (92575cef-557f-47f2-8eb4-faebea8ad956) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:55:30 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-47bdb96d-4ffe-4840-831d-1cf989976993 tempest-GroupSnapshotsTest-23458081 None] Created volume successfully. Sep 28 11:55:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5586172a-8c92-47a0-9ce3-cc046991944c tempest-AttachVolumeTestJSON-1340154457 None] Acquiring lock "cinder-63660747-ccb3-44a6-bbb8-1d77babc74f1-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:55:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5586172a-8c92-47a0-9ce3-cc046991944c tempest-AttachVolumeTestJSON-1340154457 None] Lock "cinder-63660747-ccb3-44a6-bbb8-1d77babc74f1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:55:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5586172a-8c92-47a0-9ce3-cc046991944c tempest-AttachVolumeTestJSON-1340154457 None] Acquiring lock "cinder-quobyte-63660747-ccb3-44a6-bbb8-1d77babc74f1" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:55:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5586172a-8c92-47a0-9ce3-cc046991944c tempest-AttachVolumeTestJSON-1340154457 None] Lock "cinder-quobyte-63660747-ccb3-44a6-bbb8-1d77babc74f1" acquired by "delete_volume" :: waited 0.023s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:55:31 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[3466163b-b017-44da-9596-acaf28189dfb]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:55:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5586172a-8c92-47a0-9ce3-cc046991944c tempest-AttachVolumeTestJSON-1340154457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-63660747-ccb3-44a6-bbb8-1d77babc74f1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:31 devstack sudo[99537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-63660747-ccb3-44a6-bbb8-1d77babc74f1 Sep 28 11:55:31 devstack sudo[99537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:31 devstack sudo[99537]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5586172a-8c92-47a0-9ce3-cc046991944c tempest-AttachVolumeTestJSON-1340154457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-63660747-ccb3-44a6-bbb8-1d77babc74f1" returned: 0 in 0.419s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5586172a-8c92-47a0-9ce3-cc046991944c tempest-AttachVolumeTestJSON-1340154457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-63660747-ccb3-44a6-bbb8-1d77babc74f1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:31 devstack sudo[99542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-63660747-ccb3-44a6-bbb8-1d77babc74f1 Sep 28 11:55:31 devstack sudo[99542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:31 devstack sudo[99542]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5586172a-8c92-47a0-9ce3-cc046991944c tempest-AttachVolumeTestJSON-1340154457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-63660747-ccb3-44a6-bbb8-1d77babc74f1" returned: 0 in 0.306s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5586172a-8c92-47a0-9ce3-cc046991944c tempest-AttachVolumeTestJSON-1340154457 None] Lock "cinder-quobyte-63660747-ccb3-44a6-bbb8-1d77babc74f1" released by "delete_volume" :: held 0.780s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:55:32 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-5586172a-8c92-47a0-9ce3-cc046991944c tempest-AttachVolumeTestJSON-1340154457 None] Created reservations ['7832f85c-3f87-470d-8448-c002f15df3e0', 'd29a2471-7575-4400-9bba-4faa65a3d8a4', '1d942db8-3ce9-41ea-ad2d-25c198ec781d', 'dc8c04f6-b7b5-4240-a1d9-16cc758f5649'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:55:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5586172a-8c92-47a0-9ce3-cc046991944c tempest-AttachVolumeTestJSON-1340154457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:55:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5586172a-8c92-47a0-9ce3-cc046991944c tempest-AttachVolumeTestJSON-1340154457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:55:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5586172a-8c92-47a0-9ce3-cc046991944c tempest-AttachVolumeTestJSON-1340154457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:55:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5586172a-8c92-47a0-9ce3-cc046991944c tempest-AttachVolumeTestJSON-1340154457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:55:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5586172a-8c92-47a0-9ce3-cc046991944c tempest-AttachVolumeTestJSON-1340154457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:55:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5586172a-8c92-47a0-9ce3-cc046991944c tempest-AttachVolumeTestJSON-1340154457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:32 devstack sudo[99545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:55:32 devstack sudo[99545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:32 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b6385845-6395-42c4-8872-b74ba7893cf6 tempest-GroupSnapshotsTest-23458081 None] GroupSnapshot 60318933-9cb3-4e70-9876-80afde1cc214: creating. Sep 28 11:55:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b6385845-6395-42c4-8872-b74ba7893cf6 tempest-GroupSnapshotsTest-23458081 None] Group snapshot 60318933-9cb3-4e70-9876-80afde1cc214: creating. {{(pid=86916) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 11:55:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b6385845-6395-42c4-8872-b74ba7893cf6 tempest-GroupSnapshotsTest-23458081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:55:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b6385845-6395-42c4-8872-b74ba7893cf6 tempest-GroupSnapshotsTest-23458081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:55:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-b6385845-6395-42c4-8872-b74ba7893cf6 tempest-GroupSnapshotsTest-23458081 None] Creating offline snapshot bd86cbe0-be6b-4992-9714-b002fe13bfae of volume d71c4fd1-5956-464a-9b59-275a90c79b2f {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 11:55:32 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[71416815-a387-457d-b7d1-4be46f353efc]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:55:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b6385845-6395-42c4-8872-b74ba7893cf6 tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d71c4fd1-5956-464a-9b59-275a90c79b2f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f1e3885c-3d10-4c66-b898-5d211a654a08 tempest-AttachVolumeTestJSON-1340154457 None] Acquiring lock "cinder-834a030d-15df-4cf0-b8c7-1f809e9d9333-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:55:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f1e3885c-3d10-4c66-b898-5d211a654a08 tempest-AttachVolumeTestJSON-1340154457 None] Lock "cinder-834a030d-15df-4cf0-b8c7-1f809e9d9333-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:55:32 devstack sudo[99545]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5586172a-8c92-47a0-9ce3-cc046991944c tempest-AttachVolumeTestJSON-1340154457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.346s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:32 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-5586172a-8c92-47a0-9ce3-cc046991944c tempest-AttachVolumeTestJSON-1340154457 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:55:32 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-5586172a-8c92-47a0-9ce3-cc046991944c tempest-AttachVolumeTestJSON-1340154457 None] Deleted volume successfully. Sep 28 11:55:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5586172a-8c92-47a0-9ce3-cc046991944c tempest-AttachVolumeTestJSON-1340154457 None] Lock "cinder-63660747-ccb3-44a6-bbb8-1d77babc74f1-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:55:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f1e3885c-3d10-4c66-b898-5d211a654a08 tempest-AttachVolumeTestJSON-1340154457 None] Acquiring lock "cinder-quobyte-834a030d-15df-4cf0-b8c7-1f809e9d9333" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:55:32 devstack sudo[99547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d71c4fd1-5956-464a-9b59-275a90c79b2f Sep 28 11:55:32 devstack sudo[99547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f1e3885c-3d10-4c66-b898-5d211a654a08 tempest-AttachVolumeTestJSON-1340154457 None] Lock "cinder-quobyte-834a030d-15df-4cf0-b8c7-1f809e9d9333" acquired by "delete_volume" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:55:32 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1af4466-cc19-47e1-bd42-5bd8f37ad9d0]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:55:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f1e3885c-3d10-4c66-b898-5d211a654a08 tempest-AttachVolumeTestJSON-1340154457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-834a030d-15df-4cf0-b8c7-1f809e9d9333 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:32 devstack sudo[99550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-834a030d-15df-4cf0-b8c7-1f809e9d9333 Sep 28 11:55:32 devstack sudo[99550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:32 devstack sudo[99547]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b6385845-6395-42c4-8872-b74ba7893cf6 tempest-GroupSnapshotsTest-23458081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d71c4fd1-5956-464a-9b59-275a90c79b2f" returned: 0 in 0.473s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b6385845-6395-42c4-8872-b74ba7893cf6 tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d71c4fd1-5956-464a-9b59-275a90c79b2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d71c4fd1-5956-464a-9b59-275a90c79b2f.bd86cbe0-be6b-4992-9714-b002fe13bfae 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:32 devstack sudo[99555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d71c4fd1-5956-464a-9b59-275a90c79b2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d71c4fd1-5956-464a-9b59-275a90c79b2f.bd86cbe0-be6b-4992-9714-b002fe13bfae 1G Sep 28 11:55:32 devstack sudo[99555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:33 devstack sudo[99550]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f1e3885c-3d10-4c66-b898-5d211a654a08 tempest-AttachVolumeTestJSON-1340154457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-834a030d-15df-4cf0-b8c7-1f809e9d9333" returned: 0 in 0.459s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f1e3885c-3d10-4c66-b898-5d211a654a08 tempest-AttachVolumeTestJSON-1340154457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-834a030d-15df-4cf0-b8c7-1f809e9d9333 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:33 devstack sudo[99562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-834a030d-15df-4cf0-b8c7-1f809e9d9333 Sep 28 11:55:33 devstack sudo[99562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:33 devstack sudo[99555]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b6385845-6395-42c4-8872-b74ba7893cf6 tempest-GroupSnapshotsTest-23458081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d71c4fd1-5956-464a-9b59-275a90c79b2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d71c4fd1-5956-464a-9b59-275a90c79b2f.bd86cbe0-be6b-4992-9714-b002fe13bfae 1G" returned: 0 in 0.485s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b6385845-6395-42c4-8872-b74ba7893cf6 tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d71c4fd1-5956-464a-9b59-275a90c79b2f -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d71c4fd1-5956-464a-9b59-275a90c79b2f.bd86cbe0-be6b-4992-9714-b002fe13bfae {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:33 devstack sudo[99562]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f1e3885c-3d10-4c66-b898-5d211a654a08 tempest-AttachVolumeTestJSON-1340154457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-834a030d-15df-4cf0-b8c7-1f809e9d9333" returned: 0 in 0.282s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:33 devstack sudo[99570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d71c4fd1-5956-464a-9b59-275a90c79b2f -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d71c4fd1-5956-464a-9b59-275a90c79b2f.bd86cbe0-be6b-4992-9714-b002fe13bfae Sep 28 11:55:33 devstack sudo[99570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f1e3885c-3d10-4c66-b898-5d211a654a08 tempest-AttachVolumeTestJSON-1340154457 None] Lock "cinder-quobyte-834a030d-15df-4cf0-b8c7-1f809e9d9333" released by "delete_volume" :: held 0.799s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:55:33 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-f1e3885c-3d10-4c66-b898-5d211a654a08 tempest-AttachVolumeTestJSON-1340154457 None] Created reservations ['03d8dad6-6e93-4018-ba39-577c7386dc48', '81e3bf64-08c5-4302-92cd-1c2d61d7a9bf', '0e80df51-0e38-4575-9ce9-60901e8328a3', 'd8d90e96-1bc1-45cf-847e-ac738bf1cd07'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:55:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f1e3885c-3d10-4c66-b898-5d211a654a08 tempest-AttachVolumeTestJSON-1340154457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:55:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f1e3885c-3d10-4c66-b898-5d211a654a08 tempest-AttachVolumeTestJSON-1340154457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:55:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f1e3885c-3d10-4c66-b898-5d211a654a08 tempest-AttachVolumeTestJSON-1340154457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:55:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f1e3885c-3d10-4c66-b898-5d211a654a08 tempest-AttachVolumeTestJSON-1340154457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:55:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f1e3885c-3d10-4c66-b898-5d211a654a08 tempest-AttachVolumeTestJSON-1340154457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:55:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f1e3885c-3d10-4c66-b898-5d211a654a08 tempest-AttachVolumeTestJSON-1340154457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:33 devstack sudo[99572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:55:33 devstack sudo[99572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:33 devstack sudo[99570]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b6385845-6395-42c4-8872-b74ba7893cf6 tempest-GroupSnapshotsTest-23458081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d71c4fd1-5956-464a-9b59-275a90c79b2f -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d71c4fd1-5956-464a-9b59-275a90c79b2f.bd86cbe0-be6b-4992-9714-b002fe13bfae" returned: 0 in 0.363s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:33 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-b6385845-6395-42c4-8872-b74ba7893cf6 tempest-GroupSnapshotsTest-23458081 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d71c4fd1-5956-464a-9b59-275a90c79b2f.bd86cbe0-be6b-4992-9714-b002fe13bfae is being set with open permissions: ugo+rw: NotImplementedError Sep 28 11:55:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b6385845-6395-42c4-8872-b74ba7893cf6 tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d71c4fd1-5956-464a-9b59-275a90c79b2f.bd86cbe0-be6b-4992-9714-b002fe13bfae {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:33 devstack sudo[99577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d71c4fd1-5956-464a-9b59-275a90c79b2f.bd86cbe0-be6b-4992-9714-b002fe13bfae Sep 28 11:55:33 devstack sudo[99577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:33 devstack sudo[99572]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f1e3885c-3d10-4c66-b898-5d211a654a08 tempest-AttachVolumeTestJSON-1340154457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.319s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:33 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-f1e3885c-3d10-4c66-b898-5d211a654a08 tempest-AttachVolumeTestJSON-1340154457 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:55:33 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-f1e3885c-3d10-4c66-b898-5d211a654a08 tempest-AttachVolumeTestJSON-1340154457 None] Deleted volume successfully. Sep 28 11:55:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f1e3885c-3d10-4c66-b898-5d211a654a08 tempest-AttachVolumeTestJSON-1340154457 None] Lock "cinder-834a030d-15df-4cf0-b8c7-1f809e9d9333-delete_volume" released by "delete_volume" :: held 1.386s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:55:33 devstack sudo[99577]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b6385845-6395-42c4-8872-b74ba7893cf6 tempest-GroupSnapshotsTest-23458081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d71c4fd1-5956-464a-9b59-275a90c79b2f.bd86cbe0-be6b-4992-9714-b002fe13bfae" returned: 0 in 0.311s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b6385845-6395-42c4-8872-b74ba7893cf6 tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d71c4fd1-5956-464a-9b59-275a90c79b2f.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:34 devstack sudo[99581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d71c4fd1-5956-464a-9b59-275a90c79b2f.info Sep 28 11:55:34 devstack sudo[99581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:34 devstack sudo[99581]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b6385845-6395-42c4-8872-b74ba7893cf6 tempest-GroupSnapshotsTest-23458081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d71c4fd1-5956-464a-9b59-275a90c79b2f.info" returned: 0 in 0.283s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:34 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-b6385845-6395-42c4-8872-b74ba7893cf6 tempest-GroupSnapshotsTest-23458081 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d71c4fd1-5956-464a-9b59-275a90c79b2f.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 11:55:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b6385845-6395-42c4-8872-b74ba7893cf6 tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d71c4fd1-5956-464a-9b59-275a90c79b2f.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:34 devstack sudo[99584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d71c4fd1-5956-464a-9b59-275a90c79b2f.info Sep 28 11:55:34 devstack sudo[99584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:34 devstack sudo[99584]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b6385845-6395-42c4-8872-b74ba7893cf6 tempest-GroupSnapshotsTest-23458081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d71c4fd1-5956-464a-9b59-275a90c79b2f.info" returned: 0 in 0.338s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b6385845-6395-42c4-8872-b74ba7893cf6 tempest-GroupSnapshotsTest-23458081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.384s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:55:34 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b6385845-6395-42c4-8872-b74ba7893cf6 tempest-GroupSnapshotsTest-23458081 None] group_snapshot 60318933-9cb3-4e70-9876-80afde1cc214: created successfully Sep 28 11:55:35 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-7e37ab1f-9188-4129-b158-7fe6cc0b3c92 tempest-GroupSnapshotsTest-23458081 None] group_snapshot 60318933-9cb3-4e70-9876-80afde1cc214: deleting Sep 28 11:55:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7e37ab1f-9188-4129-b158-7fe6cc0b3c92 tempest-GroupSnapshotsTest-23458081 None] group_snapshot 60318933-9cb3-4e70-9876-80afde1cc214: deleting {{(pid=86916) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 11:55:35 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=176,cinder:UPDATE=183,cinder:DELETE=14,cinder:INSERT=38 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 11:55:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7e37ab1f-9188-4129-b158-7fe6cc0b3c92 tempest-GroupSnapshotsTest-23458081 None] Acquiring lock "cinder-quobyte-d71c4fd1-5956-464a-9b59-275a90c79b2f" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:55:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7e37ab1f-9188-4129-b158-7fe6cc0b3c92 tempest-GroupSnapshotsTest-23458081 None] Lock "cinder-quobyte-d71c4fd1-5956-464a-9b59-275a90c79b2f" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:55:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7e37ab1f-9188-4129-b158-7fe6cc0b3c92 tempest-GroupSnapshotsTest-23458081 None] Acquiring lock "cinder-quobyte-bd86cbe0-be6b-4992-9714-b002fe13bfae" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:55:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7e37ab1f-9188-4129-b158-7fe6cc0b3c92 tempest-GroupSnapshotsTest-23458081 None] Lock "cinder-quobyte-bd86cbe0-be6b-4992-9714-b002fe13bfae" acquired by "_delete_snapshot" :: waited 0.054s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:55:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-7e37ab1f-9188-4129-b158-7fe6cc0b3c92 tempest-GroupSnapshotsTest-23458081 None] Deleting offline snapshot bd86cbe0-be6b-4992-9714-b002fe13bfae of volume d71c4fd1-5956-464a-9b59-275a90c79b2f {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 11:55:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-7e37ab1f-9188-4129-b158-7fe6cc0b3c92 tempest-GroupSnapshotsTest-23458081 None] snapshot_file for this snap is: volume-d71c4fd1-5956-464a-9b59-275a90c79b2f.bd86cbe0-be6b-4992-9714-b002fe13bfae {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 11:55:35 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb756724-2883-4ac0-91fe-c637ed28f67c]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:55:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7e37ab1f-9188-4129-b158-7fe6cc0b3c92 tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d71c4fd1-5956-464a-9b59-275a90c79b2f.bd86cbe0-be6b-4992-9714-b002fe13bfae {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:36 devstack sudo[99588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d71c4fd1-5956-464a-9b59-275a90c79b2f.bd86cbe0-be6b-4992-9714-b002fe13bfae Sep 28 11:55:36 devstack sudo[99588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:36 devstack sudo[99588]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7e37ab1f-9188-4129-b158-7fe6cc0b3c92 tempest-GroupSnapshotsTest-23458081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d71c4fd1-5956-464a-9b59-275a90c79b2f.bd86cbe0-be6b-4992-9714-b002fe13bfae" returned: 0 in 0.412s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-7e37ab1f-9188-4129-b158-7fe6cc0b3c92 tempest-GroupSnapshotsTest-23458081 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d71c4fd1-5956-464a-9b59-275a90c79b2f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 11:55:36 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca85e1d8-2b70-4156-89e6-965ebeed0ff5]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:55:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7e37ab1f-9188-4129-b158-7fe6cc0b3c92 tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d71c4fd1-5956-464a-9b59-275a90c79b2f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:36 devstack sudo[99593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d71c4fd1-5956-464a-9b59-275a90c79b2f Sep 28 11:55:36 devstack sudo[99593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:36 devstack sudo[99593]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7e37ab1f-9188-4129-b158-7fe6cc0b3c92 tempest-GroupSnapshotsTest-23458081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d71c4fd1-5956-464a-9b59-275a90c79b2f" returned: 0 in 0.468s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7e37ab1f-9188-4129-b158-7fe6cc0b3c92 tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d71c4fd1-5956-464a-9b59-275a90c79b2f.bd86cbe0-be6b-4992-9714-b002fe13bfae {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:36 devstack sudo[99599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d71c4fd1-5956-464a-9b59-275a90c79b2f.bd86cbe0-be6b-4992-9714-b002fe13bfae Sep 28 11:55:36 devstack sudo[99599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:37 devstack sudo[99599]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7e37ab1f-9188-4129-b158-7fe6cc0b3c92 tempest-GroupSnapshotsTest-23458081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d71c4fd1-5956-464a-9b59-275a90c79b2f.bd86cbe0-be6b-4992-9714-b002fe13bfae" returned: 0 in 0.381s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7e37ab1f-9188-4129-b158-7fe6cc0b3c92 tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d71c4fd1-5956-464a-9b59-275a90c79b2f.bd86cbe0-be6b-4992-9714-b002fe13bfae {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:37 devstack sudo[99605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d71c4fd1-5956-464a-9b59-275a90c79b2f.bd86cbe0-be6b-4992-9714-b002fe13bfae Sep 28 11:55:37 devstack sudo[99605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:37 devstack sudo[99605]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7e37ab1f-9188-4129-b158-7fe6cc0b3c92 tempest-GroupSnapshotsTest-23458081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d71c4fd1-5956-464a-9b59-275a90c79b2f.bd86cbe0-be6b-4992-9714-b002fe13bfae" returned: 0 in 0.296s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7e37ab1f-9188-4129-b158-7fe6cc0b3c92 tempest-GroupSnapshotsTest-23458081 None] Lock "cinder-quobyte-bd86cbe0-be6b-4992-9714-b002fe13bfae" released by "_delete_snapshot" :: held 1.744s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:55:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7e37ab1f-9188-4129-b158-7fe6cc0b3c92 tempest-GroupSnapshotsTest-23458081 None] Lock "cinder-quobyte-d71c4fd1-5956-464a-9b59-275a90c79b2f" released by "delete_snapshot" :: held 1.806s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:55:37 devstack cinder-volume[86916]: WARNING cinder.quota [None req-7e37ab1f-9188-4129-b158-7fe6cc0b3c92 tempest-GroupSnapshotsTest-23458081 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1835226826 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1835226826, it is now deprecated. Please use the default quota class for default quota. Sep 28 11:55:37 devstack cinder-volume[86916]: WARNING cinder.quota [None req-7e37ab1f-9188-4129-b158-7fe6cc0b3c92 tempest-GroupSnapshotsTest-23458081 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1835226826 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1835226826, it is now deprecated. Please use the default quota class for default quota. Sep 28 11:55:37 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-7e37ab1f-9188-4129-b158-7fe6cc0b3c92 tempest-GroupSnapshotsTest-23458081 None] Created reservations ['fdf70cfb-4d19-49cd-8a11-078b6a09e6de', '80c65855-b3ed-4f2c-a571-cf3045e47f65', 'd9735822-365d-4fc6-92d8-138fcc69b498', 'def1a78b-dff1-434b-ae9d-86428d3ce3d9'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:55:37 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-7e37ab1f-9188-4129-b158-7fe6cc0b3c92 tempest-GroupSnapshotsTest-23458081 None] group_snapshot 60318933-9cb3-4e70-9876-80afde1cc214: deleted successfully Sep 28 11:55:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5dd3eb5f-5f45-476f-8185-138a5c706fc3 tempest-GroupSnapshotsTest-23458081 None] Acquiring lock "cinder-quobyte-d71c4fd1-5956-464a-9b59-275a90c79b2f" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:55:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5dd3eb5f-5f45-476f-8185-138a5c706fc3 tempest-GroupSnapshotsTest-23458081 None] Lock "cinder-quobyte-d71c4fd1-5956-464a-9b59-275a90c79b2f" acquired by "delete_volume" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:55:38 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20a2e75-1ec2-4e06-8cda-63d9526f145c]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:55:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5dd3eb5f-5f45-476f-8185-138a5c706fc3 tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d71c4fd1-5956-464a-9b59-275a90c79b2f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:38 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 11:55:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:55:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:55:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:55:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:55:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:55:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:38 devstack sudo[99610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:55:38 devstack sudo[99610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:38 devstack sudo[99609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d71c4fd1-5956-464a-9b59-275a90c79b2f Sep 28 11:55:38 devstack sudo[99609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:38 devstack sudo[99610]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.298s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:38 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:55:38 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 11:55:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] thread count: 28 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 11:55:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] thread info: [<_MainThread(MainThread, started 135408582168704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 11:55:39 devstack sudo[99609]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5dd3eb5f-5f45-476f-8185-138a5c706fc3 tempest-GroupSnapshotsTest-23458081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d71c4fd1-5956-464a-9b59-275a90c79b2f" returned: 0 in 0.486s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5dd3eb5f-5f45-476f-8185-138a5c706fc3 tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d71c4fd1-5956-464a-9b59-275a90c79b2f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:39 devstack sudo[99617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d71c4fd1-5956-464a-9b59-275a90c79b2f Sep 28 11:55:39 devstack sudo[99617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:39 devstack sudo[99617]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5dd3eb5f-5f45-476f-8185-138a5c706fc3 tempest-GroupSnapshotsTest-23458081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d71c4fd1-5956-464a-9b59-275a90c79b2f" returned: 0 in 0.273s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5dd3eb5f-5f45-476f-8185-138a5c706fc3 tempest-GroupSnapshotsTest-23458081 None] Lock "cinder-quobyte-d71c4fd1-5956-464a-9b59-275a90c79b2f" released by "delete_volume" :: held 0.863s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:55:40 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-5dd3eb5f-5f45-476f-8185-138a5c706fc3 tempest-GroupSnapshotsTest-23458081 None] Created reservations ['42fa1197-3dde-4188-8112-f9339facca0b'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:55:40 devstack cinder-volume[86916]: WARNING cinder.quota [None req-5dd3eb5f-5f45-476f-8185-138a5c706fc3 tempest-GroupSnapshotsTest-23458081 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1835226826 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1835226826, it is now deprecated. Please use the default quota class for default quota. Sep 28 11:55:40 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-5dd3eb5f-5f45-476f-8185-138a5c706fc3 tempest-GroupSnapshotsTest-23458081 None] Created reservations ['50062b85-e73e-4d31-b713-084eb63f3cc9', '7a04cbba-24e3-4a2e-8c90-8aa33e68a191', '50212a18-f243-40a6-b776-dfe6ce4be873', '47d84dc5-871a-40a8-9c63-dc458f31bcf2'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:55:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5dd3eb5f-5f45-476f-8185-138a5c706fc3 tempest-GroupSnapshotsTest-23458081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:55:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5dd3eb5f-5f45-476f-8185-138a5c706fc3 tempest-GroupSnapshotsTest-23458081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:55:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5dd3eb5f-5f45-476f-8185-138a5c706fc3 tempest-GroupSnapshotsTest-23458081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:55:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5dd3eb5f-5f45-476f-8185-138a5c706fc3 tempest-GroupSnapshotsTest-23458081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:55:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5dd3eb5f-5f45-476f-8185-138a5c706fc3 tempest-GroupSnapshotsTest-23458081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:55:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5dd3eb5f-5f45-476f-8185-138a5c706fc3 tempest-GroupSnapshotsTest-23458081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:42 devstack sudo[99621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:55:42 devstack sudo[99621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:42 devstack sudo[99621]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5dd3eb5f-5f45-476f-8185-138a5c706fc3 tempest-GroupSnapshotsTest-23458081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.246s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:42 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-5dd3eb5f-5f45-476f-8185-138a5c706fc3 tempest-GroupSnapshotsTest-23458081 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:55:42 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-5dd3eb5f-5f45-476f-8185-138a5c706fc3 tempest-GroupSnapshotsTest-23458081 None] Delete group completed successfully. Sep 28 11:55:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e58bcd98-27fe-4138-be16-f8d76eee53bb tempest-BackendsCapabilitiesAdminTestsJSON-1590798601 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.2163124084473, 'free_capacity_gb': 1775.2163124084473, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86916) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 11:55:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-86829f00-304c-4e45-a5c0-f97c076c5421 tempest-BackendsCapabilitiesAdminTestsJSON-1590798601 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.2163124084473, 'free_capacity_gb': 1775.2163124084473, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86916) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 11:55:50 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef0d08b6-737f-42db-b9a4-1ce7b26d5ae9 tempest-TestInstancesWithCinderVolumes-991430352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:55:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ef0d08b6-737f-42db-b9a4-1ce7b26d5ae9 tempest-TestInstancesWithCinderVolumes-991430352 None] Flow 'volume_create_manager' (618eafc4-36a4-4fc7-8b1c-7cf6478ed9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:55:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ef0d08b6-737f-42db-b9a4-1ce7b26d5ae9 tempest-TestInstancesWithCinderVolumes-991430352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58d6734c-d6ea-48c9-a525-71364971f0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:55:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ef0d08b6-737f-42db-b9a4-1ce7b26d5ae9 tempest-TestInstancesWithCinderVolumes-991430352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58d6734c-d6ea-48c9-a525-71364971f0e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1537369495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=084be243-a5bc-42bb-8735-66c5dc3d6cae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='839e4f7e614c4f538dacab7788d08db0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:55:51Z,use_quota=True,user_id='345e380e57a14c82bf7f9bb14449ee09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(caed2d37-49cb-4bb8-b76c-b4a4240f9b48),volume_type_id=caed2d37-49cb-4bb8-b76c-b4a4240f9b48)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:55:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ef0d08b6-737f-42db-b9a4-1ce7b26d5ae9 tempest-TestInstancesWithCinderVolumes-991430352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9a0b312-ad88-438e-826e-f5a29052d68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:55:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ef0d08b6-737f-42db-b9a4-1ce7b26d5ae9 tempest-TestInstancesWithCinderVolumes-991430352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9a0b312-ad88-438e-826e-f5a29052d68d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:55:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ef0d08b6-737f-42db-b9a4-1ce7b26d5ae9 tempest-TestInstancesWithCinderVolumes-991430352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8321cfca-e609-4bd7-9605-13626ed6e319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:55:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ef0d08b6-737f-42db-b9a4-1ce7b26d5ae9 tempest-TestInstancesWithCinderVolumes-991430352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8321cfca-e609-4bd7-9605-13626ed6e319) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '084be243-a5bc-42bb-8735-66c5dc3d6cae', 'volume_name': 'volume-084be243-a5bc-42bb-8735-66c5dc3d6cae', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:55:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ef0d08b6-737f-42db-b9a4-1ce7b26d5ae9 tempest-TestInstancesWithCinderVolumes-991430352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d5869c6-30e0-463c-b8e4-a98420620caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:55:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ef0d08b6-737f-42db-b9a4-1ce7b26d5ae9 tempest-TestInstancesWithCinderVolumes-991430352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d5869c6-30e0-463c-b8e4-a98420620caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:55:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ef0d08b6-737f-42db-b9a4-1ce7b26d5ae9 tempest-TestInstancesWithCinderVolumes-991430352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9affc0fe-0f8c-464b-b292-69c6c548541a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:55:50 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-ef0d08b6-737f-42db-b9a4-1ce7b26d5ae9 tempest-TestInstancesWithCinderVolumes-991430352 None] Volume 084be243-a5bc-42bb-8735-66c5dc3d6cae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-084be243-a5bc-42bb-8735-66c5dc3d6cae', 'volume_size': 1} Sep 28 11:55:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ef0d08b6-737f-42db-b9a4-1ce7b26d5ae9 tempest-TestInstancesWithCinderVolumes-991430352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:55:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ef0d08b6-737f-42db-b9a4-1ce7b26d5ae9 tempest-TestInstancesWithCinderVolumes-991430352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:55:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ef0d08b6-737f-42db-b9a4-1ce7b26d5ae9 tempest-TestInstancesWithCinderVolumes-991430352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1537369495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=084be243-a5bc-42bb-8735-66c5dc3d6cae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='839e4f7e614c4f538dacab7788d08db0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:55:51Z,use_quota=True,user_id='345e380e57a14c82bf7f9bb14449ee09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(caed2d37-49cb-4bb8-b76c-b4a4240f9b48),volume_type_id=caed2d37-49cb-4bb8-b76c-b4a4240f9b48)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:55:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-ef0d08b6-737f-42db-b9a4-1ce7b26d5ae9 tempest-TestInstancesWithCinderVolumes-991430352 None] Creating volume 084be243-a5bc-42bb-8735-66c5dc3d6cae {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:55:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ef0d08b6-737f-42db-b9a4-1ce7b26d5ae9 tempest-TestInstancesWithCinderVolumes-991430352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:55:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ef0d08b6-737f-42db-b9a4-1ce7b26d5ae9 tempest-TestInstancesWithCinderVolumes-991430352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:55:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ef0d08b6-737f-42db-b9a4-1ce7b26d5ae9 tempest-TestInstancesWithCinderVolumes-991430352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:55:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ef0d08b6-737f-42db-b9a4-1ce7b26d5ae9 tempest-TestInstancesWithCinderVolumes-991430352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:55:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ef0d08b6-737f-42db-b9a4-1ce7b26d5ae9 tempest-TestInstancesWithCinderVolumes-991430352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:55:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ef0d08b6-737f-42db-b9a4-1ce7b26d5ae9 tempest-TestInstancesWithCinderVolumes-991430352 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:55:50 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-ef0d08b6-737f-42db-b9a4-1ce7b26d5ae9 tempest-TestInstancesWithCinderVolumes-991430352 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:55:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ef0d08b6-737f-42db-b9a4-1ce7b26d5ae9 tempest-TestInstancesWithCinderVolumes-991430352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-084be243-a5bc-42bb-8735-66c5dc3d6cae 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:50 devstack sudo[99626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-084be243-a5bc-42bb-8735-66c5dc3d6cae 1073741824 Sep 28 11:55:50 devstack sudo[99626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:51 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-87b9e44b-0bbe-4812-b466-86c8db61b5ae tempest-TestInstancesWithCinderVolumes-991430352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:55:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-87b9e44b-0bbe-4812-b466-86c8db61b5ae tempest-TestInstancesWithCinderVolumes-991430352 None] Flow 'volume_create_manager' (e273c6d4-c232-4a7a-9917-29fe8fd0ffa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:55:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-87b9e44b-0bbe-4812-b466-86c8db61b5ae tempest-TestInstancesWithCinderVolumes-991430352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f85a2c4-118f-4343-8b26-8741fbd0b72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:55:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-87b9e44b-0bbe-4812-b466-86c8db61b5ae tempest-TestInstancesWithCinderVolumes-991430352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f85a2c4-118f-4343-8b26-8741fbd0b72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-963579228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc57d5d6-739d-459b-af23-9c272cedbecb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='839e4f7e614c4f538dacab7788d08db0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:55:51Z,use_quota=True,user_id='345e380e57a14c82bf7f9bb14449ee09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc8b6b49-14dd-4bc5-b78c-d6f997357386),volume_type_id=bc8b6b49-14dd-4bc5-b78c-d6f997357386)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:55:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-87b9e44b-0bbe-4812-b466-86c8db61b5ae tempest-TestInstancesWithCinderVolumes-991430352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9617672-58be-4708-8861-9c2d57af4396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:55:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-87b9e44b-0bbe-4812-b466-86c8db61b5ae tempest-TestInstancesWithCinderVolumes-991430352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9617672-58be-4708-8861-9c2d57af4396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:55:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-87b9e44b-0bbe-4812-b466-86c8db61b5ae tempest-TestInstancesWithCinderVolumes-991430352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8edeb673-fa99-4f2b-b6f4-4eea51bb18d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:55:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-87b9e44b-0bbe-4812-b466-86c8db61b5ae tempest-TestInstancesWithCinderVolumes-991430352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8edeb673-fa99-4f2b-b6f4-4eea51bb18d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc57d5d6-739d-459b-af23-9c272cedbecb', 'volume_name': 'volume-cc57d5d6-739d-459b-af23-9c272cedbecb', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:55:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-87b9e44b-0bbe-4812-b466-86c8db61b5ae tempest-TestInstancesWithCinderVolumes-991430352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0915023c-7652-4119-b18e-cd00587786bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:55:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-87b9e44b-0bbe-4812-b466-86c8db61b5ae tempest-TestInstancesWithCinderVolumes-991430352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0915023c-7652-4119-b18e-cd00587786bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:55:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-87b9e44b-0bbe-4812-b466-86c8db61b5ae tempest-TestInstancesWithCinderVolumes-991430352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26e87475-fbc9-4c28-9bfe-9f3d1b89db85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:55:51 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-87b9e44b-0bbe-4812-b466-86c8db61b5ae tempest-TestInstancesWithCinderVolumes-991430352 None] Volume cc57d5d6-739d-459b-af23-9c272cedbecb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc57d5d6-739d-459b-af23-9c272cedbecb', 'volume_size': 1} Sep 28 11:55:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-87b9e44b-0bbe-4812-b466-86c8db61b5ae tempest-TestInstancesWithCinderVolumes-991430352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:55:51 devstack sudo[99626]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ef0d08b6-737f-42db-b9a4-1ce7b26d5ae9 tempest-TestInstancesWithCinderVolumes-991430352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-084be243-a5bc-42bb-8735-66c5dc3d6cae 1073741824" returned: 0 in 0.782s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ef0d08b6-737f-42db-b9a4-1ce7b26d5ae9 tempest-TestInstancesWithCinderVolumes-991430352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-084be243-a5bc-42bb-8735-66c5dc3d6cae {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:51 devstack sudo[99632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-084be243-a5bc-42bb-8735-66c5dc3d6cae Sep 28 11:55:51 devstack sudo[99632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:52 devstack sudo[99632]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ef0d08b6-737f-42db-b9a4-1ce7b26d5ae9 tempest-TestInstancesWithCinderVolumes-991430352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-084be243-a5bc-42bb-8735-66c5dc3d6cae" returned: 0 in 0.414s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ef0d08b6-737f-42db-b9a4-1ce7b26d5ae9 tempest-TestInstancesWithCinderVolumes-991430352 None] <== create_volume: return (1268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:55:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ef0d08b6-737f-42db-b9a4-1ce7b26d5ae9 tempest-TestInstancesWithCinderVolumes-991430352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.270s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:55:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-87b9e44b-0bbe-4812-b466-86c8db61b5ae tempest-TestInstancesWithCinderVolumes-991430352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.812s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:55:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-87b9e44b-0bbe-4812-b466-86c8db61b5ae tempest-TestInstancesWithCinderVolumes-991430352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-963579228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc57d5d6-739d-459b-af23-9c272cedbecb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='839e4f7e614c4f538dacab7788d08db0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:55:51Z,use_quota=True,user_id='345e380e57a14c82bf7f9bb14449ee09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc8b6b49-14dd-4bc5-b78c-d6f997357386),volume_type_id=bc8b6b49-14dd-4bc5-b78c-d6f997357386)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:55:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-87b9e44b-0bbe-4812-b466-86c8db61b5ae tempest-TestInstancesWithCinderVolumes-991430352 None] Creating volume cc57d5d6-739d-459b-af23-9c272cedbecb {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:55:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-87b9e44b-0bbe-4812-b466-86c8db61b5ae tempest-TestInstancesWithCinderVolumes-991430352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:55:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-87b9e44b-0bbe-4812-b466-86c8db61b5ae tempest-TestInstancesWithCinderVolumes-991430352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:55:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-87b9e44b-0bbe-4812-b466-86c8db61b5ae tempest-TestInstancesWithCinderVolumes-991430352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:55:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-87b9e44b-0bbe-4812-b466-86c8db61b5ae tempest-TestInstancesWithCinderVolumes-991430352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:55:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-87b9e44b-0bbe-4812-b466-86c8db61b5ae tempest-TestInstancesWithCinderVolumes-991430352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:55:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-87b9e44b-0bbe-4812-b466-86c8db61b5ae tempest-TestInstancesWithCinderVolumes-991430352 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:55:52 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-87b9e44b-0bbe-4812-b466-86c8db61b5ae tempest-TestInstancesWithCinderVolumes-991430352 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:55:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-87b9e44b-0bbe-4812-b466-86c8db61b5ae tempest-TestInstancesWithCinderVolumes-991430352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cc57d5d6-739d-459b-af23-9c272cedbecb 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ef0d08b6-737f-42db-b9a4-1ce7b26d5ae9 tempest-TestInstancesWithCinderVolumes-991430352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9affc0fe-0f8c-464b-b292-69c6c548541a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-084be243-a5bc-42bb-8735-66c5dc3d6cae', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:55:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ef0d08b6-737f-42db-b9a4-1ce7b26d5ae9 tempest-TestInstancesWithCinderVolumes-991430352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06411ba1-428d-4f06-97da-6492fadd0690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:55:52 devstack sudo[99635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cc57d5d6-739d-459b-af23-9c272cedbecb 1073741824 Sep 28 11:55:52 devstack sudo[99635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:52 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:55:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] Flow 'volume_create_manager' (0cf7a0a8-bf33-4251-b3f2-b560cc95ecdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:55:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b47a222c-5cf5-45fb-9ff0-9a254f1a4923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:55:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b47a222c-5cf5-45fb-9ff0-9a254f1a4923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:55:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1677085299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cf9c6db-c02f-4740-b425-bcbd04bb5b8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='839e4f7e614c4f538dacab7788d08db0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:55:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:55:52Z,use_quota=True,user_id='345e380e57a14c82bf7f9bb14449ee09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(364076d3-453d-403e-a675-d1dae2e24356),volume_type_id=364076d3-453d-403e-a675-d1dae2e24356)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:55:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e102342-2d18-41e1-83f0-ac5d73629065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:55:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e102342-2d18-41e1-83f0-ac5d73629065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:55:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b7184cd-3095-4ff3-890b-b395074df277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:55:52 devstack cinder-volume[86916]: DEBUG cinder.image.glance [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] Creating Keystone auth plugin from conf {{(pid=86916) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 11:55:52 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-ef0d08b6-737f-42db-b9a4-1ce7b26d5ae9 tempest-TestInstancesWithCinderVolumes-991430352 None] Volume volume-084be243-a5bc-42bb-8735-66c5dc3d6cae (084be243-a5bc-42bb-8735-66c5dc3d6cae): created successfully Sep 28 11:55:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ef0d08b6-737f-42db-b9a4-1ce7b26d5ae9 tempest-TestInstancesWithCinderVolumes-991430352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06411ba1-428d-4f06-97da-6492fadd0690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:55:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ef0d08b6-737f-42db-b9a4-1ce7b26d5ae9 tempest-TestInstancesWithCinderVolumes-991430352 None] Flow 'volume_create_manager' (618eafc4-36a4-4fc7-8b1c-7cf6478ed9cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:55:52 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-ef0d08b6-737f-42db-b9a4-1ce7b26d5ae9 tempest-TestInstancesWithCinderVolumes-991430352 None] Created volume successfully. Sep 28 11:55:52 devstack sudo[99635]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-87b9e44b-0bbe-4812-b466-86c8db61b5ae tempest-TestInstancesWithCinderVolumes-991430352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cc57d5d6-739d-459b-af23-9c272cedbecb 1073741824" returned: 0 in 0.524s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-87b9e44b-0bbe-4812-b466-86c8db61b5ae tempest-TestInstancesWithCinderVolumes-991430352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cc57d5d6-739d-459b-af23-9c272cedbecb {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:52 devstack sudo[99641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cc57d5d6-739d-459b-af23-9c272cedbecb Sep 28 11:55:52 devstack sudo[99641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b7184cd-3095-4ff3-890b-b395074df277) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5cf9c6db-c02f-4740-b425-bcbd04bb5b8d', 'volume_name': 'volume-5cf9c6db-c02f-4740-b425-bcbd04bb5b8d', 'volume_size': 1, 'image_id': '22f76933-96ca-482e-a63f-7ca069746097', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/22f76933-96ca-482e-a63f-7ca069746097', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1214088332', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '839e4f7e614c4f538dacab7788d08db0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '22f76933-96ca-482e-a63f-7ca069746097', 'created_at': datetime.datetime(2026, 9, 28, 9, 55, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 9, 55, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/22f76933-96ca-482e-a63f-7ca069746097/file', 'properties': {}}, 'image_service': }' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:55:53 devstack sudo[99641]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34a7cd56-64e1-40d7-b5c2-464e22d985fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:55:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34a7cd56-64e1-40d7-b5c2-464e22d985fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:55:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1fb1208-655f-4056-9cea-a6312c6d43ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:55:53 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] Volume 5cf9c6db-c02f-4740-b425-bcbd04bb5b8d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5cf9c6db-c02f-4740-b425-bcbd04bb5b8d', 'volume_size': 1, 'image_id': '22f76933-96ca-482e-a63f-7ca069746097', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/22f76933-96ca-482e-a63f-7ca069746097', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1214088332', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '839e4f7e614c4f538dacab7788d08db0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '22f76933-96ca-482e-a63f-7ca069746097', 'created_at': datetime.datetime(2026, 9, 28, 9, 55, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 9, 55, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/22f76933-96ca-482e-a63f-7ca069746097/file', 'properties': {}}, 'image_service': } Sep 28 11:55:53 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] Trying to clone 5cf9c6db-c02f-4740-b425-bcbd04bb5b8d from image 22f76933-96ca-482e-a63f-7ca069746097 at location (None, [{'url': 'file:///opt/stack/data/glance/images/22f76933-96ca-482e-a63f-7ca069746097', 'metadata': {}}]). {{(pid=86916) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 11:55:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-87b9e44b-0bbe-4812-b466-86c8db61b5ae tempest-TestInstancesWithCinderVolumes-991430352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cc57d5d6-739d-459b-af23-9c272cedbecb" returned: 0 in 0.317s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-87b9e44b-0bbe-4812-b466-86c8db61b5ae tempest-TestInstancesWithCinderVolumes-991430352 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:55:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-87b9e44b-0bbe-4812-b466-86c8db61b5ae tempest-TestInstancesWithCinderVolumes-991430352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:55:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-87b9e44b-0bbe-4812-b466-86c8db61b5ae tempest-TestInstancesWithCinderVolumes-991430352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26e87475-fbc9-4c28-9bfe-9f3d1b89db85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc57d5d6-739d-459b-af23-9c272cedbecb', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:55:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-87b9e44b-0bbe-4812-b466-86c8db61b5ae tempest-TestInstancesWithCinderVolumes-991430352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6702bc5e-7b54-44bc-af87-968d4ca4a907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:55:53 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-87b9e44b-0bbe-4812-b466-86c8db61b5ae tempest-TestInstancesWithCinderVolumes-991430352 None] Volume volume-cc57d5d6-739d-459b-af23-9c272cedbecb (cc57d5d6-739d-459b-af23-9c272cedbecb): created successfully Sep 28 11:55:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-87b9e44b-0bbe-4812-b466-86c8db61b5ae tempest-TestInstancesWithCinderVolumes-991430352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6702bc5e-7b54-44bc-af87-968d4ca4a907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:55:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-87b9e44b-0bbe-4812-b466-86c8db61b5ae tempest-TestInstancesWithCinderVolumes-991430352 None] Flow 'volume_create_manager' (e273c6d4-c232-4a7a-9917-29fe8fd0ffa7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:55:53 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-87b9e44b-0bbe-4812-b466-86c8db61b5ae tempest-TestInstancesWithCinderVolumes-991430352 None] Created volume successfully. Sep 28 11:55:55 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-0e0aafd9-a5b3-42a3-bf23-24dfae530efc tempest-GroupSnapshotsV319Test-1968687007 None] Group tempest-GroupSnapshotsV319Test-Group-210878197: creating Sep 28 11:55:55 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-0e0aafd9-a5b3-42a3-bf23-24dfae530efc tempest-GroupSnapshotsV319Test-1968687007 None] Group tempest-GroupSnapshotsV319Test-Group-210878197: created successfully Sep 28 11:55:55 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-0e0aafd9-a5b3-42a3-bf23-24dfae530efc tempest-GroupSnapshotsV319Test-1968687007 None] Create group completed successfully. Sep 28 11:55:56 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cef6b5c-c810-4f0c-b356-defcf5366cca tempest-GroupSnapshotsV319Test-1968687007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:55:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1cef6b5c-c810-4f0c-b356-defcf5366cca tempest-GroupSnapshotsV319Test-1968687007 None] Flow 'volume_create_manager' (93850b56-6573-4e35-b47f-f1317a4f4f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:55:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1cef6b5c-c810-4f0c-b356-defcf5366cca tempest-GroupSnapshotsV319Test-1968687007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eebd3cad-f074-44f7-8dd3-f83d6a334307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:55:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1cef6b5c-c810-4f0c-b356-defcf5366cca tempest-GroupSnapshotsV319Test-1968687007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eebd3cad-f074-44f7-8dd3-f83d6a334307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:55:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1194940364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=60c66d51-531c-4fb3-8c18-d298f1c162de,host='devstack@QuobyteHD#QuobyteHD',id=8f1d5c8d-fe01-467e-8ad5-82e027380acf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0df3370039c4bfc86cc8226558e17dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:55:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:55:57Z,use_quota=True,user_id='26cc1041af5e4f93a8ba28facceaa472',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dbe22a8-deb0-4d2a-8a45-74ffb5f87fa7),volume_type_id=4dbe22a8-deb0-4d2a-8a45-74ffb5f87fa7)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:55:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1cef6b5c-c810-4f0c-b356-defcf5366cca tempest-GroupSnapshotsV319Test-1968687007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8ec2369-fedf-4f92-9507-3520d0af3016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:55:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1cef6b5c-c810-4f0c-b356-defcf5366cca tempest-GroupSnapshotsV319Test-1968687007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8ec2369-fedf-4f92-9507-3520d0af3016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:55:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1cef6b5c-c810-4f0c-b356-defcf5366cca tempest-GroupSnapshotsV319Test-1968687007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28433111-647c-44ff-beb5-0e9003f639ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:55:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1cef6b5c-c810-4f0c-b356-defcf5366cca tempest-GroupSnapshotsV319Test-1968687007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28433111-647c-44ff-beb5-0e9003f639ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f1d5c8d-fe01-467e-8ad5-82e027380acf', 'volume_name': 'volume-8f1d5c8d-fe01-467e-8ad5-82e027380acf', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:55:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1cef6b5c-c810-4f0c-b356-defcf5366cca tempest-GroupSnapshotsV319Test-1968687007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a89255f1-fe0f-46c3-9aff-feecb3fa56f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:55:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1cef6b5c-c810-4f0c-b356-defcf5366cca tempest-GroupSnapshotsV319Test-1968687007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a89255f1-fe0f-46c3-9aff-feecb3fa56f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:55:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1cef6b5c-c810-4f0c-b356-defcf5366cca tempest-GroupSnapshotsV319Test-1968687007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20304958-6bf6-4fa7-8dfa-b58c1e8cee7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:55:57 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-1cef6b5c-c810-4f0c-b356-defcf5366cca tempest-GroupSnapshotsV319Test-1968687007 None] Volume 8f1d5c8d-fe01-467e-8ad5-82e027380acf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f1d5c8d-fe01-467e-8ad5-82e027380acf', 'volume_size': 1} Sep 28 11:55:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1cef6b5c-c810-4f0c-b356-defcf5366cca tempest-GroupSnapshotsV319Test-1968687007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:55:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1cef6b5c-c810-4f0c-b356-defcf5366cca tempest-GroupSnapshotsV319Test-1968687007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:55:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1cef6b5c-c810-4f0c-b356-defcf5366cca tempest-GroupSnapshotsV319Test-1968687007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=60c66d51-531c-4fb3-8c18-d298f1c162de,created_at=2026-09-28T09:55:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1194940364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=60c66d51-531c-4fb3-8c18-d298f1c162de,host='devstack@QuobyteHD#QuobyteHD',id=8f1d5c8d-fe01-467e-8ad5-82e027380acf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0df3370039c4bfc86cc8226558e17dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:55:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:55:57Z,use_quota=True,user_id='26cc1041af5e4f93a8ba28facceaa472',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dbe22a8-deb0-4d2a-8a45-74ffb5f87fa7),volume_type_id=4dbe22a8-deb0-4d2a-8a45-74ffb5f87fa7)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:55:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-1cef6b5c-c810-4f0c-b356-defcf5366cca tempest-GroupSnapshotsV319Test-1968687007 None] Creating volume 8f1d5c8d-fe01-467e-8ad5-82e027380acf {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:55:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1cef6b5c-c810-4f0c-b356-defcf5366cca tempest-GroupSnapshotsV319Test-1968687007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:55:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1cef6b5c-c810-4f0c-b356-defcf5366cca tempest-GroupSnapshotsV319Test-1968687007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:55:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1cef6b5c-c810-4f0c-b356-defcf5366cca tempest-GroupSnapshotsV319Test-1968687007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:55:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1cef6b5c-c810-4f0c-b356-defcf5366cca tempest-GroupSnapshotsV319Test-1968687007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:55:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1cef6b5c-c810-4f0c-b356-defcf5366cca tempest-GroupSnapshotsV319Test-1968687007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:55:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1cef6b5c-c810-4f0c-b356-defcf5366cca tempest-GroupSnapshotsV319Test-1968687007 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:55:57 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-1cef6b5c-c810-4f0c-b356-defcf5366cca tempest-GroupSnapshotsV319Test-1968687007 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:55:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1cef6b5c-c810-4f0c-b356-defcf5366cca tempest-GroupSnapshotsV319Test-1968687007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8f1d5c8d-fe01-467e-8ad5-82e027380acf 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:57 devstack sudo[99647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8f1d5c8d-fe01-467e-8ad5-82e027380acf 1073741824 Sep 28 11:55:57 devstack sudo[99647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:57 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_22f76933-96ca-482e-a63f-7ca069746097_3m2ohkuudevstack@QuobyteHD, size 20.69 MB, duration 4.13 sec {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 11:55:57 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] Image download 20.69 MB at 5.01 MB/s Sep 28 11:55:57 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e53fb4c-ffd4-4ce0-86d5-abeb2d5c2d44]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:55:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_22f76933-96ca-482e-a63f-7ca069746097_3m2ohkuudevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:57 devstack sudo[99649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_22f76933-96ca-482e-a63f-7ca069746097_3m2ohkuudevstack@QuobyteHD Sep 28 11:55:57 devstack sudo[99649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:57 devstack sudo[99647]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1cef6b5c-c810-4f0c-b356-defcf5366cca tempest-GroupSnapshotsV319Test-1968687007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8f1d5c8d-fe01-467e-8ad5-82e027380acf 1073741824" returned: 0 in 0.494s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1cef6b5c-c810-4f0c-b356-defcf5366cca tempest-GroupSnapshotsV319Test-1968687007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8f1d5c8d-fe01-467e-8ad5-82e027380acf {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:57 devstack sudo[99655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8f1d5c8d-fe01-467e-8ad5-82e027380acf Sep 28 11:55:57 devstack sudo[99655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:57 devstack sudo[99649]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_22f76933-96ca-482e-a63f-7ca069746097_3m2ohkuudevstack@QuobyteHD" returned: 0 in 0.380s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:57 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] Temporary image 22f76933-96ca-482e-a63f-7ca069746097 is fetched for user 345e380e57a14c82bf7f9bb14449ee09. {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 11:55:57 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b09a0af-8e51-4861-bd63-badd77383418]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:55:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_22f76933-96ca-482e-a63f-7ca069746097_3m2ohkuudevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:57 devstack sudo[99659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_22f76933-96ca-482e-a63f-7ca069746097_3m2ohkuudevstack@QuobyteHD Sep 28 11:55:57 devstack sudo[99659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:57 devstack sudo[99655]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1cef6b5c-c810-4f0c-b356-defcf5366cca tempest-GroupSnapshotsV319Test-1968687007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8f1d5c8d-fe01-467e-8ad5-82e027380acf" returned: 0 in 0.266s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1cef6b5c-c810-4f0c-b356-defcf5366cca tempest-GroupSnapshotsV319Test-1968687007 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:55:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1cef6b5c-c810-4f0c-b356-defcf5366cca tempest-GroupSnapshotsV319Test-1968687007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:55:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1cef6b5c-c810-4f0c-b356-defcf5366cca tempest-GroupSnapshotsV319Test-1968687007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20304958-6bf6-4fa7-8dfa-b58c1e8cee7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f1d5c8d-fe01-467e-8ad5-82e027380acf', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:55:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1cef6b5c-c810-4f0c-b356-defcf5366cca tempest-GroupSnapshotsV319Test-1968687007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f00a84d3-ab04-407f-b68f-ad1dd63fafa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:55:57 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-1cef6b5c-c810-4f0c-b356-defcf5366cca tempest-GroupSnapshotsV319Test-1968687007 None] Volume volume-8f1d5c8d-fe01-467e-8ad5-82e027380acf (8f1d5c8d-fe01-467e-8ad5-82e027380acf): created successfully Sep 28 11:55:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1cef6b5c-c810-4f0c-b356-defcf5366cca tempest-GroupSnapshotsV319Test-1968687007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f00a84d3-ab04-407f-b68f-ad1dd63fafa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:55:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1cef6b5c-c810-4f0c-b356-defcf5366cca tempest-GroupSnapshotsV319Test-1968687007 None] Flow 'volume_create_manager' (93850b56-6573-4e35-b47f-f1317a4f4f10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:55:57 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-1cef6b5c-c810-4f0c-b356-defcf5366cca tempest-GroupSnapshotsV319Test-1968687007 None] Created volume successfully. Sep 28 11:55:58 devstack sudo[99659]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_22f76933-96ca-482e-a63f-7ca069746097_3m2ohkuudevstack@QuobyteHD" returned: 0 in 0.350s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:55:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:55:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:55:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1677085299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cf9c6db-c02f-4740-b425-bcbd04bb5b8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='839e4f7e614c4f538dacab7788d08db0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:55:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:55:52Z,use_quota=True,user_id='345e380e57a14c82bf7f9bb14449ee09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(364076d3-453d-403e-a675-d1dae2e24356),volume_type_id=364076d3-453d-403e-a675-d1dae2e24356)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:55:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] Creating volume 5cf9c6db-c02f-4740-b425-bcbd04bb5b8d {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:55:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:55:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:55:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:55:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:55:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:55:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:55:58 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:55:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5cf9c6db-c02f-4740-b425-bcbd04bb5b8d 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:58 devstack sudo[99665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5cf9c6db-c02f-4740-b425-bcbd04bb5b8d 1073741824 Sep 28 11:55:58 devstack sudo[99665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:58 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-a76aa5a9-299f-4428-a8ee-6d40f2f800b6 tempest-GroupSnapshotsV319Test-1968687007 None] GroupSnapshot 54ece077-20eb-4370-bcb3-803e892e2a91: creating. Sep 28 11:55:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a76aa5a9-299f-4428-a8ee-6d40f2f800b6 tempest-GroupSnapshotsV319Test-1968687007 None] Group snapshot 54ece077-20eb-4370-bcb3-803e892e2a91: creating. {{(pid=86916) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 11:55:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a76aa5a9-299f-4428-a8ee-6d40f2f800b6 tempest-GroupSnapshotsV319Test-1968687007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:55:58 devstack sudo[99665]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5cf9c6db-c02f-4740-b425-bcbd04bb5b8d 1073741824" returned: 0 in 0.563s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5cf9c6db-c02f-4740-b425-bcbd04bb5b8d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:58 devstack sudo[99671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5cf9c6db-c02f-4740-b425-bcbd04bb5b8d Sep 28 11:55:58 devstack sudo[99671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:58 devstack sudo[99671]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5cf9c6db-c02f-4740-b425-bcbd04bb5b8d" returned: 0 in 0.257s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:55:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:55:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a76aa5a9-299f-4428-a8ee-6d40f2f800b6 tempest-GroupSnapshotsV319Test-1968687007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.516s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:55:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-a76aa5a9-299f-4428-a8ee-6d40f2f800b6 tempest-GroupSnapshotsV319Test-1968687007 None] Creating offline snapshot 8c8e9cf2-bc1a-4551-b013-c09c9aa29390 of volume 8f1d5c8d-fe01-467e-8ad5-82e027380acf {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 11:55:58 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] Attempting download of 22f76933-96ca-482e-a63f-7ca069746097 ((None, [{'url': 'file:///opt/stack/data/glance/images/22f76933-96ca-482e-a63f-7ca069746097', 'metadata': {}}])) to volume 5cf9c6db-c02f-4740-b425-bcbd04bb5b8d. {{(pid=86916) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 11:55:58 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d968d1a-8815-4a72-81d8-1fc8fb8b80c8]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:55:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a76aa5a9-299f-4428-a8ee-6d40f2f800b6 tempest-GroupSnapshotsV319Test-1968687007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8f1d5c8d-fe01-467e-8ad5-82e027380acf {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:59 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee36c248-564b-4926-ae6d-9e2b0c70b812]: (4, 'raw') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:55:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_22f76933-96ca-482e-a63f-7ca069746097_4_a3rn_g {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:59 devstack sudo[99674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8f1d5c8d-fe01-467e-8ad5-82e027380acf Sep 28 11:55:59 devstack sudo[99674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:59 devstack sudo[99675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_22f76933-96ca-482e-a63f-7ca069746097_4_a3rn_g Sep 28 11:55:59 devstack sudo[99675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:59 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-26d0505f-1405-4903-afef-c4fc1e713c00 tempest-GroupsV314Test-1723056726 None] Group tempest-GroupsV314Test-Group-1199001177: creating Sep 28 11:55:59 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-26d0505f-1405-4903-afef-c4fc1e713c00 tempest-GroupsV314Test-1723056726 None] Group tempest-GroupsV314Test-Group-1199001177: created successfully Sep 28 11:55:59 devstack sudo[99675]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_22f76933-96ca-482e-a63f-7ca069746097_4_a3rn_g" returned: 0 in 0.370s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:59 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-26d0505f-1405-4903-afef-c4fc1e713c00 tempest-GroupsV314Test-1723056726 None] Create group completed successfully. Sep 28 11:55:59 devstack sudo[99674]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_22f76933-96ca-482e-a63f-7ca069746097_4_a3rn_g {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a76aa5a9-299f-4428-a8ee-6d40f2f800b6 tempest-GroupSnapshotsV319Test-1968687007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8f1d5c8d-fe01-467e-8ad5-82e027380acf" returned: 0 in 0.426s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a76aa5a9-299f-4428-a8ee-6d40f2f800b6 tempest-GroupSnapshotsV319Test-1968687007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8f1d5c8d-fe01-467e-8ad5-82e027380acf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8f1d5c8d-fe01-467e-8ad5-82e027380acf.8c8e9cf2-bc1a-4551-b013-c09c9aa29390 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:59 devstack sudo[99684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8f1d5c8d-fe01-467e-8ad5-82e027380acf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8f1d5c8d-fe01-467e-8ad5-82e027380acf.8c8e9cf2-bc1a-4551-b013-c09c9aa29390 1G Sep 28 11:55:59 devstack sudo[99684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:59 devstack sudo[99683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_22f76933-96ca-482e-a63f-7ca069746097_4_a3rn_g Sep 28 11:55:59 devstack sudo[99683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:59 devstack sudo[99683]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_22f76933-96ca-482e-a63f-7ca069746097_4_a3rn_g" returned: 1 in 0.351s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_22f76933-96ca-482e-a63f-7ca069746097_4_a3rn_g' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 11:55:59 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0237ac-6eaa-4993-b2b0-afa77fe7d33d]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:55:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_22f76933-96ca-482e-a63f-7ca069746097_3m2ohkuudevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:59 devstack sudo[99684]: pam_unix(sudo:session): session closed for user root Sep 28 11:55:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a76aa5a9-299f-4428-a8ee-6d40f2f800b6 tempest-GroupSnapshotsV319Test-1968687007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8f1d5c8d-fe01-467e-8ad5-82e027380acf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8f1d5c8d-fe01-467e-8ad5-82e027380acf.8c8e9cf2-bc1a-4551-b013-c09c9aa29390 1G" returned: 0 in 0.419s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:55:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a76aa5a9-299f-4428-a8ee-6d40f2f800b6 tempest-GroupSnapshotsV319Test-1968687007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f1d5c8d-fe01-467e-8ad5-82e027380acf -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8f1d5c8d-fe01-467e-8ad5-82e027380acf.8c8e9cf2-bc1a-4551-b013-c09c9aa29390 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:55:59 devstack sudo[99693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f1d5c8d-fe01-467e-8ad5-82e027380acf -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8f1d5c8d-fe01-467e-8ad5-82e027380acf.8c8e9cf2-bc1a-4551-b013-c09c9aa29390 Sep 28 11:55:59 devstack sudo[99693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:55:59 devstack sudo[99692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_22f76933-96ca-482e-a63f-7ca069746097_3m2ohkuudevstack@QuobyteHD Sep 28 11:55:59 devstack sudo[99692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:00 devstack sudo[99692]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_22f76933-96ca-482e-a63f-7ca069746097_3m2ohkuudevstack@QuobyteHD" returned: 0 in 0.344s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:00 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] 22f76933-96ca-482e-a63f-7ca069746097 was qcow2, converting to qcow2 {{(pid=86916) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 11:56:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_22f76933-96ca-482e-a63f-7ca069746097_3m2ohkuudevstack@QuobyteHD /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5cf9c6db-c02f-4740-b425-bcbd04bb5b8d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:00 devstack sudo[99693]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a76aa5a9-299f-4428-a8ee-6d40f2f800b6 tempest-GroupSnapshotsV319Test-1968687007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f1d5c8d-fe01-467e-8ad5-82e027380acf -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8f1d5c8d-fe01-467e-8ad5-82e027380acf.8c8e9cf2-bc1a-4551-b013-c09c9aa29390" returned: 0 in 0.301s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:00 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-a76aa5a9-299f-4428-a8ee-6d40f2f800b6 tempest-GroupSnapshotsV319Test-1968687007 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8f1d5c8d-fe01-467e-8ad5-82e027380acf.8c8e9cf2-bc1a-4551-b013-c09c9aa29390 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 11:56:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a76aa5a9-299f-4428-a8ee-6d40f2f800b6 tempest-GroupSnapshotsV319Test-1968687007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8f1d5c8d-fe01-467e-8ad5-82e027380acf.8c8e9cf2-bc1a-4551-b013-c09c9aa29390 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:00 devstack sudo[99703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_22f76933-96ca-482e-a63f-7ca069746097_3m2ohkuudevstack@QuobyteHD /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5cf9c6db-c02f-4740-b425-bcbd04bb5b8d Sep 28 11:56:00 devstack sudo[99703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:00 devstack sudo[99705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8f1d5c8d-fe01-467e-8ad5-82e027380acf.8c8e9cf2-bc1a-4551-b013-c09c9aa29390 Sep 28 11:56:00 devstack sudo[99705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:00 devstack sudo[99705]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a76aa5a9-299f-4428-a8ee-6d40f2f800b6 tempest-GroupSnapshotsV319Test-1968687007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8f1d5c8d-fe01-467e-8ad5-82e027380acf.8c8e9cf2-bc1a-4551-b013-c09c9aa29390" returned: 0 in 0.252s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a76aa5a9-299f-4428-a8ee-6d40f2f800b6 tempest-GroupSnapshotsV319Test-1968687007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8f1d5c8d-fe01-467e-8ad5-82e027380acf.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:00 devstack sudo[99711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8f1d5c8d-fe01-467e-8ad5-82e027380acf.info Sep 28 11:56:00 devstack sudo[99711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:00 devstack sudo[99711]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a76aa5a9-299f-4428-a8ee-6d40f2f800b6 tempest-GroupSnapshotsV319Test-1968687007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8f1d5c8d-fe01-467e-8ad5-82e027380acf.info" returned: 0 in 0.310s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:00 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-a76aa5a9-299f-4428-a8ee-6d40f2f800b6 tempest-GroupSnapshotsV319Test-1968687007 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8f1d5c8d-fe01-467e-8ad5-82e027380acf.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 11:56:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a76aa5a9-299f-4428-a8ee-6d40f2f800b6 tempest-GroupSnapshotsV319Test-1968687007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8f1d5c8d-fe01-467e-8ad5-82e027380acf.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:00 devstack sudo[99718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8f1d5c8d-fe01-467e-8ad5-82e027380acf.info Sep 28 11:56:00 devstack sudo[99718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:01 devstack sudo[99718]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a76aa5a9-299f-4428-a8ee-6d40f2f800b6 tempest-GroupSnapshotsV319Test-1968687007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8f1d5c8d-fe01-467e-8ad5-82e027380acf.info" returned: 0 in 0.298s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a76aa5a9-299f-4428-a8ee-6d40f2f800b6 tempest-GroupSnapshotsV319Test-1968687007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.120s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:56:01 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=144,cinder:INSERT=44,cinder:UPDATE=155,cinder:DELETE=5 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 11:56:01 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9485f99-eea8-46bf-8f88-bd272b8acc72 tempest-GroupsV314Test-1723056726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:56:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f9485f99-eea8-46bf-8f88-bd272b8acc72 tempest-GroupsV314Test-1723056726 None] Flow 'volume_create_manager' (f7de3cd0-72c1-461d-b860-f98924d90ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:56:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f9485f99-eea8-46bf-8f88-bd272b8acc72 tempest-GroupsV314Test-1723056726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19c08d7a-d1e2-4f0e-bd1c-158a28513aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:56:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f9485f99-eea8-46bf-8f88-bd272b8acc72 tempest-GroupsV314Test-1723056726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19c08d7a-d1e2-4f0e-bd1c-158a28513aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:56:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-702271068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6363744a-f29d-439f-9dfd-940a2af0e3a1,host='devstack@QuobyteHD#QuobyteHD',id=294592a6-e8c7-43b3-834e-a672d8b2e8ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1d68396e880427cbf4a09ed8adac3f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:56:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:56:01Z,use_quota=True,user_id='ea35c13a3ae34304a5db4970c69bfd43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e791f3bd-8720-46a1-8f42-dc27011e4351),volume_type_id=e791f3bd-8720-46a1-8f42-dc27011e4351)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:56:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f9485f99-eea8-46bf-8f88-bd272b8acc72 tempest-GroupsV314Test-1723056726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b866031-505c-4f8b-9616-374c26fc0091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:56:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f9485f99-eea8-46bf-8f88-bd272b8acc72 tempest-GroupsV314Test-1723056726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b866031-505c-4f8b-9616-374c26fc0091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:56:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f9485f99-eea8-46bf-8f88-bd272b8acc72 tempest-GroupsV314Test-1723056726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee1bcff8-b9ed-482e-94a6-5c9f0f21182d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:56:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f9485f99-eea8-46bf-8f88-bd272b8acc72 tempest-GroupsV314Test-1723056726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee1bcff8-b9ed-482e-94a6-5c9f0f21182d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '294592a6-e8c7-43b3-834e-a672d8b2e8ba', 'volume_name': 'volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:56:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f9485f99-eea8-46bf-8f88-bd272b8acc72 tempest-GroupsV314Test-1723056726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14a9d342-4860-4e4d-8db9-6931bc5a826c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:56:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f9485f99-eea8-46bf-8f88-bd272b8acc72 tempest-GroupsV314Test-1723056726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14a9d342-4860-4e4d-8db9-6931bc5a826c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:56:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f9485f99-eea8-46bf-8f88-bd272b8acc72 tempest-GroupsV314Test-1723056726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1978e25b-6485-42cc-b32e-35d9c8190d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:56:01 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-f9485f99-eea8-46bf-8f88-bd272b8acc72 tempest-GroupsV314Test-1723056726 None] Volume 294592a6-e8c7-43b3-834e-a672d8b2e8ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba', 'volume_size': 1} Sep 28 11:56:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f9485f99-eea8-46bf-8f88-bd272b8acc72 tempest-GroupsV314Test-1723056726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:56:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f9485f99-eea8-46bf-8f88-bd272b8acc72 tempest-GroupsV314Test-1723056726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:56:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f9485f99-eea8-46bf-8f88-bd272b8acc72 tempest-GroupsV314Test-1723056726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6363744a-f29d-439f-9dfd-940a2af0e3a1,created_at=2026-09-28T09:56:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-702271068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6363744a-f29d-439f-9dfd-940a2af0e3a1,host='devstack@QuobyteHD#QuobyteHD',id=294592a6-e8c7-43b3-834e-a672d8b2e8ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1d68396e880427cbf4a09ed8adac3f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:56:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:56:01Z,use_quota=True,user_id='ea35c13a3ae34304a5db4970c69bfd43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e791f3bd-8720-46a1-8f42-dc27011e4351),volume_type_id=e791f3bd-8720-46a1-8f42-dc27011e4351)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:56:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-f9485f99-eea8-46bf-8f88-bd272b8acc72 tempest-GroupsV314Test-1723056726 None] Creating volume 294592a6-e8c7-43b3-834e-a672d8b2e8ba {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:56:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f9485f99-eea8-46bf-8f88-bd272b8acc72 tempest-GroupsV314Test-1723056726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:56:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f9485f99-eea8-46bf-8f88-bd272b8acc72 tempest-GroupsV314Test-1723056726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:56:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f9485f99-eea8-46bf-8f88-bd272b8acc72 tempest-GroupsV314Test-1723056726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:56:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f9485f99-eea8-46bf-8f88-bd272b8acc72 tempest-GroupsV314Test-1723056726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:56:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f9485f99-eea8-46bf-8f88-bd272b8acc72 tempest-GroupsV314Test-1723056726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:56:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f9485f99-eea8-46bf-8f88-bd272b8acc72 tempest-GroupsV314Test-1723056726 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:56:01 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-f9485f99-eea8-46bf-8f88-bd272b8acc72 tempest-GroupsV314Test-1723056726 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:56:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f9485f99-eea8-46bf-8f88-bd272b8acc72 tempest-GroupsV314Test-1723056726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:01 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-a76aa5a9-299f-4428-a8ee-6d40f2f800b6 tempest-GroupSnapshotsV319Test-1968687007 None] group_snapshot 54ece077-20eb-4370-bcb3-803e892e2a91: created successfully Sep 28 11:56:01 devstack sudo[99721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba 1073741824 Sep 28 11:56:01 devstack sudo[99721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:01 devstack sudo[99721]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f9485f99-eea8-46bf-8f88-bd272b8acc72 tempest-GroupsV314Test-1723056726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba 1073741824" returned: 0 in 0.562s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f9485f99-eea8-46bf-8f88-bd272b8acc72 tempest-GroupsV314Test-1723056726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:01 devstack sudo[99727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba Sep 28 11:56:01 devstack sudo[99727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:02 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-7c3628d1-e9d6-4d7a-b26a-6721c8aad910 tempest-GroupSnapshotsV319Test-1968687007 None] group_snapshot 54ece077-20eb-4370-bcb3-803e892e2a91: deleting Sep 28 11:56:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7c3628d1-e9d6-4d7a-b26a-6721c8aad910 tempest-GroupSnapshotsV319Test-1968687007 None] group_snapshot 54ece077-20eb-4370-bcb3-803e892e2a91: deleting {{(pid=86916) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 11:56:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7c3628d1-e9d6-4d7a-b26a-6721c8aad910 tempest-GroupSnapshotsV319Test-1968687007 None] Acquiring lock "cinder-quobyte-8f1d5c8d-fe01-467e-8ad5-82e027380acf" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:56:02 devstack sudo[99727]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7c3628d1-e9d6-4d7a-b26a-6721c8aad910 tempest-GroupSnapshotsV319Test-1968687007 None] Lock "cinder-quobyte-8f1d5c8d-fe01-467e-8ad5-82e027380acf" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:56:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7c3628d1-e9d6-4d7a-b26a-6721c8aad910 tempest-GroupSnapshotsV319Test-1968687007 None] Acquiring lock "cinder-quobyte-8c8e9cf2-bc1a-4551-b013-c09c9aa29390" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:56:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f9485f99-eea8-46bf-8f88-bd272b8acc72 tempest-GroupsV314Test-1723056726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba" returned: 0 in 0.290s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f9485f99-eea8-46bf-8f88-bd272b8acc72 tempest-GroupsV314Test-1723056726 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:56:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f9485f99-eea8-46bf-8f88-bd272b8acc72 tempest-GroupsV314Test-1723056726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:56:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7c3628d1-e9d6-4d7a-b26a-6721c8aad910 tempest-GroupSnapshotsV319Test-1968687007 None] Lock "cinder-quobyte-8c8e9cf2-bc1a-4551-b013-c09c9aa29390" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:56:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-7c3628d1-e9d6-4d7a-b26a-6721c8aad910 tempest-GroupSnapshotsV319Test-1968687007 None] Deleting offline snapshot 8c8e9cf2-bc1a-4551-b013-c09c9aa29390 of volume 8f1d5c8d-fe01-467e-8ad5-82e027380acf {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 11:56:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-7c3628d1-e9d6-4d7a-b26a-6721c8aad910 tempest-GroupSnapshotsV319Test-1968687007 None] snapshot_file for this snap is: volume-8f1d5c8d-fe01-467e-8ad5-82e027380acf.8c8e9cf2-bc1a-4551-b013-c09c9aa29390 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 11:56:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f9485f99-eea8-46bf-8f88-bd272b8acc72 tempest-GroupsV314Test-1723056726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1978e25b-6485-42cc-b32e-35d9c8190d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:56:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f9485f99-eea8-46bf-8f88-bd272b8acc72 tempest-GroupsV314Test-1723056726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12dc0d6c-d70a-42f0-87cf-327f49b6b63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:56:02 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f2fd20-98de-46a4-a5a0-01c8b149dbcd]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:56:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7c3628d1-e9d6-4d7a-b26a-6721c8aad910 tempest-GroupSnapshotsV319Test-1968687007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8f1d5c8d-fe01-467e-8ad5-82e027380acf.8c8e9cf2-bc1a-4551-b013-c09c9aa29390 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:02 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-f9485f99-eea8-46bf-8f88-bd272b8acc72 tempest-GroupsV314Test-1723056726 None] Volume volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba (294592a6-e8c7-43b3-834e-a672d8b2e8ba): created successfully Sep 28 11:56:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f9485f99-eea8-46bf-8f88-bd272b8acc72 tempest-GroupsV314Test-1723056726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12dc0d6c-d70a-42f0-87cf-327f49b6b63c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:56:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f9485f99-eea8-46bf-8f88-bd272b8acc72 tempest-GroupsV314Test-1723056726 None] Flow 'volume_create_manager' (f7de3cd0-72c1-461d-b860-f98924d90ba0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:56:02 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-f9485f99-eea8-46bf-8f88-bd272b8acc72 tempest-GroupsV314Test-1723056726 None] Created volume successfully. Sep 28 11:56:02 devstack sudo[99730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8f1d5c8d-fe01-467e-8ad5-82e027380acf.8c8e9cf2-bc1a-4551-b013-c09c9aa29390 Sep 28 11:56:02 devstack sudo[99730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:02 devstack sudo[99703]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_22f76933-96ca-482e-a63f-7ca069746097_3m2ohkuudevstack@QuobyteHD /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5cf9c6db-c02f-4740-b425-bcbd04bb5b8d" returned: 0 in 2.323s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:02 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_22f76933-96ca-482e-a63f-7ca069746097_3m2ohkuudevstack@QuobyteHD, size 112.00 MB, duration 2.32 sec, destination /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5cf9c6db-c02f-4740-b425-bcbd04bb5b8d {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 11:56:02 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] Converted 112.00 MB image at 48.20 MB/s Sep 28 11:56:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5cf9c6db-c02f-4740-b425-bcbd04bb5b8d 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:02 devstack sudo[99732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5cf9c6db-c02f-4740-b425-bcbd04bb5b8d 1G Sep 28 11:56:02 devstack sudo[99732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:02 devstack sudo[99730]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7c3628d1-e9d6-4d7a-b26a-6721c8aad910 tempest-GroupSnapshotsV319Test-1968687007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8f1d5c8d-fe01-467e-8ad5-82e027380acf.8c8e9cf2-bc1a-4551-b013-c09c9aa29390" returned: 0 in 0.410s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-7c3628d1-e9d6-4d7a-b26a-6721c8aad910 tempest-GroupSnapshotsV319Test-1968687007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f1d5c8d-fe01-467e-8ad5-82e027380acf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 11:56:02 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ab593a-a3ed-44d1-b7a9-cb07ce29fc41]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:56:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7c3628d1-e9d6-4d7a-b26a-6721c8aad910 tempest-GroupSnapshotsV319Test-1968687007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8f1d5c8d-fe01-467e-8ad5-82e027380acf {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:02 devstack sudo[99732]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5cf9c6db-c02f-4740-b425-bcbd04bb5b8d 1G" returned: 0 in 0.342s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:02 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] Downloaded image 22f76933-96ca-482e-a63f-7ca069746097 ((None, [{'url': 'file:///opt/stack/data/glance/images/22f76933-96ca-482e-a63f-7ca069746097', 'metadata': {}}])) to volume 5cf9c6db-c02f-4740-b425-bcbd04bb5b8d successfully. {{(pid=86916) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 11:56:02 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] Temporary image 22f76933-96ca-482e-a63f-7ca069746097 for user 345e380e57a14c82bf7f9bb14449ee09 is deleted. {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 11:56:02 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] Marking volume 5cf9c6db-c02f-4740-b425-bcbd04bb5b8d as bootable. {{(pid=86916) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 11:56:02 devstack sudo[99740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8f1d5c8d-fe01-467e-8ad5-82e027380acf Sep 28 11:56:02 devstack sudo[99740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:02 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] Copying metadata from image 22f76933-96ca-482e-a63f-7ca069746097 to 5cf9c6db-c02f-4740-b425-bcbd04bb5b8d. {{(pid=86916) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 11:56:02 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] Creating volume glance metadata for volume 5cf9c6db-c02f-4740-b425-bcbd04bb5b8d backed by image 22f76933-96ca-482e-a63f-7ca069746097 with: {'image_id': '22f76933-96ca-482e-a63f-7ca069746097', 'image_name': 'tempest-scenario-img--1214088332', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86916) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 11:56:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1fb1208-655f-4056-9cea-a6312c6d43ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cf9c6db-c02f-4740-b425-bcbd04bb5b8d', 'volume_size': 1, 'image_id': '22f76933-96ca-482e-a63f-7ca069746097', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/22f76933-96ca-482e-a63f-7ca069746097', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1214088332', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '839e4f7e614c4f538dacab7788d08db0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '22f76933-96ca-482e-a63f-7ca069746097', 'created_at': datetime.datetime(2026, 9, 28, 9, 55, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 9, 55, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/22f76933-96ca-482e-a63f-7ca069746097/file', 'properties': {}}, 'image_service': }' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:56:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7be9c1a-e0d9-4200-937d-db698ba37e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:56:02 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] Volume volume-5cf9c6db-c02f-4740-b425-bcbd04bb5b8d (5cf9c6db-c02f-4740-b425-bcbd04bb5b8d): created successfully Sep 28 11:56:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7be9c1a-e0d9-4200-937d-db698ba37e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:56:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] Flow 'volume_create_manager' (0cf7a0a8-bf33-4251-b3f2-b560cc95ecdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:56:02 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-854c1aaf-807d-4fb2-82fb-b0f90d41d50c tempest-TestInstancesWithCinderVolumes-991430352 None] Created volume successfully. Sep 28 11:56:03 devstack sudo[99740]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7c3628d1-e9d6-4d7a-b26a-6721c8aad910 tempest-GroupSnapshotsV319Test-1968687007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8f1d5c8d-fe01-467e-8ad5-82e027380acf" returned: 0 in 0.381s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7c3628d1-e9d6-4d7a-b26a-6721c8aad910 tempest-GroupSnapshotsV319Test-1968687007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8f1d5c8d-fe01-467e-8ad5-82e027380acf.8c8e9cf2-bc1a-4551-b013-c09c9aa29390 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:03 devstack sudo[99745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8f1d5c8d-fe01-467e-8ad5-82e027380acf.8c8e9cf2-bc1a-4551-b013-c09c9aa29390 Sep 28 11:56:03 devstack sudo[99745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:03 devstack sudo[99745]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7c3628d1-e9d6-4d7a-b26a-6721c8aad910 tempest-GroupSnapshotsV319Test-1968687007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8f1d5c8d-fe01-467e-8ad5-82e027380acf.8c8e9cf2-bc1a-4551-b013-c09c9aa29390" returned: 0 in 0.328s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7c3628d1-e9d6-4d7a-b26a-6721c8aad910 tempest-GroupSnapshotsV319Test-1968687007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8f1d5c8d-fe01-467e-8ad5-82e027380acf.8c8e9cf2-bc1a-4551-b013-c09c9aa29390 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:03 devstack sudo[99750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8f1d5c8d-fe01-467e-8ad5-82e027380acf.8c8e9cf2-bc1a-4551-b013-c09c9aa29390 Sep 28 11:56:03 devstack sudo[99750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:03 devstack sudo[99750]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7c3628d1-e9d6-4d7a-b26a-6721c8aad910 tempest-GroupSnapshotsV319Test-1968687007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8f1d5c8d-fe01-467e-8ad5-82e027380acf.8c8e9cf2-bc1a-4551-b013-c09c9aa29390" returned: 0 in 0.270s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7c3628d1-e9d6-4d7a-b26a-6721c8aad910 tempest-GroupSnapshotsV319Test-1968687007 None] Lock "cinder-quobyte-8c8e9cf2-bc1a-4551-b013-c09c9aa29390" released by "_delete_snapshot" :: held 1.542s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:56:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7c3628d1-e9d6-4d7a-b26a-6721c8aad910 tempest-GroupSnapshotsV319Test-1968687007 None] Lock "cinder-quobyte-8f1d5c8d-fe01-467e-8ad5-82e027380acf" released by "delete_snapshot" :: held 1.576s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:56:03 devstack cinder-volume[86916]: WARNING cinder.quota [None req-7c3628d1-e9d6-4d7a-b26a-6721c8aad910 tempest-GroupSnapshotsV319Test-1968687007 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-106176932 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-106176932, it is now deprecated. Please use the default quota class for default quota. Sep 28 11:56:03 devstack cinder-volume[86916]: WARNING cinder.quota [None req-7c3628d1-e9d6-4d7a-b26a-6721c8aad910 tempest-GroupSnapshotsV319Test-1968687007 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-106176932 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-106176932, it is now deprecated. Please use the default quota class for default quota. Sep 28 11:56:03 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-7c3628d1-e9d6-4d7a-b26a-6721c8aad910 tempest-GroupSnapshotsV319Test-1968687007 None] Created reservations ['5c68acee-8723-449f-8809-65122bd697f8', '87663ca0-6738-48d2-99c3-ca2f86e8867c', '7b3eb504-23e5-45e8-b08d-5447b7089afd', '2d124eae-7340-4516-8c19-3cd16f298f15'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:56:03 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-7c3628d1-e9d6-4d7a-b26a-6721c8aad910 tempest-GroupSnapshotsV319Test-1968687007 None] group_snapshot 54ece077-20eb-4370-bcb3-803e892e2a91: deleted successfully Sep 28 11:56:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c7f30efa-fff6-4a18-80d0-eba019f6e0e8 tempest-GroupsV314Test-1723056726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:56:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c7f30efa-fff6-4a18-80d0-eba019f6e0e8 tempest-GroupsV314Test-1723056726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:56:04 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-c7f30efa-fff6-4a18-80d0-eba019f6e0e8 tempest-GroupsV314Test-1723056726 None] Cloning volume 294592a6-e8c7-43b3-834e-a672d8b2e8ba to volume 3dd3e3b2-e749-4ebe-b329-70c867b1d2cf Sep 28 11:56:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-c7f30efa-fff6-4a18-80d0-eba019f6e0e8 tempest-GroupsV314Test-1723056726 None] Creating offline snapshot 4cda3777-c80f-4cdd-a2f5-3035864bf54b of volume 294592a6-e8c7-43b3-834e-a672d8b2e8ba {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 11:56:04 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[4601c574-ce14-477d-aeda-7d52ab5cae78]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:56:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c7f30efa-fff6-4a18-80d0-eba019f6e0e8 tempest-GroupsV314Test-1723056726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:04 devstack sudo[99753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba Sep 28 11:56:04 devstack sudo[99753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:04 devstack sudo[99753]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c7f30efa-fff6-4a18-80d0-eba019f6e0e8 tempest-GroupsV314Test-1723056726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba" returned: 0 in 0.409s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c7f30efa-fff6-4a18-80d0-eba019f6e0e8 tempest-GroupsV314Test-1723056726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba.4cda3777-c80f-4cdd-a2f5-3035864bf54b 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:04 devstack sudo[99758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba.4cda3777-c80f-4cdd-a2f5-3035864bf54b 1G Sep 28 11:56:04 devstack sudo[99758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:04 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-98bffca0-0590-4fe2-bb84-ddf8baea0843 tempest-GroupSnapshotsV319Test-1968687007 None] Acquiring lock "cinder-quobyte-8f1d5c8d-fe01-467e-8ad5-82e027380acf" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:56:04 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-98bffca0-0590-4fe2-bb84-ddf8baea0843 tempest-GroupSnapshotsV319Test-1968687007 None] Lock "cinder-quobyte-8f1d5c8d-fe01-467e-8ad5-82e027380acf" acquired by "delete_volume" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:56:04 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc4ee9d-fbdc-4afa-b049-1d8842fccf8a]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:56:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-98bffca0-0590-4fe2-bb84-ddf8baea0843 tempest-GroupSnapshotsV319Test-1968687007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8f1d5c8d-fe01-467e-8ad5-82e027380acf {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:04 devstack sudo[99760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8f1d5c8d-fe01-467e-8ad5-82e027380acf Sep 28 11:56:04 devstack sudo[99760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:05 devstack sudo[99758]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c7f30efa-fff6-4a18-80d0-eba019f6e0e8 tempest-GroupsV314Test-1723056726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba.4cda3777-c80f-4cdd-a2f5-3035864bf54b 1G" returned: 0 in 0.510s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c7f30efa-fff6-4a18-80d0-eba019f6e0e8 tempest-GroupsV314Test-1723056726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba.4cda3777-c80f-4cdd-a2f5-3035864bf54b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:05 devstack sudo[99770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba.4cda3777-c80f-4cdd-a2f5-3035864bf54b Sep 28 11:56:05 devstack sudo[99770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:05 devstack sudo[99760]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-98bffca0-0590-4fe2-bb84-ddf8baea0843 tempest-GroupSnapshotsV319Test-1968687007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8f1d5c8d-fe01-467e-8ad5-82e027380acf" returned: 0 in 0.470s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-98bffca0-0590-4fe2-bb84-ddf8baea0843 tempest-GroupSnapshotsV319Test-1968687007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8f1d5c8d-fe01-467e-8ad5-82e027380acf {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:05 devstack sudo[99773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8f1d5c8d-fe01-467e-8ad5-82e027380acf Sep 28 11:56:05 devstack sudo[99773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:05 devstack sudo[99770]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c7f30efa-fff6-4a18-80d0-eba019f6e0e8 tempest-GroupsV314Test-1723056726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba.4cda3777-c80f-4cdd-a2f5-3035864bf54b" returned: 0 in 0.321s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:05 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-c7f30efa-fff6-4a18-80d0-eba019f6e0e8 tempest-GroupsV314Test-1723056726 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba.4cda3777-c80f-4cdd-a2f5-3035864bf54b is being set with open permissions: ugo+rw: NotImplementedError Sep 28 11:56:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c7f30efa-fff6-4a18-80d0-eba019f6e0e8 tempest-GroupsV314Test-1723056726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba.4cda3777-c80f-4cdd-a2f5-3035864bf54b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:05 devstack sudo[99779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba.4cda3777-c80f-4cdd-a2f5-3035864bf54b Sep 28 11:56:05 devstack sudo[99779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:05 devstack sudo[99773]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-98bffca0-0590-4fe2-bb84-ddf8baea0843 tempest-GroupSnapshotsV319Test-1968687007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8f1d5c8d-fe01-467e-8ad5-82e027380acf" returned: 0 in 0.309s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-98bffca0-0590-4fe2-bb84-ddf8baea0843 tempest-GroupSnapshotsV319Test-1968687007 None] Lock "cinder-quobyte-8f1d5c8d-fe01-467e-8ad5-82e027380acf" released by "delete_volume" :: held 0.890s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:56:05 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-98bffca0-0590-4fe2-bb84-ddf8baea0843 tempest-GroupSnapshotsV319Test-1968687007 None] Created reservations ['959c8bbf-e9af-49dd-a4c5-ec1dd7ab5953'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:56:05 devstack cinder-volume[86916]: WARNING cinder.quota [None req-98bffca0-0590-4fe2-bb84-ddf8baea0843 tempest-GroupSnapshotsV319Test-1968687007 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-106176932 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-106176932, it is now deprecated. Please use the default quota class for default quota. Sep 28 11:56:05 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-98bffca0-0590-4fe2-bb84-ddf8baea0843 tempest-GroupSnapshotsV319Test-1968687007 None] Created reservations ['f960c338-4336-4302-9c39-9f2ba2385a73', 'b4f70920-f36c-4420-bcb6-540179cb6d76', 'b5640007-4ed9-4092-9edb-bf74dd4fa134', '1f67b9df-b310-4899-8728-5a8b23cb82e0'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:56:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c7f30efa-fff6-4a18-80d0-eba019f6e0e8 tempest-GroupsV314Test-1723056726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba.4cda3777-c80f-4cdd-a2f5-3035864bf54b" returned: 0 in 0.371s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:05 devstack sudo[99779]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c7f30efa-fff6-4a18-80d0-eba019f6e0e8 tempest-GroupsV314Test-1723056726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:06 devstack sudo[99785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba.info Sep 28 11:56:06 devstack sudo[99785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-98bffca0-0590-4fe2-bb84-ddf8baea0843 tempest-GroupSnapshotsV319Test-1968687007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:56:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-98bffca0-0590-4fe2-bb84-ddf8baea0843 tempest-GroupSnapshotsV319Test-1968687007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:56:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-98bffca0-0590-4fe2-bb84-ddf8baea0843 tempest-GroupSnapshotsV319Test-1968687007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:56:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-98bffca0-0590-4fe2-bb84-ddf8baea0843 tempest-GroupSnapshotsV319Test-1968687007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:56:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-98bffca0-0590-4fe2-bb84-ddf8baea0843 tempest-GroupSnapshotsV319Test-1968687007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:56:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-98bffca0-0590-4fe2-bb84-ddf8baea0843 tempest-GroupSnapshotsV319Test-1968687007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:06 devstack sudo[99787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:56:06 devstack sudo[99787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:06 devstack sudo[99785]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c7f30efa-fff6-4a18-80d0-eba019f6e0e8 tempest-GroupsV314Test-1723056726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba.info" returned: 0 in 0.276s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:06 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-c7f30efa-fff6-4a18-80d0-eba019f6e0e8 tempest-GroupsV314Test-1723056726 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 11:56:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c7f30efa-fff6-4a18-80d0-eba019f6e0e8 tempest-GroupsV314Test-1723056726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:06 devstack sudo[99790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba.info Sep 28 11:56:06 devstack sudo[99790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:06 devstack sudo[99787]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-98bffca0-0590-4fe2-bb84-ddf8baea0843 tempest-GroupSnapshotsV319Test-1968687007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.271s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:06 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-98bffca0-0590-4fe2-bb84-ddf8baea0843 tempest-GroupSnapshotsV319Test-1968687007 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:56:06 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-98bffca0-0590-4fe2-bb84-ddf8baea0843 tempest-GroupSnapshotsV319Test-1968687007 None] Delete group completed successfully. Sep 28 11:56:06 devstack sudo[99790]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c7f30efa-fff6-4a18-80d0-eba019f6e0e8 tempest-GroupsV314Test-1723056726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba.info" returned: 0 in 0.295s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c7f30efa-fff6-4a18-80d0-eba019f6e0e8 tempest-GroupsV314Test-1723056726 None] Acquiring lock "cinder-quobyte-3dd3e3b2-e749-4ebe-b329-70c867b1d2cf" by "_copy_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:56:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c7f30efa-fff6-4a18-80d0-eba019f6e0e8 tempest-GroupsV314Test-1723056726 None] Lock "cinder-quobyte-3dd3e3b2-e749-4ebe-b329-70c867b1d2cf" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:56:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c7f30efa-fff6-4a18-80d0-eba019f6e0e8 tempest-GroupsV314Test-1723056726 None] snapshot: 4cda3777-c80f-4cdd-a2f5-3035864bf54b, volume: 3dd3e3b2-e749-4ebe-b329-70c867b1d2cf, {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 11:56:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c7f30efa-fff6-4a18-80d0-eba019f6e0e8 tempest-GroupsV314Test-1723056726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:56:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c7f30efa-fff6-4a18-80d0-eba019f6e0e8 tempest-GroupsV314Test-1723056726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:56:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c7f30efa-fff6-4a18-80d0-eba019f6e0e8 tempest-GroupsV314Test-1723056726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:56:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c7f30efa-fff6-4a18-80d0-eba019f6e0e8 tempest-GroupsV314Test-1723056726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:56:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c7f30efa-fff6-4a18-80d0-eba019f6e0e8 tempest-GroupsV314Test-1723056726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:56:06 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f48faa7-a72f-4380-8262-aa44f60dd8ca]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:56:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c7f30efa-fff6-4a18-80d0-eba019f6e0e8 tempest-GroupsV314Test-1723056726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba.4cda3777-c80f-4cdd-a2f5-3035864bf54b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:06 devstack sudo[99828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba.4cda3777-c80f-4cdd-a2f5-3035864bf54b Sep 28 11:56:06 devstack sudo[99828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:07 devstack sudo[99828]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c7f30efa-fff6-4a18-80d0-eba019f6e0e8 tempest-GroupsV314Test-1723056726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba.4cda3777-c80f-4cdd-a2f5-3035864bf54b" returned: 0 in 0.447s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-c7f30efa-fff6-4a18-80d0-eba019f6e0e8 tempest-GroupsV314Test-1723056726 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 11:56:07 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[03eaa083-360e-416f-9f7b-27805a3c9aa1]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:56:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c7f30efa-fff6-4a18-80d0-eba019f6e0e8 tempest-GroupsV314Test-1723056726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:07 devstack sudo[99836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba Sep 28 11:56:07 devstack sudo[99836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:07 devstack sudo[99836]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c7f30efa-fff6-4a18-80d0-eba019f6e0e8 tempest-GroupsV314Test-1723056726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba" returned: 0 in 0.493s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c7f30efa-fff6-4a18-80d0-eba019f6e0e8 tempest-GroupsV314Test-1723056726 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 11:56:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c7f30efa-fff6-4a18-80d0-eba019f6e0e8 tempest-GroupsV314Test-1723056726 None] Creating direct copy from snapshot {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 11:56:07 devstack cinder-volume[86916]: DEBUG cinder.utils [None req-c7f30efa-fff6-4a18-80d0-eba019f6e0e8 tempest-GroupsV314Test-1723056726 None] Path /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3dd3e3b2-e749-4ebe-b329-70c867b1d2cf not found in is_blk_device check {{(pid=86916) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 11:56:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c7f30efa-fff6-4a18-80d0-eba019f6e0e8 tempest-GroupsV314Test-1723056726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3dd3e3b2-e749-4ebe-b329-70c867b1d2cf {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:07 devstack sudo[99849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3dd3e3b2-e749-4ebe-b329-70c867b1d2cf Sep 28 11:56:07 devstack sudo[99849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-639b40c2-81af-4cd7-a606-5f81ca10df05 req-be42b27e-8986-4f50-9bde-0b57777b1c38 tempest-TestInstancesWithCinderVolumes-991430352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:56:13 devstack sudo[99849]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c7f30efa-fff6-4a18-80d0-eba019f6e0e8 tempest-GroupsV314Test-1723056726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3dd3e3b2-e749-4ebe-b329-70c867b1d2cf" returned: 0 in 6.273s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:13 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-c7f30efa-fff6-4a18-80d0-eba019f6e0e8 tempest-GroupsV314Test-1723056726 None] Image conversion details: src /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba, size 1024.00 MB, duration 6.27 sec, destination /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3dd3e3b2-e749-4ebe-b329-70c867b1d2cf {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 11:56:13 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-c7f30efa-fff6-4a18-80d0-eba019f6e0e8 tempest-GroupsV314Test-1723056726 None] Converted 1024.00 MB image at 163.21 MB/s Sep 28 11:56:13 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-c7f30efa-fff6-4a18-80d0-eba019f6e0e8 tempest-GroupsV314Test-1723056726 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3dd3e3b2-e749-4ebe-b329-70c867b1d2cf is being set with open permissions: ugo+rw: NotImplementedError Sep 28 11:56:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c7f30efa-fff6-4a18-80d0-eba019f6e0e8 tempest-GroupsV314Test-1723056726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3dd3e3b2-e749-4ebe-b329-70c867b1d2cf {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:13 devstack sudo[99863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3dd3e3b2-e749-4ebe-b329-70c867b1d2cf Sep 28 11:56:13 devstack sudo[99863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:14 devstack sudo[99863]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c7f30efa-fff6-4a18-80d0-eba019f6e0e8 tempest-GroupsV314Test-1723056726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3dd3e3b2-e749-4ebe-b329-70c867b1d2cf" returned: 0 in 0.242s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c7f30efa-fff6-4a18-80d0-eba019f6e0e8 tempest-GroupsV314Test-1723056726 None] Lock "cinder-quobyte-3dd3e3b2-e749-4ebe-b329-70c867b1d2cf" released by "_copy_volume_from_snapshot" :: held 7.541s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:56:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c7f30efa-fff6-4a18-80d0-eba019f6e0e8 tempest-GroupsV314Test-1723056726 None] Acquiring lock "cinder-quobyte-4cda3777-c80f-4cdd-a2f5-3035864bf54b" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:56:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c7f30efa-fff6-4a18-80d0-eba019f6e0e8 tempest-GroupsV314Test-1723056726 None] Lock "cinder-quobyte-4cda3777-c80f-4cdd-a2f5-3035864bf54b" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:56:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-c7f30efa-fff6-4a18-80d0-eba019f6e0e8 tempest-GroupsV314Test-1723056726 None] Deleting offline snapshot 4cda3777-c80f-4cdd-a2f5-3035864bf54b of volume 294592a6-e8c7-43b3-834e-a672d8b2e8ba {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 11:56:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-c7f30efa-fff6-4a18-80d0-eba019f6e0e8 tempest-GroupsV314Test-1723056726 None] snapshot_file for this snap is: volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba.4cda3777-c80f-4cdd-a2f5-3035864bf54b {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 11:56:14 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[5240bd40-ccf8-46bd-aff4-0a15a6df6ddb]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:56:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c7f30efa-fff6-4a18-80d0-eba019f6e0e8 tempest-GroupsV314Test-1723056726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba.4cda3777-c80f-4cdd-a2f5-3035864bf54b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:14 devstack sudo[99866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba.4cda3777-c80f-4cdd-a2f5-3035864bf54b Sep 28 11:56:14 devstack sudo[99866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:14 devstack sudo[99866]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c7f30efa-fff6-4a18-80d0-eba019f6e0e8 tempest-GroupsV314Test-1723056726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba.4cda3777-c80f-4cdd-a2f5-3035864bf54b" returned: 0 in 0.433s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-c7f30efa-fff6-4a18-80d0-eba019f6e0e8 tempest-GroupsV314Test-1723056726 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 11:56:14 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfe7e81-1fdc-4bde-b895-50a78e24b642]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:56:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c7f30efa-fff6-4a18-80d0-eba019f6e0e8 tempest-GroupsV314Test-1723056726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:14 devstack sudo[99871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba Sep 28 11:56:14 devstack sudo[99871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:15 devstack sudo[99871]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c7f30efa-fff6-4a18-80d0-eba019f6e0e8 tempest-GroupsV314Test-1723056726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba" returned: 0 in 0.724s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c7f30efa-fff6-4a18-80d0-eba019f6e0e8 tempest-GroupsV314Test-1723056726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba.4cda3777-c80f-4cdd-a2f5-3035864bf54b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:15 devstack sudo[99880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba.4cda3777-c80f-4cdd-a2f5-3035864bf54b Sep 28 11:56:15 devstack sudo[99880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:16 devstack sudo[99880]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c7f30efa-fff6-4a18-80d0-eba019f6e0e8 tempest-GroupsV314Test-1723056726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba.4cda3777-c80f-4cdd-a2f5-3035864bf54b" returned: 0 in 0.479s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c7f30efa-fff6-4a18-80d0-eba019f6e0e8 tempest-GroupsV314Test-1723056726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba.4cda3777-c80f-4cdd-a2f5-3035864bf54b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:16 devstack sudo[99889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba.4cda3777-c80f-4cdd-a2f5-3035864bf54b Sep 28 11:56:16 devstack sudo[99889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:16 devstack sudo[99889]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c7f30efa-fff6-4a18-80d0-eba019f6e0e8 tempest-GroupsV314Test-1723056726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba.4cda3777-c80f-4cdd-a2f5-3035864bf54b" returned: 0 in 0.294s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c7f30efa-fff6-4a18-80d0-eba019f6e0e8 tempest-GroupsV314Test-1723056726 None] Lock "cinder-quobyte-4cda3777-c80f-4cdd-a2f5-3035864bf54b" released by "_delete_snapshot" :: held 2.104s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:56:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c7f30efa-fff6-4a18-80d0-eba019f6e0e8 tempest-GroupsV314Test-1723056726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.190s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:56:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-639b40c2-81af-4cd7-a606-5f81ca10df05 req-be42b27e-8986-4f50-9bde-0b57777b1c38 tempest-TestInstancesWithCinderVolumes-991430352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.769s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:56:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-639b40c2-81af-4cd7-a606-5f81ca10df05 req-be42b27e-8986-4f50-9bde-0b57777b1c38 tempest-TestInstancesWithCinderVolumes-991430352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:56:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-639b40c2-81af-4cd7-a606-5f81ca10df05 req-be42b27e-8986-4f50-9bde-0b57777b1c38 tempest-TestInstancesWithCinderVolumes-991430352 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0', 'name': 'volume-5cf9c6db-c02f-4740-b425-bcbd04bb5b8d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '48439dfb-9844-4869-8db3-52787549b3cd', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 11:56:16 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-c7f30efa-fff6-4a18-80d0-eba019f6e0e8 tempest-GroupsV314Test-1723056726 None] Create group from source-group-6363744a-f29d-439f-9dfd-940a2af0e3a1 completed successfully. Sep 28 11:56:16 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-639b40c2-81af-4cd7-a606-5f81ca10df05 req-be42b27e-8986-4f50-9bde-0b57777b1c38 tempest-TestInstancesWithCinderVolumes-991430352 None] attachment_update completed successfully. Sep 28 11:56:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b72a32fe-5201-4008-8422-9fe0d83aa292 tempest-GroupsV314Test-1723056726 None] Acquiring lock "cinder-quobyte-3dd3e3b2-e749-4ebe-b329-70c867b1d2cf" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:56:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b72a32fe-5201-4008-8422-9fe0d83aa292 tempest-GroupsV314Test-1723056726 None] Lock "cinder-quobyte-3dd3e3b2-e749-4ebe-b329-70c867b1d2cf" acquired by "delete_volume" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:56:18 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d40d513-8392-4122-adb6-1830570eeaf6]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:56:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b72a32fe-5201-4008-8422-9fe0d83aa292 tempest-GroupsV314Test-1723056726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3dd3e3b2-e749-4ebe-b329-70c867b1d2cf {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:18 devstack sudo[100357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3dd3e3b2-e749-4ebe-b329-70c867b1d2cf Sep 28 11:56:18 devstack sudo[100357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:18 devstack sudo[100357]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b72a32fe-5201-4008-8422-9fe0d83aa292 tempest-GroupsV314Test-1723056726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3dd3e3b2-e749-4ebe-b329-70c867b1d2cf" returned: 0 in 0.399s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b72a32fe-5201-4008-8422-9fe0d83aa292 tempest-GroupsV314Test-1723056726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3dd3e3b2-e749-4ebe-b329-70c867b1d2cf {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:18 devstack sudo[100371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3dd3e3b2-e749-4ebe-b329-70c867b1d2cf Sep 28 11:56:18 devstack sudo[100371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:19 devstack sudo[100371]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b72a32fe-5201-4008-8422-9fe0d83aa292 tempest-GroupsV314Test-1723056726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3dd3e3b2-e749-4ebe-b329-70c867b1d2cf" returned: 0 in 0.278s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b72a32fe-5201-4008-8422-9fe0d83aa292 tempest-GroupsV314Test-1723056726 None] Lock "cinder-quobyte-3dd3e3b2-e749-4ebe-b329-70c867b1d2cf" released by "delete_volume" :: held 0.742s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:56:19 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-b72a32fe-5201-4008-8422-9fe0d83aa292 tempest-GroupsV314Test-1723056726 None] Created reservations ['eb055233-1a10-4058-aaf5-6490e09cc42b'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:56:19 devstack cinder-volume[86916]: WARNING cinder.quota [None req-b72a32fe-5201-4008-8422-9fe0d83aa292 tempest-GroupsV314Test-1723056726 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-342803309 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-342803309, it is now deprecated. Please use the default quota class for default quota. Sep 28 11:56:19 devstack cinder-volume[86916]: WARNING cinder.quota [None req-b72a32fe-5201-4008-8422-9fe0d83aa292 tempest-GroupsV314Test-1723056726 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-342803309 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-342803309, it is now deprecated. Please use the default quota class for default quota. Sep 28 11:56:19 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-b72a32fe-5201-4008-8422-9fe0d83aa292 tempest-GroupsV314Test-1723056726 None] Created reservations ['7cf1be70-ed82-495e-9bee-f181e526c2d6', 'c476a4dc-83c2-4999-a1b3-94bcce944bc2', 'c7021931-f377-4f6e-83db-2d2835a93d81', 'fd9a43f3-3190-4fe1-9ed5-a306c1d8790b'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:56:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b72a32fe-5201-4008-8422-9fe0d83aa292 tempest-GroupsV314Test-1723056726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:56:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b72a32fe-5201-4008-8422-9fe0d83aa292 tempest-GroupsV314Test-1723056726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:56:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b72a32fe-5201-4008-8422-9fe0d83aa292 tempest-GroupsV314Test-1723056726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:56:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b72a32fe-5201-4008-8422-9fe0d83aa292 tempest-GroupsV314Test-1723056726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:56:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b72a32fe-5201-4008-8422-9fe0d83aa292 tempest-GroupsV314Test-1723056726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:56:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b72a32fe-5201-4008-8422-9fe0d83aa292 tempest-GroupsV314Test-1723056726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:19 devstack sudo[100389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:56:19 devstack sudo[100389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:19 devstack sudo[100389]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b72a32fe-5201-4008-8422-9fe0d83aa292 tempest-GroupsV314Test-1723056726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.358s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:19 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-b72a32fe-5201-4008-8422-9fe0d83aa292 tempest-GroupsV314Test-1723056726 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:56:19 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b72a32fe-5201-4008-8422-9fe0d83aa292 tempest-GroupsV314Test-1723056726 None] Delete group completed successfully. Sep 28 11:56:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1482e19a-252b-4bdb-8d3e-c8957cfe8b85 tempest-GroupsV314Test-1723056726 None] Acquiring lock "cinder-quobyte-294592a6-e8c7-43b3-834e-a672d8b2e8ba" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:56:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1482e19a-252b-4bdb-8d3e-c8957cfe8b85 tempest-GroupsV314Test-1723056726 None] Lock "cinder-quobyte-294592a6-e8c7-43b3-834e-a672d8b2e8ba" acquired by "delete_volume" :: waited 0.031s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:56:19 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca13b02-b78d-4575-8fe1-90e35459dff1]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:56:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1482e19a-252b-4bdb-8d3e-c8957cfe8b85 tempest-GroupsV314Test-1723056726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:20 devstack sudo[100393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba Sep 28 11:56:20 devstack sudo[100393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:20 devstack sudo[100393]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1482e19a-252b-4bdb-8d3e-c8957cfe8b85 tempest-GroupsV314Test-1723056726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba" returned: 0 in 0.552s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1482e19a-252b-4bdb-8d3e-c8957cfe8b85 tempest-GroupsV314Test-1723056726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:20 devstack sudo[100400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba Sep 28 11:56:20 devstack sudo[100400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:20 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e6bc05c5-3eb7-42cf-8ba1-3592b6960d9c tempest-GroupsV320Test-1912364665 None] Group tempest-GroupsV320Test-Group-1688473275: creating Sep 28 11:56:20 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e6bc05c5-3eb7-42cf-8ba1-3592b6960d9c tempest-GroupsV320Test-1912364665 None] Group tempest-GroupsV320Test-Group-1688473275: created successfully Sep 28 11:56:20 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e6bc05c5-3eb7-42cf-8ba1-3592b6960d9c tempest-GroupsV320Test-1912364665 None] Create group completed successfully. Sep 28 11:56:20 devstack sudo[100400]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1482e19a-252b-4bdb-8d3e-c8957cfe8b85 tempest-GroupsV314Test-1723056726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-294592a6-e8c7-43b3-834e-a672d8b2e8ba" returned: 0 in 0.351s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1482e19a-252b-4bdb-8d3e-c8957cfe8b85 tempest-GroupsV314Test-1723056726 None] Lock "cinder-quobyte-294592a6-e8c7-43b3-834e-a672d8b2e8ba" released by "delete_volume" :: held 1.013s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:56:21 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-1482e19a-252b-4bdb-8d3e-c8957cfe8b85 tempest-GroupsV314Test-1723056726 None] Created reservations ['e2c1c92d-4dc6-4fad-98cf-0d5a9a36f2c6'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:56:21 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-1482e19a-252b-4bdb-8d3e-c8957cfe8b85 tempest-GroupsV314Test-1723056726 None] Created reservations ['5899ab1f-430c-4beb-8896-e86be3ab31e6', 'a9145319-1115-4a0a-8ba1-d7bd63a14e55', '808a18c0-2552-4499-9944-9c0cc71de181', '5dc4b489-b7c4-40d3-8630-debdf9e22c12'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:56:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1482e19a-252b-4bdb-8d3e-c8957cfe8b85 tempest-GroupsV314Test-1723056726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:56:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1482e19a-252b-4bdb-8d3e-c8957cfe8b85 tempest-GroupsV314Test-1723056726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:56:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1482e19a-252b-4bdb-8d3e-c8957cfe8b85 tempest-GroupsV314Test-1723056726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:56:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1482e19a-252b-4bdb-8d3e-c8957cfe8b85 tempest-GroupsV314Test-1723056726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:56:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1482e19a-252b-4bdb-8d3e-c8957cfe8b85 tempest-GroupsV314Test-1723056726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:56:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1482e19a-252b-4bdb-8d3e-c8957cfe8b85 tempest-GroupsV314Test-1723056726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:21 devstack sudo[100403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:56:21 devstack sudo[100403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:21 devstack sudo[100403]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1482e19a-252b-4bdb-8d3e-c8957cfe8b85 tempest-GroupsV314Test-1723056726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.294s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:21 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-1482e19a-252b-4bdb-8d3e-c8957cfe8b85 tempest-GroupsV314Test-1723056726 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:56:21 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-1482e19a-252b-4bdb-8d3e-c8957cfe8b85 tempest-GroupsV314Test-1723056726 None] Delete group completed successfully. Sep 28 11:56:22 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-298dc423-f368-4432-ac26-09e50603f757 tempest-GroupsV320Test-1912364665 None] Created reservations ['9c4fcccc-ae6a-41fb-a541-48877d8468f0'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:56:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-298dc423-f368-4432-ac26-09e50603f757 tempest-GroupsV320Test-1912364665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:56:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-298dc423-f368-4432-ac26-09e50603f757 tempest-GroupsV320Test-1912364665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:56:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-298dc423-f368-4432-ac26-09e50603f757 tempest-GroupsV320Test-1912364665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:56:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-298dc423-f368-4432-ac26-09e50603f757 tempest-GroupsV320Test-1912364665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:56:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-298dc423-f368-4432-ac26-09e50603f757 tempest-GroupsV320Test-1912364665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:56:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-298dc423-f368-4432-ac26-09e50603f757 tempest-GroupsV320Test-1912364665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:22 devstack sudo[100406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:56:22 devstack sudo[100406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:22 devstack sudo[100406]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-298dc423-f368-4432-ac26-09e50603f757 tempest-GroupsV320Test-1912364665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.388s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:22 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-298dc423-f368-4432-ac26-09e50603f757 tempest-GroupsV320Test-1912364665 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:56:22 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-298dc423-f368-4432-ac26-09e50603f757 tempest-GroupsV320Test-1912364665 None] Delete group completed successfully. Sep 28 11:56:32 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:UPDATE=78,cinder:SELECT=90,cinder:INSERT=22,cinder:DELETE=2 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 11:56:32 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=61,cinder:UPDATE=58,cinder:INSERT=16,cinder:DELETE=1 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 11:56:38 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 11:56:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:56:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:56:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:56:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:56:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:56:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:38 devstack sudo[100455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:56:38 devstack sudo[100455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:38 devstack sudo[100455]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.261s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:38 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:56:38 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 11:56:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] thread count: 28 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 11:56:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] thread info: [<_MainThread(MainThread, started 135408582168704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 11:56:40 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bae2d2c-f354-4a7c-acf4-5697cfb356a0 tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:56:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7bae2d2c-f354-4a7c-acf4-5697cfb356a0 tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] Flow 'volume_create_manager' (04ec34a1-056f-4571-866a-4092bb7ca21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:56:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7bae2d2c-f354-4a7c-acf4-5697cfb356a0 tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f671925-4895-40d0-9d9c-adcc1a1cf2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:56:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7bae2d2c-f354-4a7c-acf4-5697cfb356a0 tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f671925-4895-40d0-9d9c-adcc1a1cf2fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:56:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-475423494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cec85e8a-c9dd-4331-aaaf-f925d92291c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d7f408f00004c5a953afe47818e80f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:56:41Z,use_quota=True,user_id='8f5c6de214aa4c829354017b1e25972a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(079fa26e-dbd7-4f3d-bd6b-dcadab40bfeb),volume_type_id=079fa26e-dbd7-4f3d-bd6b-dcadab40bfeb)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:56:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7bae2d2c-f354-4a7c-acf4-5697cfb356a0 tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2345470-8504-4234-867f-0a05a8003c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:56:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7bae2d2c-f354-4a7c-acf4-5697cfb356a0 tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2345470-8504-4234-867f-0a05a8003c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:56:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7bae2d2c-f354-4a7c-acf4-5697cfb356a0 tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bcd3392-332c-4942-aa6b-1d74a633745c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:56:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7bae2d2c-f354-4a7c-acf4-5697cfb356a0 tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bcd3392-332c-4942-aa6b-1d74a633745c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cec85e8a-c9dd-4331-aaaf-f925d92291c6', 'volume_name': 'volume-cec85e8a-c9dd-4331-aaaf-f925d92291c6', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:56:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7bae2d2c-f354-4a7c-acf4-5697cfb356a0 tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94069989-df56-4b4d-8ec1-3dcb4af454a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:56:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7bae2d2c-f354-4a7c-acf4-5697cfb356a0 tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94069989-df56-4b4d-8ec1-3dcb4af454a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:56:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7bae2d2c-f354-4a7c-acf4-5697cfb356a0 tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (579fb6a5-fbc7-40ee-8656-37133052b260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:56:40 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-7bae2d2c-f354-4a7c-acf4-5697cfb356a0 tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] Volume cec85e8a-c9dd-4331-aaaf-f925d92291c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cec85e8a-c9dd-4331-aaaf-f925d92291c6', 'volume_size': 1} Sep 28 11:56:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7bae2d2c-f354-4a7c-acf4-5697cfb356a0 tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:56:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7bae2d2c-f354-4a7c-acf4-5697cfb356a0 tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:56:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7bae2d2c-f354-4a7c-acf4-5697cfb356a0 tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:56:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-475423494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cec85e8a-c9dd-4331-aaaf-f925d92291c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d7f408f00004c5a953afe47818e80f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:56:41Z,use_quota=True,user_id='8f5c6de214aa4c829354017b1e25972a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(079fa26e-dbd7-4f3d-bd6b-dcadab40bfeb),volume_type_id=079fa26e-dbd7-4f3d-bd6b-dcadab40bfeb)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:56:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-7bae2d2c-f354-4a7c-acf4-5697cfb356a0 tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] Creating volume cec85e8a-c9dd-4331-aaaf-f925d92291c6 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:56:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7bae2d2c-f354-4a7c-acf4-5697cfb356a0 tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:56:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7bae2d2c-f354-4a7c-acf4-5697cfb356a0 tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:56:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7bae2d2c-f354-4a7c-acf4-5697cfb356a0 tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:56:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7bae2d2c-f354-4a7c-acf4-5697cfb356a0 tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:56:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7bae2d2c-f354-4a7c-acf4-5697cfb356a0 tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:56:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7bae2d2c-f354-4a7c-acf4-5697cfb356a0 tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:56:40 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-7bae2d2c-f354-4a7c-acf4-5697cfb356a0 tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:56:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7bae2d2c-f354-4a7c-acf4-5697cfb356a0 tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cec85e8a-c9dd-4331-aaaf-f925d92291c6 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:40 devstack sudo[100459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cec85e8a-c9dd-4331-aaaf-f925d92291c6 1073741824 Sep 28 11:56:40 devstack sudo[100459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:41 devstack sudo[100459]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7bae2d2c-f354-4a7c-acf4-5697cfb356a0 tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cec85e8a-c9dd-4331-aaaf-f925d92291c6 1073741824" returned: 0 in 0.452s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7bae2d2c-f354-4a7c-acf4-5697cfb356a0 tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cec85e8a-c9dd-4331-aaaf-f925d92291c6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:41 devstack sudo[100465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cec85e8a-c9dd-4331-aaaf-f925d92291c6 Sep 28 11:56:41 devstack sudo[100465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:42 devstack sudo[100465]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7bae2d2c-f354-4a7c-acf4-5697cfb356a0 tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cec85e8a-c9dd-4331-aaaf-f925d92291c6" returned: 0 in 0.250s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7bae2d2c-f354-4a7c-acf4-5697cfb356a0 tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] <== create_volume: return (1240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:56:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7bae2d2c-f354-4a7c-acf4-5697cfb356a0 tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.242s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:56:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7bae2d2c-f354-4a7c-acf4-5697cfb356a0 tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (579fb6a5-fbc7-40ee-8656-37133052b260) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cec85e8a-c9dd-4331-aaaf-f925d92291c6', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:56:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7bae2d2c-f354-4a7c-acf4-5697cfb356a0 tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (601c25fb-ee20-4e84-b347-722ff91a3b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:56:42 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-7bae2d2c-f354-4a7c-acf4-5697cfb356a0 tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] Volume volume-cec85e8a-c9dd-4331-aaaf-f925d92291c6 (cec85e8a-c9dd-4331-aaaf-f925d92291c6): created successfully Sep 28 11:56:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7bae2d2c-f354-4a7c-acf4-5697cfb356a0 tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (601c25fb-ee20-4e84-b347-722ff91a3b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:56:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7bae2d2c-f354-4a7c-acf4-5697cfb356a0 tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] Flow 'volume_create_manager' (04ec34a1-056f-4571-866a-4092bb7ca21f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:56:42 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-7bae2d2c-f354-4a7c-acf4-5697cfb356a0 tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] Created volume successfully. Sep 28 11:56:42 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-54b24348-dd38-4575-8443-50e567ee5364 tempest-SnapshotsActionsTest-236189319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:56:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-54b24348-dd38-4575-8443-50e567ee5364 tempest-SnapshotsActionsTest-236189319 None] Flow 'volume_create_manager' (af6704ef-7750-4c83-8ff0-9a149311a03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:56:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-54b24348-dd38-4575-8443-50e567ee5364 tempest-SnapshotsActionsTest-236189319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50ab0121-f28b-4068-965d-afd76e3acfcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:56:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-54b24348-dd38-4575-8443-50e567ee5364 tempest-SnapshotsActionsTest-236189319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50ab0121-f28b-4068-965d-afd76e3acfcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-547857112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d75c95f-01f2-414f-8315-ddd08b770213,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d878d02bf414aa48553d1cf86746b30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:56:42Z,use_quota=True,user_id='7d60539e43a84ac2a31b9ab8639f687c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:56:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-54b24348-dd38-4575-8443-50e567ee5364 tempest-SnapshotsActionsTest-236189319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f40b2fe-360b-4d7d-a223-c1c5630808ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:56:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-54b24348-dd38-4575-8443-50e567ee5364 tempest-SnapshotsActionsTest-236189319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f40b2fe-360b-4d7d-a223-c1c5630808ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:56:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-54b24348-dd38-4575-8443-50e567ee5364 tempest-SnapshotsActionsTest-236189319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10ab435c-5070-488d-bb34-84cae2886d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:56:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-54b24348-dd38-4575-8443-50e567ee5364 tempest-SnapshotsActionsTest-236189319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10ab435c-5070-488d-bb34-84cae2886d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d75c95f-01f2-414f-8315-ddd08b770213', 'volume_name': 'volume-8d75c95f-01f2-414f-8315-ddd08b770213', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:56:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-54b24348-dd38-4575-8443-50e567ee5364 tempest-SnapshotsActionsTest-236189319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (154fd6b9-838d-4e87-b39b-3b0211df0323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:56:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-54b24348-dd38-4575-8443-50e567ee5364 tempest-SnapshotsActionsTest-236189319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (154fd6b9-838d-4e87-b39b-3b0211df0323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:56:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-54b24348-dd38-4575-8443-50e567ee5364 tempest-SnapshotsActionsTest-236189319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d79ea83-a673-443c-aceb-59bcaff76904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:56:42 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-54b24348-dd38-4575-8443-50e567ee5364 tempest-SnapshotsActionsTest-236189319 None] Volume 8d75c95f-01f2-414f-8315-ddd08b770213: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d75c95f-01f2-414f-8315-ddd08b770213', 'volume_size': 1} Sep 28 11:56:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-54b24348-dd38-4575-8443-50e567ee5364 tempest-SnapshotsActionsTest-236189319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:56:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-54b24348-dd38-4575-8443-50e567ee5364 tempest-SnapshotsActionsTest-236189319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:56:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-54b24348-dd38-4575-8443-50e567ee5364 tempest-SnapshotsActionsTest-236189319 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-547857112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d75c95f-01f2-414f-8315-ddd08b770213,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d878d02bf414aa48553d1cf86746b30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:56:42Z,use_quota=True,user_id='7d60539e43a84ac2a31b9ab8639f687c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:56:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-54b24348-dd38-4575-8443-50e567ee5364 tempest-SnapshotsActionsTest-236189319 None] Creating volume 8d75c95f-01f2-414f-8315-ddd08b770213 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:56:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-54b24348-dd38-4575-8443-50e567ee5364 tempest-SnapshotsActionsTest-236189319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:56:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-54b24348-dd38-4575-8443-50e567ee5364 tempest-SnapshotsActionsTest-236189319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:56:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-54b24348-dd38-4575-8443-50e567ee5364 tempest-SnapshotsActionsTest-236189319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:56:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-54b24348-dd38-4575-8443-50e567ee5364 tempest-SnapshotsActionsTest-236189319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:56:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-54b24348-dd38-4575-8443-50e567ee5364 tempest-SnapshotsActionsTest-236189319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:56:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-54b24348-dd38-4575-8443-50e567ee5364 tempest-SnapshotsActionsTest-236189319 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:56:42 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-54b24348-dd38-4575-8443-50e567ee5364 tempest-SnapshotsActionsTest-236189319 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:56:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-54b24348-dd38-4575-8443-50e567ee5364 tempest-SnapshotsActionsTest-236189319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:42 devstack sudo[100468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213 1073741824 Sep 28 11:56:42 devstack sudo[100468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:43 devstack sudo[100468]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-54b24348-dd38-4575-8443-50e567ee5364 tempest-SnapshotsActionsTest-236189319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213 1073741824" returned: 0 in 0.433s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-54b24348-dd38-4575-8443-50e567ee5364 tempest-SnapshotsActionsTest-236189319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:43 devstack sudo[100474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213 Sep 28 11:56:43 devstack sudo[100474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:43 devstack sudo[100474]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-54b24348-dd38-4575-8443-50e567ee5364 tempest-SnapshotsActionsTest-236189319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213" returned: 0 in 0.256s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-54b24348-dd38-4575-8443-50e567ee5364 tempest-SnapshotsActionsTest-236189319 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:56:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-54b24348-dd38-4575-8443-50e567ee5364 tempest-SnapshotsActionsTest-236189319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:56:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-54b24348-dd38-4575-8443-50e567ee5364 tempest-SnapshotsActionsTest-236189319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d79ea83-a673-443c-aceb-59bcaff76904) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d75c95f-01f2-414f-8315-ddd08b770213', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:56:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-54b24348-dd38-4575-8443-50e567ee5364 tempest-SnapshotsActionsTest-236189319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5004ac65-811d-42d8-b154-3764618fae52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:56:44 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-54b24348-dd38-4575-8443-50e567ee5364 tempest-SnapshotsActionsTest-236189319 None] Volume volume-8d75c95f-01f2-414f-8315-ddd08b770213 (8d75c95f-01f2-414f-8315-ddd08b770213): created successfully Sep 28 11:56:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-54b24348-dd38-4575-8443-50e567ee5364 tempest-SnapshotsActionsTest-236189319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5004ac65-811d-42d8-b154-3764618fae52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:56:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-54b24348-dd38-4575-8443-50e567ee5364 tempest-SnapshotsActionsTest-236189319 None] Flow 'volume_create_manager' (af6704ef-7750-4c83-8ff0-9a149311a03d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:56:44 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-54b24348-dd38-4575-8443-50e567ee5364 tempest-SnapshotsActionsTest-236189319 None] Created volume successfully. Sep 28 11:56:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e98e5c97-25ca-4cd6-b594-206a11ad652c tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:56:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e98e5c97-25ca-4cd6-b594-206a11ad652c tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:56:44 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e98e5c97-25ca-4cd6-b594-206a11ad652c tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:56:44 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e98e5c97-25ca-4cd6-b594-206a11ad652c tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:56:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e98e5c97-25ca-4cd6-b594-206a11ad652c tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:56:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e98e5c97-25ca-4cd6-b594-206a11ad652c tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:44 devstack sudo[100477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:56:44 devstack sudo[100477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:44 devstack sudo[100477]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e98e5c97-25ca-4cd6-b594-206a11ad652c tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.264s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:44 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-e98e5c97-25ca-4cd6-b594-206a11ad652c tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:56:44 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e98e5c97-25ca-4cd6-b594-206a11ad652c tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] Retype volume completed successfully. Sep 28 11:56:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-af17de12-9565-4159-a5d0-0f6c700090e2 tempest-SnapshotsActionsTest-236189319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:56:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-af17de12-9565-4159-a5d0-0f6c700090e2 tempest-SnapshotsActionsTest-236189319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:56:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-af17de12-9565-4159-a5d0-0f6c700090e2 tempest-SnapshotsActionsTest-236189319 None] Creating offline snapshot aa8700e4-ffa3-4ab0-8b9c-c907b65c3372 of volume 8d75c95f-01f2-414f-8315-ddd08b770213 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 11:56:45 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[607e0661-67da-492c-bd4a-614e8ad9ebb3]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:56:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-af17de12-9565-4159-a5d0-0f6c700090e2 tempest-SnapshotsActionsTest-236189319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:45 devstack sudo[100484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213 Sep 28 11:56:45 devstack sudo[100484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:45 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-aab200e5-1375-4d79-996d-add5367bbc41 tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] Acquiring lock "cinder-cec85e8a-c9dd-4331-aaaf-f925d92291c6-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:56:45 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-aab200e5-1375-4d79-996d-add5367bbc41 tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] Lock "cinder-cec85e8a-c9dd-4331-aaaf-f925d92291c6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:56:45 devstack sudo[100484]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-af17de12-9565-4159-a5d0-0f6c700090e2 tempest-SnapshotsActionsTest-236189319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213" returned: 0 in 0.466s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-af17de12-9565-4159-a5d0-0f6c700090e2 tempest-SnapshotsActionsTest-236189319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:45 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-aab200e5-1375-4d79-996d-add5367bbc41 tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] Acquiring lock "cinder-quobyte-cec85e8a-c9dd-4331-aaaf-f925d92291c6" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:56:45 devstack sudo[100489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372 1G Sep 28 11:56:45 devstack sudo[100489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:45 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-aab200e5-1375-4d79-996d-add5367bbc41 tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] Lock "cinder-quobyte-cec85e8a-c9dd-4331-aaaf-f925d92291c6" acquired by "delete_volume" :: waited 0.027s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:56:45 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13cd6f5-16fe-4908-86a5-77d94d0deeb8]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:56:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-aab200e5-1375-4d79-996d-add5367bbc41 tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cec85e8a-c9dd-4331-aaaf-f925d92291c6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:46 devstack sudo[100491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cec85e8a-c9dd-4331-aaaf-f925d92291c6 Sep 28 11:56:46 devstack sudo[100491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:46 devstack sudo[100489]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-af17de12-9565-4159-a5d0-0f6c700090e2 tempest-SnapshotsActionsTest-236189319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372 1G" returned: 0 in 0.444s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-af17de12-9565-4159-a5d0-0f6c700090e2 tempest-SnapshotsActionsTest-236189319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d75c95f-01f2-414f-8315-ddd08b770213 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:46 devstack sudo[100499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d75c95f-01f2-414f-8315-ddd08b770213 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372 Sep 28 11:56:46 devstack sudo[100499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:46 devstack sudo[100491]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-aab200e5-1375-4d79-996d-add5367bbc41 tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cec85e8a-c9dd-4331-aaaf-f925d92291c6" returned: 0 in 0.460s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-aab200e5-1375-4d79-996d-add5367bbc41 tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cec85e8a-c9dd-4331-aaaf-f925d92291c6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:46 devstack sudo[100502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cec85e8a-c9dd-4331-aaaf-f925d92291c6 Sep 28 11:56:46 devstack sudo[100502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:46 devstack sudo[100499]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-af17de12-9565-4159-a5d0-0f6c700090e2 tempest-SnapshotsActionsTest-236189319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d75c95f-01f2-414f-8315-ddd08b770213 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372" returned: 0 in 0.320s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:46 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-af17de12-9565-4159-a5d0-0f6c700090e2 tempest-SnapshotsActionsTest-236189319 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372 is being set with open permissions: ugo+rw Sep 28 11:56:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-af17de12-9565-4159-a5d0-0f6c700090e2 tempest-SnapshotsActionsTest-236189319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:46 devstack sudo[100508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372 Sep 28 11:56:46 devstack sudo[100508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:46 devstack sudo[100502]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-aab200e5-1375-4d79-996d-add5367bbc41 tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cec85e8a-c9dd-4331-aaaf-f925d92291c6" returned: 0 in 0.261s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-aab200e5-1375-4d79-996d-add5367bbc41 tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] Lock "cinder-quobyte-cec85e8a-c9dd-4331-aaaf-f925d92291c6" released by "delete_volume" :: held 0.780s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:56:46 devstack cinder-volume[86916]: WARNING cinder.quota [None req-aab200e5-1375-4d79-996d-add5367bbc41 tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 28 11:56:46 devstack cinder-volume[86916]: WARNING cinder.quota [None req-aab200e5-1375-4d79-996d-add5367bbc41 tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 28 11:56:46 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-aab200e5-1375-4d79-996d-add5367bbc41 tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] Created reservations ['bbdd9b96-dbfa-486e-8c04-3adb2f5432e8', '8185f049-b3f5-4e93-8f75-db5558c4c7f1', '52691012-9108-4b36-82e9-3079c5fe875d', 'f3192ba4-ec63-444f-8809-2d5b8c6e4e3a'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:56:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-aab200e5-1375-4d79-996d-add5367bbc41 tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:56:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-aab200e5-1375-4d79-996d-add5367bbc41 tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:56:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-aab200e5-1375-4d79-996d-add5367bbc41 tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:56:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-aab200e5-1375-4d79-996d-add5367bbc41 tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:56:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-aab200e5-1375-4d79-996d-add5367bbc41 tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:56:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-aab200e5-1375-4d79-996d-add5367bbc41 tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:46 devstack sudo[100510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:56:46 devstack sudo[100510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:46 devstack sudo[100508]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-af17de12-9565-4159-a5d0-0f6c700090e2 tempest-SnapshotsActionsTest-236189319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372" returned: 0 in 0.269s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-af17de12-9565-4159-a5d0-0f6c700090e2 tempest-SnapshotsActionsTest-236189319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:46 devstack sudo[100513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.info Sep 28 11:56:46 devstack sudo[100513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:47 devstack sudo[100510]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-aab200e5-1375-4d79-996d-add5367bbc41 tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.298s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:47 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-aab200e5-1375-4d79-996d-add5367bbc41 tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:56:47 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-aab200e5-1375-4d79-996d-add5367bbc41 tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] Deleted volume successfully. Sep 28 11:56:47 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-aab200e5-1375-4d79-996d-add5367bbc41 tempest-VolumeRetypeWithoutMigrationTest-1371788209 None] Lock "cinder-cec85e8a-c9dd-4331-aaaf-f925d92291c6-delete_volume" released by "delete_volume" :: held 1.345s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:56:47 devstack sudo[100513]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-af17de12-9565-4159-a5d0-0f6c700090e2 tempest-SnapshotsActionsTest-236189319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.info" returned: 0 in 0.274s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:47 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-af17de12-9565-4159-a5d0-0f6c700090e2 tempest-SnapshotsActionsTest-236189319 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.info is being set with open permissions: ugo+rw Sep 28 11:56:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-af17de12-9565-4159-a5d0-0f6c700090e2 tempest-SnapshotsActionsTest-236189319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:47 devstack sudo[100517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.info Sep 28 11:56:47 devstack sudo[100517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:47 devstack sudo[100517]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-af17de12-9565-4159-a5d0-0f6c700090e2 tempest-SnapshotsActionsTest-236189319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.info" returned: 0 in 0.251s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-af17de12-9565-4159-a5d0-0f6c700090e2 tempest-SnapshotsActionsTest-236189319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.150s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:56:47 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-af17de12-9565-4159-a5d0-0f6c700090e2 tempest-SnapshotsActionsTest-236189319 None] Create snapshot completed successfully Sep 28 11:56:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-322db2dd-1cca-4198-946d-fdda9e37d117 tempest-SnapshotsActionsTest-236189319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:56:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-322db2dd-1cca-4198-946d-fdda9e37d117 tempest-SnapshotsActionsTest-236189319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:56:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-322db2dd-1cca-4198-946d-fdda9e37d117 tempest-SnapshotsActionsTest-236189319 None] Creating offline snapshot c4ede4fd-ede6-48e6-85de-30e7736daa48 of volume 8d75c95f-01f2-414f-8315-ddd08b770213 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 11:56:49 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[70fbebb2-b313-49ce-9411-220660575cbd]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:56:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-322db2dd-1cca-4198-946d-fdda9e37d117 tempest-SnapshotsActionsTest-236189319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:49 devstack sudo[100527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372 Sep 28 11:56:49 devstack sudo[100527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:49 devstack sudo[100527]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-322db2dd-1cca-4198-946d-fdda9e37d117 tempest-SnapshotsActionsTest-236189319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372" returned: 0 in 0.521s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-322db2dd-1cca-4198-946d-fdda9e37d117 tempest-SnapshotsActionsTest-236189319 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d75c95f-01f2-414f-8315-ddd08b770213(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 11:56:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-322db2dd-1cca-4198-946d-fdda9e37d117 tempest-SnapshotsActionsTest-236189319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.c4ede4fd-ede6-48e6-85de-30e7736daa48 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:49 devstack sudo[100540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.c4ede4fd-ede6-48e6-85de-30e7736daa48 1G Sep 28 11:56:49 devstack sudo[100540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-571fbaa5-15f2-4cdc-b5e9-3f59807499cf req-1b8f465a-f1d0-48a0-a689-1dcd53ec8b4e tempest-TestInstancesWithCinderVolumes-991430352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:56:50 devstack sudo[100540]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-322db2dd-1cca-4198-946d-fdda9e37d117 tempest-SnapshotsActionsTest-236189319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.c4ede4fd-ede6-48e6-85de-30e7736daa48 1G" returned: 0 in 0.496s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-322db2dd-1cca-4198-946d-fdda9e37d117 tempest-SnapshotsActionsTest-236189319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.c4ede4fd-ede6-48e6-85de-30e7736daa48 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:50 devstack sudo[100547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.c4ede4fd-ede6-48e6-85de-30e7736daa48 Sep 28 11:56:50 devstack sudo[100547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:50 devstack sudo[100547]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-322db2dd-1cca-4198-946d-fdda9e37d117 tempest-SnapshotsActionsTest-236189319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.c4ede4fd-ede6-48e6-85de-30e7736daa48" returned: 0 in 0.312s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:50 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-322db2dd-1cca-4198-946d-fdda9e37d117 tempest-SnapshotsActionsTest-236189319 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.c4ede4fd-ede6-48e6-85de-30e7736daa48 is being set with open permissions: ugo+rw Sep 28 11:56:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-322db2dd-1cca-4198-946d-fdda9e37d117 tempest-SnapshotsActionsTest-236189319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.c4ede4fd-ede6-48e6-85de-30e7736daa48 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:50 devstack sudo[100553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.c4ede4fd-ede6-48e6-85de-30e7736daa48 Sep 28 11:56:50 devstack sudo[100553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:50 devstack sudo[100553]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-322db2dd-1cca-4198-946d-fdda9e37d117 tempest-SnapshotsActionsTest-236189319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.c4ede4fd-ede6-48e6-85de-30e7736daa48" returned: 0 in 0.275s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-322db2dd-1cca-4198-946d-fdda9e37d117 tempest-SnapshotsActionsTest-236189319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.743s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:56:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-571fbaa5-15f2-4cdc-b5e9-3f59807499cf req-1b8f465a-f1d0-48a0-a689-1dcd53ec8b4e tempest-TestInstancesWithCinderVolumes-991430352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.084s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:56:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-571fbaa5-15f2-4cdc-b5e9-3f59807499cf req-1b8f465a-f1d0-48a0-a689-1dcd53ec8b4e tempest-TestInstancesWithCinderVolumes-991430352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:56:50 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-322db2dd-1cca-4198-946d-fdda9e37d117 tempest-SnapshotsActionsTest-236189319 None] Create snapshot completed successfully Sep 28 11:56:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-571fbaa5-15f2-4cdc-b5e9-3f59807499cf req-1b8f465a-f1d0-48a0-a689-1dcd53ec8b4e tempest-TestInstancesWithCinderVolumes-991430352 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0', 'name': 'volume-084be243-a5bc-42bb-8735-66c5dc3d6cae', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c6ab87c3-920c-41ae-96f1-766367b9bd1e', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 11:56:51 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-571fbaa5-15f2-4cdc-b5e9-3f59807499cf req-1b8f465a-f1d0-48a0-a689-1dcd53ec8b4e tempest-TestInstancesWithCinderVolumes-991430352 None] attachment_update completed successfully. Sep 28 11:56:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3df3eed6-29a2-4716-8706-50af1f6afaf1 tempest-SnapshotsActionsTest-1459299255 None] Acquiring lock "cinder-c4ede4fd-ede6-48e6-85de-30e7736daa48-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:56:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3df3eed6-29a2-4716-8706-50af1f6afaf1 tempest-SnapshotsActionsTest-1459299255 None] Lock "cinder-c4ede4fd-ede6-48e6-85de-30e7736daa48-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:56:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3df3eed6-29a2-4716-8706-50af1f6afaf1 tempest-SnapshotsActionsTest-1459299255 None] Acquiring lock "cinder-quobyte-8d75c95f-01f2-414f-8315-ddd08b770213" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:56:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3df3eed6-29a2-4716-8706-50af1f6afaf1 tempest-SnapshotsActionsTest-1459299255 None] Lock "cinder-quobyte-8d75c95f-01f2-414f-8315-ddd08b770213" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:56:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3df3eed6-29a2-4716-8706-50af1f6afaf1 tempest-SnapshotsActionsTest-1459299255 None] Acquiring lock "cinder-quobyte-c4ede4fd-ede6-48e6-85de-30e7736daa48" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:56:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3df3eed6-29a2-4716-8706-50af1f6afaf1 tempest-SnapshotsActionsTest-1459299255 None] Lock "cinder-quobyte-c4ede4fd-ede6-48e6-85de-30e7736daa48" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:56:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-3df3eed6-29a2-4716-8706-50af1f6afaf1 tempest-SnapshotsActionsTest-1459299255 None] Deleting offline snapshot c4ede4fd-ede6-48e6-85de-30e7736daa48 of volume 8d75c95f-01f2-414f-8315-ddd08b770213 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 11:56:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-3df3eed6-29a2-4716-8706-50af1f6afaf1 tempest-SnapshotsActionsTest-1459299255 None] snapshot_file for this snap is: volume-8d75c95f-01f2-414f-8315-ddd08b770213.c4ede4fd-ede6-48e6-85de-30e7736daa48 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 11:56:51 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e20bbf-0e7b-4a12-b477-53cdcf487c5c]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:56:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3df3eed6-29a2-4716-8706-50af1f6afaf1 tempest-SnapshotsActionsTest-1459299255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.c4ede4fd-ede6-48e6-85de-30e7736daa48 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:51 devstack sudo[100561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.c4ede4fd-ede6-48e6-85de-30e7736daa48 Sep 28 11:56:51 devstack sudo[100561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:51 devstack sudo[100561]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3df3eed6-29a2-4716-8706-50af1f6afaf1 tempest-SnapshotsActionsTest-1459299255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.c4ede4fd-ede6-48e6-85de-30e7736daa48" returned: 0 in 0.521s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-3df3eed6-29a2-4716-8706-50af1f6afaf1 tempest-SnapshotsActionsTest-1459299255 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d75c95f-01f2-414f-8315-ddd08b770213(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 11:56:52 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[450436b7-b47e-4699-9e91-9a03f8c8d54d]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:56:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3df3eed6-29a2-4716-8706-50af1f6afaf1 tempest-SnapshotsActionsTest-1459299255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:52 devstack sudo[100567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372 Sep 28 11:56:52 devstack sudo[100567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:52 devstack sudo[100567]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3df3eed6-29a2-4716-8706-50af1f6afaf1 tempest-SnapshotsActionsTest-1459299255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372" returned: 0 in 0.388s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-3df3eed6-29a2-4716-8706-50af1f6afaf1 tempest-SnapshotsActionsTest-1459299255 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d75c95f-01f2-414f-8315-ddd08b770213(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 11:56:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3df3eed6-29a2-4716-8706-50af1f6afaf1 tempest-SnapshotsActionsTest-1459299255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.c4ede4fd-ede6-48e6-85de-30e7736daa48 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:52 devstack sudo[100572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.c4ede4fd-ede6-48e6-85de-30e7736daa48 Sep 28 11:56:52 devstack sudo[100572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:52 devstack sudo[100572]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3df3eed6-29a2-4716-8706-50af1f6afaf1 tempest-SnapshotsActionsTest-1459299255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.c4ede4fd-ede6-48e6-85de-30e7736daa48" returned: 0 in 0.403s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3df3eed6-29a2-4716-8706-50af1f6afaf1 tempest-SnapshotsActionsTest-1459299255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.c4ede4fd-ede6-48e6-85de-30e7736daa48 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:52 devstack sudo[100578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.c4ede4fd-ede6-48e6-85de-30e7736daa48 Sep 28 11:56:52 devstack sudo[100578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:53 devstack sudo[100578]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3df3eed6-29a2-4716-8706-50af1f6afaf1 tempest-SnapshotsActionsTest-1459299255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.c4ede4fd-ede6-48e6-85de-30e7736daa48" returned: 0 in 0.275s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3df3eed6-29a2-4716-8706-50af1f6afaf1 tempest-SnapshotsActionsTest-1459299255 None] Lock "cinder-quobyte-c4ede4fd-ede6-48e6-85de-30e7736daa48" released by "_delete_snapshot" :: held 1.703s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:56:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3df3eed6-29a2-4716-8706-50af1f6afaf1 tempest-SnapshotsActionsTest-1459299255 None] Lock "cinder-quobyte-8d75c95f-01f2-414f-8315-ddd08b770213" released by "delete_snapshot" :: held 1.731s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:56:53 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-3df3eed6-29a2-4716-8706-50af1f6afaf1 tempest-SnapshotsActionsTest-1459299255 None] Created reservations ['90cf3aed-1df9-475f-b25e-079d344821d8', '1b1372db-0c09-45af-89ab-be312cb291bf', '37a5180b-151c-4f75-93ac-5e3cd95e9014', 'cd40a34d-b028-4e0d-b67d-43e49727646e'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:56:53 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-3df3eed6-29a2-4716-8706-50af1f6afaf1 tempest-SnapshotsActionsTest-1459299255 None] Delete snapshot completed successfully. Sep 28 11:56:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3df3eed6-29a2-4716-8706-50af1f6afaf1 tempest-SnapshotsActionsTest-1459299255 None] Lock "cinder-c4ede4fd-ede6-48e6-85de-30e7736daa48-delete_snapshot" released by "delete_snapshot" :: held 1.912s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:56:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0b16f729-5dc3-416b-a67f-9da4114b6695 tempest-SnapshotsActionsTest-236189319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:56:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0b16f729-5dc3-416b-a67f-9da4114b6695 tempest-SnapshotsActionsTest-236189319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:56:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-0b16f729-5dc3-416b-a67f-9da4114b6695 tempest-SnapshotsActionsTest-236189319 None] Creating offline snapshot c4da7f74-ce8e-4e90-9aa9-b255ab6560c9 of volume 8d75c95f-01f2-414f-8315-ddd08b770213 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 11:56:53 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef2a5d9-1a0a-4ffd-8019-753efdbfaf15]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:56:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0b16f729-5dc3-416b-a67f-9da4114b6695 tempest-SnapshotsActionsTest-236189319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:54 devstack sudo[100598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372 Sep 28 11:56:54 devstack sudo[100598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-130a5cd5-16e1-453e-95bb-b997089daa8c req-e69f768f-1ccd-4e1c-8067-8e33c3e7aa5e tempest-TestInstancesWithCinderVolumes-991430352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:56:54 devstack sudo[100598]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0b16f729-5dc3-416b-a67f-9da4114b6695 tempest-SnapshotsActionsTest-236189319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372" returned: 0 in 0.416s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-0b16f729-5dc3-416b-a67f-9da4114b6695 tempest-SnapshotsActionsTest-236189319 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d75c95f-01f2-414f-8315-ddd08b770213(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 11:56:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0b16f729-5dc3-416b-a67f-9da4114b6695 tempest-SnapshotsActionsTest-236189319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.c4da7f74-ce8e-4e90-9aa9-b255ab6560c9 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:54 devstack sudo[100605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.c4da7f74-ce8e-4e90-9aa9-b255ab6560c9 1G Sep 28 11:56:54 devstack sudo[100605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:54 devstack sudo[100605]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0b16f729-5dc3-416b-a67f-9da4114b6695 tempest-SnapshotsActionsTest-236189319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.c4da7f74-ce8e-4e90-9aa9-b255ab6560c9 1G" returned: 0 in 0.509s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0b16f729-5dc3-416b-a67f-9da4114b6695 tempest-SnapshotsActionsTest-236189319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.c4da7f74-ce8e-4e90-9aa9-b255ab6560c9 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:54 devstack sudo[100611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.c4da7f74-ce8e-4e90-9aa9-b255ab6560c9 Sep 28 11:56:54 devstack sudo[100611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:55 devstack sudo[100611]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0b16f729-5dc3-416b-a67f-9da4114b6695 tempest-SnapshotsActionsTest-236189319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.c4da7f74-ce8e-4e90-9aa9-b255ab6560c9" returned: 0 in 0.310s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:55 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-0b16f729-5dc3-416b-a67f-9da4114b6695 tempest-SnapshotsActionsTest-236189319 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.c4da7f74-ce8e-4e90-9aa9-b255ab6560c9 is being set with open permissions: ugo+rw Sep 28 11:56:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0b16f729-5dc3-416b-a67f-9da4114b6695 tempest-SnapshotsActionsTest-236189319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.c4da7f74-ce8e-4e90-9aa9-b255ab6560c9 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:55 devstack sudo[100617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.c4da7f74-ce8e-4e90-9aa9-b255ab6560c9 Sep 28 11:56:55 devstack sudo[100617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:55 devstack sudo[100617]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0b16f729-5dc3-416b-a67f-9da4114b6695 tempest-SnapshotsActionsTest-236189319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.c4da7f74-ce8e-4e90-9aa9-b255ab6560c9" returned: 0 in 0.272s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0b16f729-5dc3-416b-a67f-9da4114b6695 tempest-SnapshotsActionsTest-236189319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.645s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:56:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-130a5cd5-16e1-453e-95bb-b997089daa8c req-e69f768f-1ccd-4e1c-8067-8e33c3e7aa5e tempest-TestInstancesWithCinderVolumes-991430352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.406s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:56:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-130a5cd5-16e1-453e-95bb-b997089daa8c req-e69f768f-1ccd-4e1c-8067-8e33c3e7aa5e tempest-TestInstancesWithCinderVolumes-991430352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:56:55 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-0b16f729-5dc3-416b-a67f-9da4114b6695 tempest-SnapshotsActionsTest-236189319 None] Create snapshot completed successfully Sep 28 11:56:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-130a5cd5-16e1-453e-95bb-b997089daa8c req-e69f768f-1ccd-4e1c-8067-8e33c3e7aa5e tempest-TestInstancesWithCinderVolumes-991430352 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0', 'name': 'volume-cc57d5d6-739d-459b-af23-9c272cedbecb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '22d08c15-b6f7-4111-8804-385bba6f023e', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 11:56:55 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-130a5cd5-16e1-453e-95bb-b997089daa8c req-e69f768f-1ccd-4e1c-8067-8e33c3e7aa5e tempest-TestInstancesWithCinderVolumes-991430352 None] attachment_update completed successfully. Sep 28 11:56:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6a2a8a44-5ab3-410f-9a3f-8fbe9a83fd8d tempest-SnapshotsActionsTest-1459299255 None] Acquiring lock "cinder-c4da7f74-ce8e-4e90-9aa9-b255ab6560c9-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:56:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6a2a8a44-5ab3-410f-9a3f-8fbe9a83fd8d tempest-SnapshotsActionsTest-1459299255 None] Lock "cinder-c4da7f74-ce8e-4e90-9aa9-b255ab6560c9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:56:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6a2a8a44-5ab3-410f-9a3f-8fbe9a83fd8d tempest-SnapshotsActionsTest-1459299255 None] Acquiring lock "cinder-quobyte-8d75c95f-01f2-414f-8315-ddd08b770213" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:56:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6a2a8a44-5ab3-410f-9a3f-8fbe9a83fd8d tempest-SnapshotsActionsTest-1459299255 None] Lock "cinder-quobyte-8d75c95f-01f2-414f-8315-ddd08b770213" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:56:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6a2a8a44-5ab3-410f-9a3f-8fbe9a83fd8d tempest-SnapshotsActionsTest-1459299255 None] Acquiring lock "cinder-quobyte-c4da7f74-ce8e-4e90-9aa9-b255ab6560c9" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:56:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6a2a8a44-5ab3-410f-9a3f-8fbe9a83fd8d tempest-SnapshotsActionsTest-1459299255 None] Lock "cinder-quobyte-c4da7f74-ce8e-4e90-9aa9-b255ab6560c9" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:56:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-6a2a8a44-5ab3-410f-9a3f-8fbe9a83fd8d tempest-SnapshotsActionsTest-1459299255 None] Deleting offline snapshot c4da7f74-ce8e-4e90-9aa9-b255ab6560c9 of volume 8d75c95f-01f2-414f-8315-ddd08b770213 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 11:56:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-6a2a8a44-5ab3-410f-9a3f-8fbe9a83fd8d tempest-SnapshotsActionsTest-1459299255 None] snapshot_file for this snap is: volume-8d75c95f-01f2-414f-8315-ddd08b770213.c4da7f74-ce8e-4e90-9aa9-b255ab6560c9 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 11:56:56 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[8772b6cd-6b78-4216-a678-212d638bbe29]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:56:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6a2a8a44-5ab3-410f-9a3f-8fbe9a83fd8d tempest-SnapshotsActionsTest-1459299255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.c4da7f74-ce8e-4e90-9aa9-b255ab6560c9 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:56 devstack sudo[100627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.c4da7f74-ce8e-4e90-9aa9-b255ab6560c9 Sep 28 11:56:56 devstack sudo[100627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:56 devstack sudo[100627]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6a2a8a44-5ab3-410f-9a3f-8fbe9a83fd8d tempest-SnapshotsActionsTest-1459299255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.c4da7f74-ce8e-4e90-9aa9-b255ab6560c9" returned: 0 in 0.474s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-6a2a8a44-5ab3-410f-9a3f-8fbe9a83fd8d tempest-SnapshotsActionsTest-1459299255 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d75c95f-01f2-414f-8315-ddd08b770213(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 11:56:56 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[259149a9-1151-4031-ab90-0c7cfd315cc2]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:56:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6a2a8a44-5ab3-410f-9a3f-8fbe9a83fd8d tempest-SnapshotsActionsTest-1459299255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:56 devstack sudo[100632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372 Sep 28 11:56:56 devstack sudo[100632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:57 devstack sudo[100632]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6a2a8a44-5ab3-410f-9a3f-8fbe9a83fd8d tempest-SnapshotsActionsTest-1459299255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372" returned: 0 in 0.381s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-6a2a8a44-5ab3-410f-9a3f-8fbe9a83fd8d tempest-SnapshotsActionsTest-1459299255 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d75c95f-01f2-414f-8315-ddd08b770213(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 11:56:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6a2a8a44-5ab3-410f-9a3f-8fbe9a83fd8d tempest-SnapshotsActionsTest-1459299255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.c4da7f74-ce8e-4e90-9aa9-b255ab6560c9 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:57 devstack sudo[100641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.c4da7f74-ce8e-4e90-9aa9-b255ab6560c9 Sep 28 11:56:57 devstack sudo[100641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:57 devstack sudo[100641]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6a2a8a44-5ab3-410f-9a3f-8fbe9a83fd8d tempest-SnapshotsActionsTest-1459299255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.c4da7f74-ce8e-4e90-9aa9-b255ab6560c9" returned: 0 in 0.449s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6a2a8a44-5ab3-410f-9a3f-8fbe9a83fd8d tempest-SnapshotsActionsTest-1459299255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.c4da7f74-ce8e-4e90-9aa9-b255ab6560c9 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:57 devstack sudo[100651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.c4da7f74-ce8e-4e90-9aa9-b255ab6560c9 Sep 28 11:56:57 devstack sudo[100651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:57 devstack sudo[100651]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6a2a8a44-5ab3-410f-9a3f-8fbe9a83fd8d tempest-SnapshotsActionsTest-1459299255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.c4da7f74-ce8e-4e90-9aa9-b255ab6560c9" returned: 0 in 0.276s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6a2a8a44-5ab3-410f-9a3f-8fbe9a83fd8d tempest-SnapshotsActionsTest-1459299255 None] Lock "cinder-quobyte-c4da7f74-ce8e-4e90-9aa9-b255ab6560c9" released by "_delete_snapshot" :: held 1.706s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:56:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6a2a8a44-5ab3-410f-9a3f-8fbe9a83fd8d tempest-SnapshotsActionsTest-1459299255 None] Lock "cinder-quobyte-8d75c95f-01f2-414f-8315-ddd08b770213" released by "delete_snapshot" :: held 1.736s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:56:58 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-6a2a8a44-5ab3-410f-9a3f-8fbe9a83fd8d tempest-SnapshotsActionsTest-1459299255 None] Created reservations ['0f12f262-8e3b-4821-ad19-98f3c53e154d', '1a0d7233-7349-4c1f-819d-7b0ae0e1ff6a', 'da37acbf-2c8a-445d-9f3a-9cdd245e3e4f', 'd0b91c92-b1f7-4fc0-a1c9-134d41a95486'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:56:58 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-6a2a8a44-5ab3-410f-9a3f-8fbe9a83fd8d tempest-SnapshotsActionsTest-1459299255 None] Delete snapshot completed successfully. Sep 28 11:56:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6a2a8a44-5ab3-410f-9a3f-8fbe9a83fd8d tempest-SnapshotsActionsTest-1459299255 None] Lock "cinder-c4da7f74-ce8e-4e90-9aa9-b255ab6560c9-delete_snapshot" released by "delete_snapshot" :: held 1.916s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:56:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-60e8ecb0-7040-4ca6-9c99-fe1a22789ce7 tempest-SnapshotsActionsTest-236189319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:56:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-60e8ecb0-7040-4ca6-9c99-fe1a22789ce7 tempest-SnapshotsActionsTest-236189319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:56:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-60e8ecb0-7040-4ca6-9c99-fe1a22789ce7 tempest-SnapshotsActionsTest-236189319 None] Creating offline snapshot 494cb199-0f86-4496-8c9e-ed3602a1c5f7 of volume 8d75c95f-01f2-414f-8315-ddd08b770213 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 11:56:58 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b64fbe7-d546-48bd-8e64-6a09cf3257a5]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:56:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-60e8ecb0-7040-4ca6-9c99-fe1a22789ce7 tempest-SnapshotsActionsTest-236189319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:58 devstack sudo[100654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372 Sep 28 11:56:58 devstack sudo[100654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:59 devstack sudo[100654]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-60e8ecb0-7040-4ca6-9c99-fe1a22789ce7 tempest-SnapshotsActionsTest-236189319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372" returned: 0 in 0.420s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-60e8ecb0-7040-4ca6-9c99-fe1a22789ce7 tempest-SnapshotsActionsTest-236189319 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d75c95f-01f2-414f-8315-ddd08b770213(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 11:56:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-60e8ecb0-7040-4ca6-9c99-fe1a22789ce7 tempest-SnapshotsActionsTest-236189319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.494cb199-0f86-4496-8c9e-ed3602a1c5f7 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:59 devstack sudo[100659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.494cb199-0f86-4496-8c9e-ed3602a1c5f7 1G Sep 28 11:56:59 devstack sudo[100659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:56:59 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-027db058-dee5-4265-b868-9ff40feadb58 tempest-VolumeTypesAccessTest-1027366097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:56:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-027db058-dee5-4265-b868-9ff40feadb58 tempest-VolumeTypesAccessTest-1027366097 None] Flow 'volume_create_manager' (fe0985b3-2600-44c7-a20d-0ee7163448a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:56:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-027db058-dee5-4265-b868-9ff40feadb58 tempest-VolumeTypesAccessTest-1027366097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a78e2add-d5e5-4e1a-a0f4-0b03def71437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:56:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-027db058-dee5-4265-b868-9ff40feadb58 tempest-VolumeTypesAccessTest-1027366097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a78e2add-d5e5-4e1a-a0f4-0b03def71437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1575860944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7744d796-6f65-4c78-89e4-7fac3631067c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df8212d5a16e4874a8c891cb2dd8b234',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:57:00Z,use_quota=True,user_id='52870dbddd85450aa5562a30e3f43ad0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b80592c-721f-40a2-8205-ab26667baebb),volume_type_id=9b80592c-721f-40a2-8205-ab26667baebb)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:56:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-027db058-dee5-4265-b868-9ff40feadb58 tempest-VolumeTypesAccessTest-1027366097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (587adf71-a999-4c68-ab9c-1e46a4e73b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:56:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-027db058-dee5-4265-b868-9ff40feadb58 tempest-VolumeTypesAccessTest-1027366097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (587adf71-a999-4c68-ab9c-1e46a4e73b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:56:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-027db058-dee5-4265-b868-9ff40feadb58 tempest-VolumeTypesAccessTest-1027366097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66a064ce-5d5f-4d28-8fe9-6b4848fa57e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:56:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-027db058-dee5-4265-b868-9ff40feadb58 tempest-VolumeTypesAccessTest-1027366097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66a064ce-5d5f-4d28-8fe9-6b4848fa57e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7744d796-6f65-4c78-89e4-7fac3631067c', 'volume_name': 'volume-7744d796-6f65-4c78-89e4-7fac3631067c', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:56:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-027db058-dee5-4265-b868-9ff40feadb58 tempest-VolumeTypesAccessTest-1027366097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (809640c4-43f6-4a8d-bbd9-709da0735dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:56:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-027db058-dee5-4265-b868-9ff40feadb58 tempest-VolumeTypesAccessTest-1027366097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (809640c4-43f6-4a8d-bbd9-709da0735dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:56:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-027db058-dee5-4265-b868-9ff40feadb58 tempest-VolumeTypesAccessTest-1027366097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caf4a621-545c-4545-b537-34379f21e265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:56:59 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-027db058-dee5-4265-b868-9ff40feadb58 tempest-VolumeTypesAccessTest-1027366097 None] Volume 7744d796-6f65-4c78-89e4-7fac3631067c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7744d796-6f65-4c78-89e4-7fac3631067c', 'volume_size': 1} Sep 28 11:56:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-027db058-dee5-4265-b868-9ff40feadb58 tempest-VolumeTypesAccessTest-1027366097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:56:59 devstack sudo[100659]: pam_unix(sudo:session): session closed for user root Sep 28 11:56:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-60e8ecb0-7040-4ca6-9c99-fe1a22789ce7 tempest-SnapshotsActionsTest-236189319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.494cb199-0f86-4496-8c9e-ed3602a1c5f7 1G" returned: 0 in 0.605s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:56:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-60e8ecb0-7040-4ca6-9c99-fe1a22789ce7 tempest-SnapshotsActionsTest-236189319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.494cb199-0f86-4496-8c9e-ed3602a1c5f7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:56:59 devstack sudo[100669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.494cb199-0f86-4496-8c9e-ed3602a1c5f7 Sep 28 11:56:59 devstack sudo[100669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:57:00 devstack sudo[100669]: pam_unix(sudo:session): session closed for user root Sep 28 11:57:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-60e8ecb0-7040-4ca6-9c99-fe1a22789ce7 tempest-SnapshotsActionsTest-236189319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.494cb199-0f86-4496-8c9e-ed3602a1c5f7" returned: 0 in 0.322s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:57:00 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-60e8ecb0-7040-4ca6-9c99-fe1a22789ce7 tempest-SnapshotsActionsTest-236189319 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.494cb199-0f86-4496-8c9e-ed3602a1c5f7 is being set with open permissions: ugo+rw Sep 28 11:57:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-60e8ecb0-7040-4ca6-9c99-fe1a22789ce7 tempest-SnapshotsActionsTest-236189319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.494cb199-0f86-4496-8c9e-ed3602a1c5f7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:57:00 devstack sudo[100680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.494cb199-0f86-4496-8c9e-ed3602a1c5f7 Sep 28 11:57:00 devstack sudo[100680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:57:00 devstack sudo[100680]: pam_unix(sudo:session): session closed for user root Sep 28 11:57:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-60e8ecb0-7040-4ca6-9c99-fe1a22789ce7 tempest-SnapshotsActionsTest-236189319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.494cb199-0f86-4496-8c9e-ed3602a1c5f7" returned: 0 in 0.238s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:57:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-60e8ecb0-7040-4ca6-9c99-fe1a22789ce7 tempest-SnapshotsActionsTest-236189319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.710s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:57:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-027db058-dee5-4265-b868-9ff40feadb58 tempest-VolumeTypesAccessTest-1027366097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.677s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:57:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-027db058-dee5-4265-b868-9ff40feadb58 tempest-VolumeTypesAccessTest-1027366097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1575860944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7744d796-6f65-4c78-89e4-7fac3631067c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df8212d5a16e4874a8c891cb2dd8b234',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:57:00Z,use_quota=True,user_id='52870dbddd85450aa5562a30e3f43ad0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b80592c-721f-40a2-8205-ab26667baebb),volume_type_id=9b80592c-721f-40a2-8205-ab26667baebb)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:57:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-027db058-dee5-4265-b868-9ff40feadb58 tempest-VolumeTypesAccessTest-1027366097 None] Creating volume 7744d796-6f65-4c78-89e4-7fac3631067c {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:57:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-027db058-dee5-4265-b868-9ff40feadb58 tempest-VolumeTypesAccessTest-1027366097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:57:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-027db058-dee5-4265-b868-9ff40feadb58 tempest-VolumeTypesAccessTest-1027366097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:57:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-027db058-dee5-4265-b868-9ff40feadb58 tempest-VolumeTypesAccessTest-1027366097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:57:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-027db058-dee5-4265-b868-9ff40feadb58 tempest-VolumeTypesAccessTest-1027366097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:57:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-027db058-dee5-4265-b868-9ff40feadb58 tempest-VolumeTypesAccessTest-1027366097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:57:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-027db058-dee5-4265-b868-9ff40feadb58 tempest-VolumeTypesAccessTest-1027366097 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:57:00 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-027db058-dee5-4265-b868-9ff40feadb58 tempest-VolumeTypesAccessTest-1027366097 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:57:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-027db058-dee5-4265-b868-9ff40feadb58 tempest-VolumeTypesAccessTest-1027366097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-7744d796-6f65-4c78-89e4-7fac3631067c 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:57:00 devstack sudo[100690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-7744d796-6f65-4c78-89e4-7fac3631067c 1073741824 Sep 28 11:57:00 devstack sudo[100690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:57:00 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-60e8ecb0-7040-4ca6-9c99-fe1a22789ce7 tempest-SnapshotsActionsTest-236189319 None] Create snapshot completed successfully Sep 28 11:57:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a587a244-13c9-4f11-a921-b40ecf2c6ee3 tempest-SnapshotsActionsTest-1459299255 None] Acquiring lock "cinder-494cb199-0f86-4496-8c9e-ed3602a1c5f7-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:57:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a587a244-13c9-4f11-a921-b40ecf2c6ee3 tempest-SnapshotsActionsTest-1459299255 None] Lock "cinder-494cb199-0f86-4496-8c9e-ed3602a1c5f7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:57:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a587a244-13c9-4f11-a921-b40ecf2c6ee3 tempest-SnapshotsActionsTest-1459299255 None] Acquiring lock "cinder-quobyte-8d75c95f-01f2-414f-8315-ddd08b770213" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:57:00 devstack sudo[100690]: pam_unix(sudo:session): session closed for user root Sep 28 11:57:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a587a244-13c9-4f11-a921-b40ecf2c6ee3 tempest-SnapshotsActionsTest-1459299255 None] Lock "cinder-quobyte-8d75c95f-01f2-414f-8315-ddd08b770213" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:57:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a587a244-13c9-4f11-a921-b40ecf2c6ee3 tempest-SnapshotsActionsTest-1459299255 None] Acquiring lock "cinder-quobyte-494cb199-0f86-4496-8c9e-ed3602a1c5f7" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:57:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-027db058-dee5-4265-b868-9ff40feadb58 tempest-VolumeTypesAccessTest-1027366097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-7744d796-6f65-4c78-89e4-7fac3631067c 1073741824" returned: 0 in 0.546s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:57:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a587a244-13c9-4f11-a921-b40ecf2c6ee3 tempest-SnapshotsActionsTest-1459299255 None] Lock "cinder-quobyte-494cb199-0f86-4496-8c9e-ed3602a1c5f7" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:57:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-a587a244-13c9-4f11-a921-b40ecf2c6ee3 tempest-SnapshotsActionsTest-1459299255 None] Deleting offline snapshot 494cb199-0f86-4496-8c9e-ed3602a1c5f7 of volume 8d75c95f-01f2-414f-8315-ddd08b770213 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 11:57:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-a587a244-13c9-4f11-a921-b40ecf2c6ee3 tempest-SnapshotsActionsTest-1459299255 None] snapshot_file for this snap is: volume-8d75c95f-01f2-414f-8315-ddd08b770213.494cb199-0f86-4496-8c9e-ed3602a1c5f7 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 11:57:01 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[e957c772-5664-435a-a45f-098ae41c10e1]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:57:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a587a244-13c9-4f11-a921-b40ecf2c6ee3 tempest-SnapshotsActionsTest-1459299255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.494cb199-0f86-4496-8c9e-ed3602a1c5f7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:57:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-027db058-dee5-4265-b868-9ff40feadb58 tempest-VolumeTypesAccessTest-1027366097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-7744d796-6f65-4c78-89e4-7fac3631067c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:57:01 devstack sudo[100701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-7744d796-6f65-4c78-89e4-7fac3631067c Sep 28 11:57:01 devstack sudo[100701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:57:01 devstack sudo[100700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.494cb199-0f86-4496-8c9e-ed3602a1c5f7 Sep 28 11:57:01 devstack sudo[100700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:57:01 devstack sudo[100701]: pam_unix(sudo:session): session closed for user root Sep 28 11:57:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-027db058-dee5-4265-b868-9ff40feadb58 tempest-VolumeTypesAccessTest-1027366097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-7744d796-6f65-4c78-89e4-7fac3631067c" returned: 0 in 0.249s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:57:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-027db058-dee5-4265-b868-9ff40feadb58 tempest-VolumeTypesAccessTest-1027366097 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:57:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-027db058-dee5-4265-b868-9ff40feadb58 tempest-VolumeTypesAccessTest-1027366097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:57:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-027db058-dee5-4265-b868-9ff40feadb58 tempest-VolumeTypesAccessTest-1027366097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caf4a621-545c-4545-b537-34379f21e265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7744d796-6f65-4c78-89e4-7fac3631067c', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:57:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-027db058-dee5-4265-b868-9ff40feadb58 tempest-VolumeTypesAccessTest-1027366097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c93ee07a-11c1-4a58-ba52-820f92bab128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:57:01 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-027db058-dee5-4265-b868-9ff40feadb58 tempest-VolumeTypesAccessTest-1027366097 None] Volume volume-7744d796-6f65-4c78-89e4-7fac3631067c (7744d796-6f65-4c78-89e4-7fac3631067c): created successfully Sep 28 11:57:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-027db058-dee5-4265-b868-9ff40feadb58 tempest-VolumeTypesAccessTest-1027366097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c93ee07a-11c1-4a58-ba52-820f92bab128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:57:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-027db058-dee5-4265-b868-9ff40feadb58 tempest-VolumeTypesAccessTest-1027366097 None] Flow 'volume_create_manager' (fe0985b3-2600-44c7-a20d-0ee7163448a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:57:01 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-027db058-dee5-4265-b868-9ff40feadb58 tempest-VolumeTypesAccessTest-1027366097 None] Created volume successfully. Sep 28 11:57:01 devstack sudo[100700]: pam_unix(sudo:session): session closed for user root Sep 28 11:57:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a587a244-13c9-4f11-a921-b40ecf2c6ee3 tempest-SnapshotsActionsTest-1459299255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.494cb199-0f86-4496-8c9e-ed3602a1c5f7" returned: 0 in 0.401s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:57:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-a587a244-13c9-4f11-a921-b40ecf2c6ee3 tempest-SnapshotsActionsTest-1459299255 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d75c95f-01f2-414f-8315-ddd08b770213(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 11:57:01 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e3f483-1261-4433-9424-1e0c0afdf4fd]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:57:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a587a244-13c9-4f11-a921-b40ecf2c6ee3 tempest-SnapshotsActionsTest-1459299255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:57:01 devstack sudo[100712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372 Sep 28 11:57:01 devstack sudo[100712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:57:01 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-b991630f-fe66-479c-b96e-3769a27fd32c req-fa5e9ef4-6eb6-459e-9d3b-a213c93ae5d0 tempest-TestInstancesWithCinderVolumes-991430352 None] Terminate volume connection completed successfully. Sep 28 11:57:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-b991630f-fe66-479c-b96e-3769a27fd32c req-fa5e9ef4-6eb6-459e-9d3b-a213c93ae5d0 tempest-TestInstancesWithCinderVolumes-991430352 None] Deleting attachment c6ab87c3-920c-41ae-96f1-766367b9bd1e. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 11:57:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f44b10b8-c820-40d4-aa5e-ba61fa7d5d93 tempest-VolumeTypesAccessTest-1027366097 None] Acquiring lock "cinder-7744d796-6f65-4c78-89e4-7fac3631067c-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:57:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f44b10b8-c820-40d4-aa5e-ba61fa7d5d93 tempest-VolumeTypesAccessTest-1027366097 None] Lock "cinder-7744d796-6f65-4c78-89e4-7fac3631067c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:57:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f44b10b8-c820-40d4-aa5e-ba61fa7d5d93 tempest-VolumeTypesAccessTest-1027366097 None] Acquiring lock "cinder-quobyte-7744d796-6f65-4c78-89e4-7fac3631067c" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:57:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f44b10b8-c820-40d4-aa5e-ba61fa7d5d93 tempest-VolumeTypesAccessTest-1027366097 None] Lock "cinder-quobyte-7744d796-6f65-4c78-89e4-7fac3631067c" acquired by "delete_volume" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:57:01 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b815d6-3b3a-478c-a88f-f99f65c332d9]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:57:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f44b10b8-c820-40d4-aa5e-ba61fa7d5d93 tempest-VolumeTypesAccessTest-1027366097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-7744d796-6f65-4c78-89e4-7fac3631067c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:57:01 devstack sudo[100712]: pam_unix(sudo:session): session closed for user root Sep 28 11:57:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a587a244-13c9-4f11-a921-b40ecf2c6ee3 tempest-SnapshotsActionsTest-1459299255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372" returned: 0 in 0.427s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:57:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-a587a244-13c9-4f11-a921-b40ecf2c6ee3 tempest-SnapshotsActionsTest-1459299255 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d75c95f-01f2-414f-8315-ddd08b770213(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 11:57:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a587a244-13c9-4f11-a921-b40ecf2c6ee3 tempest-SnapshotsActionsTest-1459299255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.494cb199-0f86-4496-8c9e-ed3602a1c5f7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:57:01 devstack sudo[100719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.494cb199-0f86-4496-8c9e-ed3602a1c5f7 Sep 28 11:57:01 devstack sudo[100719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:57:02 devstack sudo[100718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-7744d796-6f65-4c78-89e4-7fac3631067c Sep 28 11:57:02 devstack sudo[100718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:57:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-28434b27-f28a-4db7-b015-cfdbb8419722 tempest-TestInstancesWithCinderVolumes-991430352 None] Acquiring lock "cinder-084be243-a5bc-42bb-8735-66c5dc3d6cae-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:57:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-28434b27-f28a-4db7-b015-cfdbb8419722 tempest-TestInstancesWithCinderVolumes-991430352 None] Lock "cinder-084be243-a5bc-42bb-8735-66c5dc3d6cae-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:57:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-28434b27-f28a-4db7-b015-cfdbb8419722 tempest-TestInstancesWithCinderVolumes-991430352 None] Acquiring lock "cinder-quobyte-084be243-a5bc-42bb-8735-66c5dc3d6cae" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:57:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-28434b27-f28a-4db7-b015-cfdbb8419722 tempest-TestInstancesWithCinderVolumes-991430352 None] Lock "cinder-quobyte-084be243-a5bc-42bb-8735-66c5dc3d6cae" acquired by "delete_volume" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:57:02 devstack sudo[100718]: pam_unix(sudo:session): session closed for user root Sep 28 11:57:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f44b10b8-c820-40d4-aa5e-ba61fa7d5d93 tempest-VolumeTypesAccessTest-1027366097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-7744d796-6f65-4c78-89e4-7fac3631067c" returned: 0 in 0.418s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:57:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f44b10b8-c820-40d4-aa5e-ba61fa7d5d93 tempest-VolumeTypesAccessTest-1027366097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-7744d796-6f65-4c78-89e4-7fac3631067c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:57:02 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e4c9a1-197d-41a4-9c63-878854564b13]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:57:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-28434b27-f28a-4db7-b015-cfdbb8419722 tempest-TestInstancesWithCinderVolumes-991430352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-084be243-a5bc-42bb-8735-66c5dc3d6cae {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:57:02 devstack sudo[100733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-7744d796-6f65-4c78-89e4-7fac3631067c Sep 28 11:57:02 devstack sudo[100733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:57:02 devstack sudo[100719]: pam_unix(sudo:session): session closed for user root Sep 28 11:57:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a587a244-13c9-4f11-a921-b40ecf2c6ee3 tempest-SnapshotsActionsTest-1459299255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.494cb199-0f86-4496-8c9e-ed3602a1c5f7" returned: 0 in 0.469s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:57:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a587a244-13c9-4f11-a921-b40ecf2c6ee3 tempest-SnapshotsActionsTest-1459299255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.494cb199-0f86-4496-8c9e-ed3602a1c5f7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:57:02 devstack sudo[100736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.494cb199-0f86-4496-8c9e-ed3602a1c5f7 Sep 28 11:57:02 devstack sudo[100736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:57:02 devstack sudo[100734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-084be243-a5bc-42bb-8735-66c5dc3d6cae Sep 28 11:57:02 devstack sudo[100734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:57:02 devstack sudo[100733]: pam_unix(sudo:session): session closed for user root Sep 28 11:57:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f44b10b8-c820-40d4-aa5e-ba61fa7d5d93 tempest-VolumeTypesAccessTest-1027366097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-7744d796-6f65-4c78-89e4-7fac3631067c" returned: 0 in 0.328s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:57:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f44b10b8-c820-40d4-aa5e-ba61fa7d5d93 tempest-VolumeTypesAccessTest-1027366097 None] Lock "cinder-quobyte-7744d796-6f65-4c78-89e4-7fac3631067c" released by "delete_volume" :: held 0.797s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:57:02 devstack sudo[100736]: pam_unix(sudo:session): session closed for user root Sep 28 11:57:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a587a244-13c9-4f11-a921-b40ecf2c6ee3 tempest-SnapshotsActionsTest-1459299255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.494cb199-0f86-4496-8c9e-ed3602a1c5f7" returned: 0 in 0.300s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:57:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a587a244-13c9-4f11-a921-b40ecf2c6ee3 tempest-SnapshotsActionsTest-1459299255 None] Lock "cinder-quobyte-494cb199-0f86-4496-8c9e-ed3602a1c5f7" released by "_delete_snapshot" :: held 1.737s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:57:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a587a244-13c9-4f11-a921-b40ecf2c6ee3 tempest-SnapshotsActionsTest-1459299255 None] Lock "cinder-quobyte-8d75c95f-01f2-414f-8315-ddd08b770213" released by "delete_snapshot" :: held 1.774s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:57:02 devstack cinder-volume[86916]: WARNING cinder.quota [None req-f44b10b8-c820-40d4-aa5e-ba61fa7d5d93 tempest-VolumeTypesAccessTest-1027366097 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1609888804 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1609888804, it is now deprecated. Please use the default quota class for default quota. Sep 28 11:57:02 devstack cinder-volume[86916]: WARNING cinder.quota [None req-f44b10b8-c820-40d4-aa5e-ba61fa7d5d93 tempest-VolumeTypesAccessTest-1027366097 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1609888804 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1609888804, it is now deprecated. Please use the default quota class for default quota. Sep 28 11:57:02 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-f44b10b8-c820-40d4-aa5e-ba61fa7d5d93 tempest-VolumeTypesAccessTest-1027366097 None] Created reservations ['8958f976-f800-41fc-9416-52e07745b774', '4b406025-99a7-4a98-a268-0ab4c1503c6b', '43b206b4-aefc-4153-8368-93004dffca14', '14187d98-ddc5-48dd-851b-cc7a030a3754'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:57:02 devstack sudo[100734]: pam_unix(sudo:session): session closed for user root Sep 28 11:57:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-28434b27-f28a-4db7-b015-cfdbb8419722 tempest-TestInstancesWithCinderVolumes-991430352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-084be243-a5bc-42bb-8735-66c5dc3d6cae" returned: 0 in 0.486s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:57:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-28434b27-f28a-4db7-b015-cfdbb8419722 tempest-TestInstancesWithCinderVolumes-991430352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-084be243-a5bc-42bb-8735-66c5dc3d6cae {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:57:02 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-a587a244-13c9-4f11-a921-b40ecf2c6ee3 tempest-SnapshotsActionsTest-1459299255 None] Created reservations ['f6778022-6f0a-48e8-8d79-0bd6a267cabf', '986ca457-878c-473d-ada5-6108678c4be5', '35d77f9d-8192-4b8e-a708-7d163d12e50d', 'e351d38d-4aff-469b-a850-0eef084841d9'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:57:02 devstack sudo[100745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-084be243-a5bc-42bb-8735-66c5dc3d6cae Sep 28 11:57:02 devstack sudo[100745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:57:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f44b10b8-c820-40d4-aa5e-ba61fa7d5d93 tempest-VolumeTypesAccessTest-1027366097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:57:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f44b10b8-c820-40d4-aa5e-ba61fa7d5d93 tempest-VolumeTypesAccessTest-1027366097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:57:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f44b10b8-c820-40d4-aa5e-ba61fa7d5d93 tempest-VolumeTypesAccessTest-1027366097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:57:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f44b10b8-c820-40d4-aa5e-ba61fa7d5d93 tempest-VolumeTypesAccessTest-1027366097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:57:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f44b10b8-c820-40d4-aa5e-ba61fa7d5d93 tempest-VolumeTypesAccessTest-1027366097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:57:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f44b10b8-c820-40d4-aa5e-ba61fa7d5d93 tempest-VolumeTypesAccessTest-1027366097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:57:02 devstack sudo[100747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:57:02 devstack sudo[100747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:57:03 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-a587a244-13c9-4f11-a921-b40ecf2c6ee3 tempest-SnapshotsActionsTest-1459299255 None] Delete snapshot completed successfully. Sep 28 11:57:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a587a244-13c9-4f11-a921-b40ecf2c6ee3 tempest-SnapshotsActionsTest-1459299255 None] Lock "cinder-494cb199-0f86-4496-8c9e-ed3602a1c5f7-delete_snapshot" released by "delete_snapshot" :: held 2.079s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:57:03 devstack sudo[100745]: pam_unix(sudo:session): session closed for user root Sep 28 11:57:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-28434b27-f28a-4db7-b015-cfdbb8419722 tempest-TestInstancesWithCinderVolumes-991430352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-084be243-a5bc-42bb-8735-66c5dc3d6cae" returned: 0 in 0.434s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:57:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-28434b27-f28a-4db7-b015-cfdbb8419722 tempest-TestInstancesWithCinderVolumes-991430352 None] Lock "cinder-quobyte-084be243-a5bc-42bb-8735-66c5dc3d6cae" released by "delete_volume" :: held 0.984s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:57:03 devstack cinder-volume[86916]: WARNING cinder.quota [None req-28434b27-f28a-4db7-b015-cfdbb8419722 tempest-TestInstancesWithCinderVolumes-991430352 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-961342321-134015263 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-961342321-134015263, it is now deprecated. Please use the default quota class for default quota. Sep 28 11:57:03 devstack cinder-volume[86916]: WARNING cinder.quota [None req-28434b27-f28a-4db7-b015-cfdbb8419722 tempest-TestInstancesWithCinderVolumes-991430352 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-961342321-134015263 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-961342321-134015263, it is now deprecated. Please use the default quota class for default quota. Sep 28 11:57:03 devstack sudo[100747]: pam_unix(sudo:session): session closed for user root Sep 28 11:57:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f44b10b8-c820-40d4-aa5e-ba61fa7d5d93 tempest-VolumeTypesAccessTest-1027366097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.444s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:57:03 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-f44b10b8-c820-40d4-aa5e-ba61fa7d5d93 tempest-VolumeTypesAccessTest-1027366097 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:57:03 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-f44b10b8-c820-40d4-aa5e-ba61fa7d5d93 tempest-VolumeTypesAccessTest-1027366097 None] Deleted volume successfully. Sep 28 11:57:03 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-28434b27-f28a-4db7-b015-cfdbb8419722 tempest-TestInstancesWithCinderVolumes-991430352 None] Created reservations ['8d13d423-d40a-4078-b844-be4feaa89741', '0f3001e8-24ed-4458-ab4a-5853f2e1560c', '05daa1ca-1dc6-4411-a55d-c14497c1c622', '8834550f-c7af-4f6d-b3d8-2cc818b584da'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:57:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f44b10b8-c820-40d4-aa5e-ba61fa7d5d93 tempest-VolumeTypesAccessTest-1027366097 None] Lock "cinder-7744d796-6f65-4c78-89e4-7fac3631067c-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:57:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-28434b27-f28a-4db7-b015-cfdbb8419722 tempest-TestInstancesWithCinderVolumes-991430352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:57:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-28434b27-f28a-4db7-b015-cfdbb8419722 tempest-TestInstancesWithCinderVolumes-991430352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:57:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-28434b27-f28a-4db7-b015-cfdbb8419722 tempest-TestInstancesWithCinderVolumes-991430352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:57:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-28434b27-f28a-4db7-b015-cfdbb8419722 tempest-TestInstancesWithCinderVolumes-991430352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:57:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-28434b27-f28a-4db7-b015-cfdbb8419722 tempest-TestInstancesWithCinderVolumes-991430352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:57:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-28434b27-f28a-4db7-b015-cfdbb8419722 tempest-TestInstancesWithCinderVolumes-991430352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:57:03 devstack sudo[100751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:57:03 devstack sudo[100751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:57:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3b4803ea-9148-41df-bc21-dce5b518cd5e tempest-SnapshotsActionsTest-236189319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:57:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3b4803ea-9148-41df-bc21-dce5b518cd5e tempest-SnapshotsActionsTest-236189319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:57:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-3b4803ea-9148-41df-bc21-dce5b518cd5e tempest-SnapshotsActionsTest-236189319 None] Creating offline snapshot 510f9d0b-4843-4cf9-bc27-4faed750be05 of volume 8d75c95f-01f2-414f-8315-ddd08b770213 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 11:57:03 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b833547-0538-4c27-af35-b085f45314bc]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:57:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3b4803ea-9148-41df-bc21-dce5b518cd5e tempest-SnapshotsActionsTest-236189319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:57:03 devstack sudo[100753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372 Sep 28 11:57:03 devstack sudo[100753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:57:03 devstack sudo[100751]: pam_unix(sudo:session): session closed for user root Sep 28 11:57:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-28434b27-f28a-4db7-b015-cfdbb8419722 tempest-TestInstancesWithCinderVolumes-991430352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.350s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:57:03 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-28434b27-f28a-4db7-b015-cfdbb8419722 tempest-TestInstancesWithCinderVolumes-991430352 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:57:03 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-28434b27-f28a-4db7-b015-cfdbb8419722 tempest-TestInstancesWithCinderVolumes-991430352 None] Deleted volume successfully. Sep 28 11:57:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-28434b27-f28a-4db7-b015-cfdbb8419722 tempest-TestInstancesWithCinderVolumes-991430352 None] Lock "cinder-084be243-a5bc-42bb-8735-66c5dc3d6cae-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:57:04 devstack sudo[100753]: pam_unix(sudo:session): session closed for user root Sep 28 11:57:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3b4803ea-9148-41df-bc21-dce5b518cd5e tempest-SnapshotsActionsTest-236189319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372" returned: 0 in 0.474s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:57:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-3b4803ea-9148-41df-bc21-dce5b518cd5e tempest-SnapshotsActionsTest-236189319 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d75c95f-01f2-414f-8315-ddd08b770213(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 11:57:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3b4803ea-9148-41df-bc21-dce5b518cd5e tempest-SnapshotsActionsTest-236189319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.510f9d0b-4843-4cf9-bc27-4faed750be05 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:57:04 devstack sudo[100759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.510f9d0b-4843-4cf9-bc27-4faed750be05 1G Sep 28 11:57:04 devstack sudo[100759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:57:04 devstack sudo[100759]: pam_unix(sudo:session): session closed for user root Sep 28 11:57:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3b4803ea-9148-41df-bc21-dce5b518cd5e tempest-SnapshotsActionsTest-236189319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.510f9d0b-4843-4cf9-bc27-4faed750be05 1G" returned: 0 in 0.627s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:57:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3b4803ea-9148-41df-bc21-dce5b518cd5e tempest-SnapshotsActionsTest-236189319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.510f9d0b-4843-4cf9-bc27-4faed750be05 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:57:04 devstack sudo[100767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.510f9d0b-4843-4cf9-bc27-4faed750be05 Sep 28 11:57:04 devstack sudo[100767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:57:05 devstack sudo[100767]: pam_unix(sudo:session): session closed for user root Sep 28 11:57:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3b4803ea-9148-41df-bc21-dce5b518cd5e tempest-SnapshotsActionsTest-236189319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.510f9d0b-4843-4cf9-bc27-4faed750be05" returned: 0 in 0.372s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:57:05 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-3b4803ea-9148-41df-bc21-dce5b518cd5e tempest-SnapshotsActionsTest-236189319 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.510f9d0b-4843-4cf9-bc27-4faed750be05 is being set with open permissions: ugo+rw Sep 28 11:57:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3b4803ea-9148-41df-bc21-dce5b518cd5e tempest-SnapshotsActionsTest-236189319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.510f9d0b-4843-4cf9-bc27-4faed750be05 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:57:05 devstack sudo[100782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.510f9d0b-4843-4cf9-bc27-4faed750be05 Sep 28 11:57:05 devstack sudo[100782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:57:05 devstack sudo[100782]: pam_unix(sudo:session): session closed for user root Sep 28 11:57:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3b4803ea-9148-41df-bc21-dce5b518cd5e tempest-SnapshotsActionsTest-236189319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.510f9d0b-4843-4cf9-bc27-4faed750be05" returned: 0 in 0.323s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:57:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3b4803ea-9148-41df-bc21-dce5b518cd5e tempest-SnapshotsActionsTest-236189319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.958s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:57:05 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-3b4803ea-9148-41df-bc21-dce5b518cd5e tempest-SnapshotsActionsTest-236189319 None] Create snapshot completed successfully Sep 28 11:57:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-32ee55a9-ac22-4f3e-8798-2496bda64d7c tempest-SnapshotsActionsTest-1459299255 None] Acquiring lock "cinder-510f9d0b-4843-4cf9-bc27-4faed750be05-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:57:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-32ee55a9-ac22-4f3e-8798-2496bda64d7c tempest-SnapshotsActionsTest-1459299255 None] Lock "cinder-510f9d0b-4843-4cf9-bc27-4faed750be05-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:57:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-32ee55a9-ac22-4f3e-8798-2496bda64d7c tempest-SnapshotsActionsTest-1459299255 None] Acquiring lock "cinder-quobyte-8d75c95f-01f2-414f-8315-ddd08b770213" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:57:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-32ee55a9-ac22-4f3e-8798-2496bda64d7c tempest-SnapshotsActionsTest-1459299255 None] Lock "cinder-quobyte-8d75c95f-01f2-414f-8315-ddd08b770213" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:57:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-32ee55a9-ac22-4f3e-8798-2496bda64d7c tempest-SnapshotsActionsTest-1459299255 None] Acquiring lock "cinder-quobyte-510f9d0b-4843-4cf9-bc27-4faed750be05" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:57:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-32ee55a9-ac22-4f3e-8798-2496bda64d7c tempest-SnapshotsActionsTest-1459299255 None] Lock "cinder-quobyte-510f9d0b-4843-4cf9-bc27-4faed750be05" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:57:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-32ee55a9-ac22-4f3e-8798-2496bda64d7c tempest-SnapshotsActionsTest-1459299255 None] Deleting offline snapshot 510f9d0b-4843-4cf9-bc27-4faed750be05 of volume 8d75c95f-01f2-414f-8315-ddd08b770213 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 11:57:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-32ee55a9-ac22-4f3e-8798-2496bda64d7c tempest-SnapshotsActionsTest-1459299255 None] snapshot_file for this snap is: volume-8d75c95f-01f2-414f-8315-ddd08b770213.510f9d0b-4843-4cf9-bc27-4faed750be05 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 11:57:05 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce983f3d-7414-4c61-8ac1-3e69e303b135]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:57:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-32ee55a9-ac22-4f3e-8798-2496bda64d7c tempest-SnapshotsActionsTest-1459299255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.510f9d0b-4843-4cf9-bc27-4faed750be05 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:57:06 devstack sudo[100798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.510f9d0b-4843-4cf9-bc27-4faed750be05 Sep 28 11:57:06 devstack sudo[100798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:57:06 devstack sudo[100798]: pam_unix(sudo:session): session closed for user root Sep 28 11:57:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-32ee55a9-ac22-4f3e-8798-2496bda64d7c tempest-SnapshotsActionsTest-1459299255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.510f9d0b-4843-4cf9-bc27-4faed750be05" returned: 0 in 0.456s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:57:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-32ee55a9-ac22-4f3e-8798-2496bda64d7c tempest-SnapshotsActionsTest-1459299255 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d75c95f-01f2-414f-8315-ddd08b770213(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 11:57:06 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[751fa85c-0428-477b-ae42-85233726fb73]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:57:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-32ee55a9-ac22-4f3e-8798-2496bda64d7c tempest-SnapshotsActionsTest-1459299255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:57:06 devstack sudo[100803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372 Sep 28 11:57:06 devstack sudo[100803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:57:06 devstack sudo[100803]: pam_unix(sudo:session): session closed for user root Sep 28 11:57:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-32ee55a9-ac22-4f3e-8798-2496bda64d7c tempest-SnapshotsActionsTest-1459299255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372" returned: 0 in 0.441s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:57:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-32ee55a9-ac22-4f3e-8798-2496bda64d7c tempest-SnapshotsActionsTest-1459299255 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d75c95f-01f2-414f-8315-ddd08b770213(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 11:57:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-32ee55a9-ac22-4f3e-8798-2496bda64d7c tempest-SnapshotsActionsTest-1459299255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.510f9d0b-4843-4cf9-bc27-4faed750be05 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:57:06 devstack sudo[100827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.510f9d0b-4843-4cf9-bc27-4faed750be05 Sep 28 11:57:06 devstack sudo[100827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:57:06 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-1b04ffee-50fc-4439-8df4-b3c54ea2ead8 req-b08d9e0e-758d-419a-a948-96b59fad6583 tempest-TestInstancesWithCinderVolumes-991430352 None] Terminate volume connection completed successfully. Sep 28 11:57:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-1b04ffee-50fc-4439-8df4-b3c54ea2ead8 req-b08d9e0e-758d-419a-a948-96b59fad6583 tempest-TestInstancesWithCinderVolumes-991430352 None] Deleting attachment 22d08c15-b6f7-4111-8804-385bba6f023e. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 11:57:07 devstack sudo[100827]: pam_unix(sudo:session): session closed for user root Sep 28 11:57:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-32ee55a9-ac22-4f3e-8798-2496bda64d7c tempest-SnapshotsActionsTest-1459299255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.510f9d0b-4843-4cf9-bc27-4faed750be05" returned: 0 in 0.475s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:57:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-32ee55a9-ac22-4f3e-8798-2496bda64d7c tempest-SnapshotsActionsTest-1459299255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.510f9d0b-4843-4cf9-bc27-4faed750be05 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:57:07 devstack sudo[100854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.510f9d0b-4843-4cf9-bc27-4faed750be05 Sep 28 11:57:07 devstack sudo[100854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:57:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-da013e62-d44d-4610-b2cf-d3d8105d8c7c tempest-TestInstancesWithCinderVolumes-991430352 None] Acquiring lock "cinder-cc57d5d6-739d-459b-af23-9c272cedbecb-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:57:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-da013e62-d44d-4610-b2cf-d3d8105d8c7c tempest-TestInstancesWithCinderVolumes-991430352 None] Lock "cinder-cc57d5d6-739d-459b-af23-9c272cedbecb-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:57:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-da013e62-d44d-4610-b2cf-d3d8105d8c7c tempest-TestInstancesWithCinderVolumes-991430352 None] Acquiring lock "cinder-quobyte-cc57d5d6-739d-459b-af23-9c272cedbecb" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:57:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-da013e62-d44d-4610-b2cf-d3d8105d8c7c tempest-TestInstancesWithCinderVolumes-991430352 None] Lock "cinder-quobyte-cc57d5d6-739d-459b-af23-9c272cedbecb" acquired by "delete_volume" :: waited 0.030s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:57:07 devstack sudo[100854]: pam_unix(sudo:session): session closed for user root Sep 28 11:57:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-32ee55a9-ac22-4f3e-8798-2496bda64d7c tempest-SnapshotsActionsTest-1459299255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.510f9d0b-4843-4cf9-bc27-4faed750be05" returned: 0 in 0.349s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:57:07 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[266c8503-4cb2-42eb-a761-3ff6f8fd0041]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:57:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-da013e62-d44d-4610-b2cf-d3d8105d8c7c tempest-TestInstancesWithCinderVolumes-991430352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cc57d5d6-739d-459b-af23-9c272cedbecb {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:57:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-32ee55a9-ac22-4f3e-8798-2496bda64d7c tempest-SnapshotsActionsTest-1459299255 None] Lock "cinder-quobyte-510f9d0b-4843-4cf9-bc27-4faed750be05" released by "_delete_snapshot" :: held 1.848s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:57:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-32ee55a9-ac22-4f3e-8798-2496bda64d7c tempest-SnapshotsActionsTest-1459299255 None] Lock "cinder-quobyte-8d75c95f-01f2-414f-8315-ddd08b770213" released by "delete_snapshot" :: held 1.879s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:57:07 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-32ee55a9-ac22-4f3e-8798-2496bda64d7c tempest-SnapshotsActionsTest-1459299255 None] Created reservations ['3490f5be-39b4-4973-bfd3-40d2b593c756', '944210e6-9ec1-4822-9a71-3962ac2aec4b', 'e86db06c-52f1-4a34-9954-f9d4fe8d7186', 'f4f43f79-1b60-48d9-a1bf-03fd30d1b3f9'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:57:07 devstack sudo[100857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cc57d5d6-739d-459b-af23-9c272cedbecb Sep 28 11:57:07 devstack sudo[100857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:57:07 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-32ee55a9-ac22-4f3e-8798-2496bda64d7c tempest-SnapshotsActionsTest-1459299255 None] Delete snapshot completed successfully. Sep 28 11:57:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-32ee55a9-ac22-4f3e-8798-2496bda64d7c tempest-SnapshotsActionsTest-1459299255 None] Lock "cinder-510f9d0b-4843-4cf9-bc27-4faed750be05-delete_snapshot" released by "delete_snapshot" :: held 2.086s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:57:08 devstack sudo[100857]: pam_unix(sudo:session): session closed for user root Sep 28 11:57:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-da013e62-d44d-4610-b2cf-d3d8105d8c7c tempest-TestInstancesWithCinderVolumes-991430352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cc57d5d6-739d-459b-af23-9c272cedbecb" returned: 0 in 0.493s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:57:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-da013e62-d44d-4610-b2cf-d3d8105d8c7c tempest-TestInstancesWithCinderVolumes-991430352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cc57d5d6-739d-459b-af23-9c272cedbecb {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:57:08 devstack sudo[100862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cc57d5d6-739d-459b-af23-9c272cedbecb Sep 28 11:57:08 devstack sudo[100862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:57:08 devstack sudo[100862]: pam_unix(sudo:session): session closed for user root Sep 28 11:57:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-da013e62-d44d-4610-b2cf-d3d8105d8c7c tempest-TestInstancesWithCinderVolumes-991430352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cc57d5d6-739d-459b-af23-9c272cedbecb" returned: 0 in 0.304s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:57:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-da013e62-d44d-4610-b2cf-d3d8105d8c7c tempest-TestInstancesWithCinderVolumes-991430352 None] Lock "cinder-quobyte-cc57d5d6-739d-459b-af23-9c272cedbecb" released by "delete_volume" :: held 0.866s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:57:08 devstack cinder-volume[86916]: WARNING cinder.quota [None req-da013e62-d44d-4610-b2cf-d3d8105d8c7c tempest-TestInstancesWithCinderVolumes-991430352 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2046759599-1435281696 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2046759599-1435281696, it is now deprecated. Please use the default quota class for default quota. Sep 28 11:57:08 devstack cinder-volume[86916]: WARNING cinder.quota [None req-da013e62-d44d-4610-b2cf-d3d8105d8c7c tempest-TestInstancesWithCinderVolumes-991430352 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2046759599-1435281696 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2046759599-1435281696, it is now deprecated. Please use the default quota class for default quota. Sep 28 11:57:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8cc65eac-dd24-4b18-92d5-d71719d0f6ac tempest-SnapshotsActionsTest-236189319 None] Acquiring lock "cinder-aa8700e4-ffa3-4ab0-8b9c-c907b65c3372-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:57:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8cc65eac-dd24-4b18-92d5-d71719d0f6ac tempest-SnapshotsActionsTest-236189319 None] Lock "cinder-aa8700e4-ffa3-4ab0-8b9c-c907b65c3372-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:57:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8cc65eac-dd24-4b18-92d5-d71719d0f6ac tempest-SnapshotsActionsTest-236189319 None] Acquiring lock "cinder-quobyte-8d75c95f-01f2-414f-8315-ddd08b770213" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:57:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8cc65eac-dd24-4b18-92d5-d71719d0f6ac tempest-SnapshotsActionsTest-236189319 None] Lock "cinder-quobyte-8d75c95f-01f2-414f-8315-ddd08b770213" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:57:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8cc65eac-dd24-4b18-92d5-d71719d0f6ac tempest-SnapshotsActionsTest-236189319 None] Acquiring lock "cinder-quobyte-aa8700e4-ffa3-4ab0-8b9c-c907b65c3372" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:57:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8cc65eac-dd24-4b18-92d5-d71719d0f6ac tempest-SnapshotsActionsTest-236189319 None] Lock "cinder-quobyte-aa8700e4-ffa3-4ab0-8b9c-c907b65c3372" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:57:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-8cc65eac-dd24-4b18-92d5-d71719d0f6ac tempest-SnapshotsActionsTest-236189319 None] Deleting offline snapshot aa8700e4-ffa3-4ab0-8b9c-c907b65c3372 of volume 8d75c95f-01f2-414f-8315-ddd08b770213 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 11:57:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-8cc65eac-dd24-4b18-92d5-d71719d0f6ac tempest-SnapshotsActionsTest-236189319 None] snapshot_file for this snap is: volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 11:57:08 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5c592c-4824-4cd6-9f68-642bc9549f46]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:57:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8cc65eac-dd24-4b18-92d5-d71719d0f6ac tempest-SnapshotsActionsTest-236189319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:57:08 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-da013e62-d44d-4610-b2cf-d3d8105d8c7c tempest-TestInstancesWithCinderVolumes-991430352 None] Created reservations ['788cf410-7b1f-49fd-b6fc-95372279cca9', '21fa9ceb-8148-409e-9cb5-477417c3d203', 'c2d26b7f-a098-49c8-a22e-eb64dd86ef16', '33478b27-7159-48f3-8c28-4c7dea76f695'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:57:08 devstack sudo[100865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372 Sep 28 11:57:08 devstack sudo[100865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:57:09 devstack sudo[100865]: pam_unix(sudo:session): session closed for user root Sep 28 11:57:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8cc65eac-dd24-4b18-92d5-d71719d0f6ac tempest-SnapshotsActionsTest-236189319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372" returned: 0 in 0.367s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:57:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-8cc65eac-dd24-4b18-92d5-d71719d0f6ac tempest-SnapshotsActionsTest-236189319 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d75c95f-01f2-414f-8315-ddd08b770213(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 11:57:09 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[4225f532-5bdb-4b3a-a4e0-bedea7519797]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:57:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8cc65eac-dd24-4b18-92d5-d71719d0f6ac tempest-SnapshotsActionsTest-236189319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:57:09 devstack sudo[100870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213 Sep 28 11:57:09 devstack sudo[100870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:57:09 devstack sudo[100870]: pam_unix(sudo:session): session closed for user root Sep 28 11:57:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8cc65eac-dd24-4b18-92d5-d71719d0f6ac tempest-SnapshotsActionsTest-236189319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213" returned: 0 in 0.377s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:57:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8cc65eac-dd24-4b18-92d5-d71719d0f6ac tempest-SnapshotsActionsTest-236189319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:57:09 devstack sudo[100875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372 Sep 28 11:57:09 devstack sudo[100875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:57:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-da013e62-d44d-4610-b2cf-d3d8105d8c7c tempest-TestInstancesWithCinderVolumes-991430352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:57:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-da013e62-d44d-4610-b2cf-d3d8105d8c7c tempest-TestInstancesWithCinderVolumes-991430352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:57:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-da013e62-d44d-4610-b2cf-d3d8105d8c7c tempest-TestInstancesWithCinderVolumes-991430352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:57:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-da013e62-d44d-4610-b2cf-d3d8105d8c7c tempest-TestInstancesWithCinderVolumes-991430352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:57:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-da013e62-d44d-4610-b2cf-d3d8105d8c7c tempest-TestInstancesWithCinderVolumes-991430352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:57:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-da013e62-d44d-4610-b2cf-d3d8105d8c7c tempest-TestInstancesWithCinderVolumes-991430352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:57:09 devstack sudo[100875]: pam_unix(sudo:session): session closed for user root Sep 28 11:57:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8cc65eac-dd24-4b18-92d5-d71719d0f6ac tempest-SnapshotsActionsTest-236189319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372" returned: 0 in 0.352s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:57:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8cc65eac-dd24-4b18-92d5-d71719d0f6ac tempest-SnapshotsActionsTest-236189319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:57:09 devstack sudo[100881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:57:09 devstack sudo[100881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:57:09 devstack sudo[100882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372 Sep 28 11:57:09 devstack sudo[100882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:57:10 devstack sudo[100881]: pam_unix(sudo:session): session closed for user root Sep 28 11:57:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-da013e62-d44d-4610-b2cf-d3d8105d8c7c tempest-TestInstancesWithCinderVolumes-991430352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.284s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:57:10 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-da013e62-d44d-4610-b2cf-d3d8105d8c7c tempest-TestInstancesWithCinderVolumes-991430352 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:57:10 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-da013e62-d44d-4610-b2cf-d3d8105d8c7c tempest-TestInstancesWithCinderVolumes-991430352 None] Deleted volume successfully. Sep 28 11:57:10 devstack sudo[100882]: pam_unix(sudo:session): session closed for user root Sep 28 11:57:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8cc65eac-dd24-4b18-92d5-d71719d0f6ac tempest-SnapshotsActionsTest-236189319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213.aa8700e4-ffa3-4ab0-8b9c-c907b65c3372" returned: 0 in 0.280s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:57:10 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8cc65eac-dd24-4b18-92d5-d71719d0f6ac tempest-SnapshotsActionsTest-236189319 None] Lock "cinder-quobyte-aa8700e4-ffa3-4ab0-8b9c-c907b65c3372" released by "_delete_snapshot" :: held 1.501s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:57:10 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8cc65eac-dd24-4b18-92d5-d71719d0f6ac tempest-SnapshotsActionsTest-236189319 None] Lock "cinder-quobyte-8d75c95f-01f2-414f-8315-ddd08b770213" released by "delete_snapshot" :: held 1.522s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:57:10 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-da013e62-d44d-4610-b2cf-d3d8105d8c7c tempest-TestInstancesWithCinderVolumes-991430352 None] Lock "cinder-cc57d5d6-739d-459b-af23-9c272cedbecb-delete_volume" released by "delete_volume" :: held 2.883s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:57:10 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-8cc65eac-dd24-4b18-92d5-d71719d0f6ac tempest-SnapshotsActionsTest-236189319 None] Created reservations ['c2f3ebbc-04ad-42ec-b995-ef8b8b737ef3', '760b65cc-d6be-4afa-9705-fe7f4e3e69f4', '22e096b8-08ed-4c4d-a799-a881be02fcd3', 'ab1fcb08-1881-4fd7-9d15-7505eaea55f4'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:57:11 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-8cc65eac-dd24-4b18-92d5-d71719d0f6ac tempest-SnapshotsActionsTest-236189319 None] Delete snapshot completed successfully. Sep 28 11:57:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8cc65eac-dd24-4b18-92d5-d71719d0f6ac tempest-SnapshotsActionsTest-236189319 None] Lock "cinder-aa8700e4-ffa3-4ab0-8b9c-c907b65c3372-delete_snapshot" released by "delete_snapshot" :: held 2.430s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:57:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-15d01088-9b15-46d0-ba17-8c1b5dd1bbc2 tempest-SnapshotsActionsTest-236189319 None] Acquiring lock "cinder-8d75c95f-01f2-414f-8315-ddd08b770213-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:57:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-15d01088-9b15-46d0-ba17-8c1b5dd1bbc2 tempest-SnapshotsActionsTest-236189319 None] Lock "cinder-8d75c95f-01f2-414f-8315-ddd08b770213-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:57:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-15d01088-9b15-46d0-ba17-8c1b5dd1bbc2 tempest-SnapshotsActionsTest-236189319 None] Acquiring lock "cinder-quobyte-8d75c95f-01f2-414f-8315-ddd08b770213" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:57:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-15d01088-9b15-46d0-ba17-8c1b5dd1bbc2 tempest-SnapshotsActionsTest-236189319 None] Lock "cinder-quobyte-8d75c95f-01f2-414f-8315-ddd08b770213" acquired by "delete_volume" :: waited 0.021s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:57:12 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61351a5-0253-4a59-8874-c3704bd9e64e]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:57:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-15d01088-9b15-46d0-ba17-8c1b5dd1bbc2 tempest-SnapshotsActionsTest-236189319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:57:12 devstack sudo[100888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213 Sep 28 11:57:12 devstack sudo[100888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:57:12 devstack sudo[100888]: pam_unix(sudo:session): session closed for user root Sep 28 11:57:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-15d01088-9b15-46d0-ba17-8c1b5dd1bbc2 tempest-SnapshotsActionsTest-236189319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213" returned: 0 in 0.390s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:57:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-15d01088-9b15-46d0-ba17-8c1b5dd1bbc2 tempest-SnapshotsActionsTest-236189319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:57:12 devstack sudo[100893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213 Sep 28 11:57:12 devstack sudo[100893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:57:12 devstack sudo[100893]: pam_unix(sudo:session): session closed for user root Sep 28 11:57:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-15d01088-9b15-46d0-ba17-8c1b5dd1bbc2 tempest-SnapshotsActionsTest-236189319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8d75c95f-01f2-414f-8315-ddd08b770213" returned: 0 in 0.258s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:57:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-15d01088-9b15-46d0-ba17-8c1b5dd1bbc2 tempest-SnapshotsActionsTest-236189319 None] Lock "cinder-quobyte-8d75c95f-01f2-414f-8315-ddd08b770213" released by "delete_volume" :: held 0.724s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:57:13 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-15d01088-9b15-46d0-ba17-8c1b5dd1bbc2 tempest-SnapshotsActionsTest-236189319 None] Created reservations ['9031efaa-0227-4f3b-8866-74c24f7f882e', '4e4ddce9-c75e-4501-9ce8-0181425c2f79', '9d837ea2-f0b8-410a-9f04-6c9f23b34b64', '27512b98-2629-4a2e-a0c2-8c1938946c65'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:57:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-15d01088-9b15-46d0-ba17-8c1b5dd1bbc2 tempest-SnapshotsActionsTest-236189319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:57:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-15d01088-9b15-46d0-ba17-8c1b5dd1bbc2 tempest-SnapshotsActionsTest-236189319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:57:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-15d01088-9b15-46d0-ba17-8c1b5dd1bbc2 tempest-SnapshotsActionsTest-236189319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:57:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-15d01088-9b15-46d0-ba17-8c1b5dd1bbc2 tempest-SnapshotsActionsTest-236189319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:57:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-15d01088-9b15-46d0-ba17-8c1b5dd1bbc2 tempest-SnapshotsActionsTest-236189319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:57:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-15d01088-9b15-46d0-ba17-8c1b5dd1bbc2 tempest-SnapshotsActionsTest-236189319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:57:13 devstack sudo[100896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:57:13 devstack sudo[100896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:57:13 devstack sudo[100896]: pam_unix(sudo:session): session closed for user root Sep 28 11:57:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-15d01088-9b15-46d0-ba17-8c1b5dd1bbc2 tempest-SnapshotsActionsTest-236189319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.290s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:57:13 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-15d01088-9b15-46d0-ba17-8c1b5dd1bbc2 tempest-SnapshotsActionsTest-236189319 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:57:13 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-15d01088-9b15-46d0-ba17-8c1b5dd1bbc2 tempest-SnapshotsActionsTest-236189319 None] Deleted volume successfully. Sep 28 11:57:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-15d01088-9b15-46d0-ba17-8c1b5dd1bbc2 tempest-SnapshotsActionsTest-236189319 None] Lock "cinder-8d75c95f-01f2-414f-8315-ddd08b770213-delete_volume" released by "delete_volume" :: held 2.393s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:57:16 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-c9825e57-c304-477c-b097-344fd807feea req-7feded4a-4758-4614-8e1b-eaca55cc83fd tempest-TestInstancesWithCinderVolumes-991430352 None] Terminate volume connection completed successfully. Sep 28 11:57:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-c9825e57-c304-477c-b097-344fd807feea req-7feded4a-4758-4614-8e1b-eaca55cc83fd tempest-TestInstancesWithCinderVolumes-991430352 None] Deleting attachment 48439dfb-9844-4869-8db3-52787549b3cd. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 11:57:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b3190220-09fd-4d7a-8a4a-66e740f51c42 tempest-TestInstancesWithCinderVolumes-991430352 None] Acquiring lock "cinder-5cf9c6db-c02f-4740-b425-bcbd04bb5b8d-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:57:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b3190220-09fd-4d7a-8a4a-66e740f51c42 tempest-TestInstancesWithCinderVolumes-991430352 None] Lock "cinder-5cf9c6db-c02f-4740-b425-bcbd04bb5b8d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:57:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b3190220-09fd-4d7a-8a4a-66e740f51c42 tempest-TestInstancesWithCinderVolumes-991430352 None] Acquiring lock "cinder-quobyte-5cf9c6db-c02f-4740-b425-bcbd04bb5b8d" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:57:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b3190220-09fd-4d7a-8a4a-66e740f51c42 tempest-TestInstancesWithCinderVolumes-991430352 None] Lock "cinder-quobyte-5cf9c6db-c02f-4740-b425-bcbd04bb5b8d" acquired by "delete_volume" :: waited 0.029s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:57:17 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f079be-0aee-48d7-a722-19ee4a98715f]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:57:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b3190220-09fd-4d7a-8a4a-66e740f51c42 tempest-TestInstancesWithCinderVolumes-991430352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5cf9c6db-c02f-4740-b425-bcbd04bb5b8d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:57:17 devstack sudo[100935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5cf9c6db-c02f-4740-b425-bcbd04bb5b8d Sep 28 11:57:17 devstack sudo[100935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:57:18 devstack sudo[100935]: pam_unix(sudo:session): session closed for user root Sep 28 11:57:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b3190220-09fd-4d7a-8a4a-66e740f51c42 tempest-TestInstancesWithCinderVolumes-991430352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5cf9c6db-c02f-4740-b425-bcbd04bb5b8d" returned: 0 in 0.432s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:57:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b3190220-09fd-4d7a-8a4a-66e740f51c42 tempest-TestInstancesWithCinderVolumes-991430352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5cf9c6db-c02f-4740-b425-bcbd04bb5b8d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:57:18 devstack sudo[100940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5cf9c6db-c02f-4740-b425-bcbd04bb5b8d Sep 28 11:57:18 devstack sudo[100940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:57:18 devstack sudo[100940]: pam_unix(sudo:session): session closed for user root Sep 28 11:57:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b3190220-09fd-4d7a-8a4a-66e740f51c42 tempest-TestInstancesWithCinderVolumes-991430352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5cf9c6db-c02f-4740-b425-bcbd04bb5b8d" returned: 0 in 0.287s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:57:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b3190220-09fd-4d7a-8a4a-66e740f51c42 tempest-TestInstancesWithCinderVolumes-991430352 None] Lock "cinder-quobyte-5cf9c6db-c02f-4740-b425-bcbd04bb5b8d" released by "delete_volume" :: held 0.771s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:57:18 devstack cinder-volume[86916]: WARNING cinder.quota [None req-b3190220-09fd-4d7a-8a4a-66e740f51c42 tempest-TestInstancesWithCinderVolumes-991430352 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-301940702-220582048 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-301940702-220582048, it is now deprecated. Please use the default quota class for default quota. Sep 28 11:57:18 devstack cinder-volume[86916]: WARNING cinder.quota [None req-b3190220-09fd-4d7a-8a4a-66e740f51c42 tempest-TestInstancesWithCinderVolumes-991430352 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-301940702-220582048 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-301940702-220582048, it is now deprecated. Please use the default quota class for default quota. Sep 28 11:57:18 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-b3190220-09fd-4d7a-8a4a-66e740f51c42 tempest-TestInstancesWithCinderVolumes-991430352 None] Created reservations ['16bb95b2-8c57-43f7-a104-9a9dacaee456', '7eb888c5-34c0-4dc7-bd94-323adbafb5cb', '4ec3053d-4c5e-4003-aa53-1d95e58c67bd', '7d8354e0-1da0-4b21-9bba-eac2554972c0'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:57:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b3190220-09fd-4d7a-8a4a-66e740f51c42 tempest-TestInstancesWithCinderVolumes-991430352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:57:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b3190220-09fd-4d7a-8a4a-66e740f51c42 tempest-TestInstancesWithCinderVolumes-991430352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:57:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b3190220-09fd-4d7a-8a4a-66e740f51c42 tempest-TestInstancesWithCinderVolumes-991430352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:57:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b3190220-09fd-4d7a-8a4a-66e740f51c42 tempest-TestInstancesWithCinderVolumes-991430352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:57:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b3190220-09fd-4d7a-8a4a-66e740f51c42 tempest-TestInstancesWithCinderVolumes-991430352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:57:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b3190220-09fd-4d7a-8a4a-66e740f51c42 tempest-TestInstancesWithCinderVolumes-991430352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:57:18 devstack sudo[100943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:57:18 devstack sudo[100943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:57:18 devstack sudo[100943]: pam_unix(sudo:session): session closed for user root Sep 28 11:57:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b3190220-09fd-4d7a-8a4a-66e740f51c42 tempest-TestInstancesWithCinderVolumes-991430352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.321s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:57:18 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-b3190220-09fd-4d7a-8a4a-66e740f51c42 tempest-TestInstancesWithCinderVolumes-991430352 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:57:18 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b3190220-09fd-4d7a-8a4a-66e740f51c42 tempest-TestInstancesWithCinderVolumes-991430352 None] Deleted volume successfully. Sep 28 11:57:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b3190220-09fd-4d7a-8a4a-66e740f51c42 tempest-TestInstancesWithCinderVolumes-991430352 None] Lock "cinder-5cf9c6db-c02f-4740-b425-bcbd04bb5b8d-delete_volume" released by "delete_volume" :: held 1.353s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:57:28 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=105,cinder:INSERT=24,cinder:UPDATE=96,cinder:DELETE=9 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 11:57:28 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:UPDATE=99,cinder:SELECT=87,cinder:DELETE=5,cinder:INSERT=24 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 11:57:36 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbe72b3f-8328-4da8-b8ef-73fbd8765c04 tempest-VolumesTransfersTest-1075135647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:57:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bbe72b3f-8328-4da8-b8ef-73fbd8765c04 tempest-VolumesTransfersTest-1075135647 None] Flow 'volume_create_manager' (4dda85cf-1907-4890-a020-16c0c587b06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:57:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bbe72b3f-8328-4da8-b8ef-73fbd8765c04 tempest-VolumesTransfersTest-1075135647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbe1b10f-972f-4b0f-b5b4-a149515f99e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:57:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bbe72b3f-8328-4da8-b8ef-73fbd8765c04 tempest-VolumesTransfersTest-1075135647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbe1b10f-972f-4b0f-b5b4-a149515f99e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1951699339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32e648d7-42a2-40bc-b72f-902d5a92f548,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b906c211702949b7817f4dd4cae0503a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:57:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:57:36Z,use_quota=True,user_id='624ec1bb2a7042d698db672f65ea87ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:57:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bbe72b3f-8328-4da8-b8ef-73fbd8765c04 tempest-VolumesTransfersTest-1075135647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50bc7cb1-c994-48a8-abc8-66dcdfeab1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:57:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bbe72b3f-8328-4da8-b8ef-73fbd8765c04 tempest-VolumesTransfersTest-1075135647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50bc7cb1-c994-48a8-abc8-66dcdfeab1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:57:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bbe72b3f-8328-4da8-b8ef-73fbd8765c04 tempest-VolumesTransfersTest-1075135647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e01e40c7-6b42-491a-9524-f6447c0166a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:57:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bbe72b3f-8328-4da8-b8ef-73fbd8765c04 tempest-VolumesTransfersTest-1075135647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e01e40c7-6b42-491a-9524-f6447c0166a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32e648d7-42a2-40bc-b72f-902d5a92f548', 'volume_name': 'volume-32e648d7-42a2-40bc-b72f-902d5a92f548', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:57:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bbe72b3f-8328-4da8-b8ef-73fbd8765c04 tempest-VolumesTransfersTest-1075135647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d794156-d366-4885-9f13-8fc05f5a8ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:57:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bbe72b3f-8328-4da8-b8ef-73fbd8765c04 tempest-VolumesTransfersTest-1075135647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d794156-d366-4885-9f13-8fc05f5a8ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:57:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bbe72b3f-8328-4da8-b8ef-73fbd8765c04 tempest-VolumesTransfersTest-1075135647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b5b3eca-784f-4e2b-aca7-47ef7d37af99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:57:36 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-bbe72b3f-8328-4da8-b8ef-73fbd8765c04 tempest-VolumesTransfersTest-1075135647 None] Volume 32e648d7-42a2-40bc-b72f-902d5a92f548: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32e648d7-42a2-40bc-b72f-902d5a92f548', 'volume_size': 1} Sep 28 11:57:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bbe72b3f-8328-4da8-b8ef-73fbd8765c04 tempest-VolumesTransfersTest-1075135647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:57:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bbe72b3f-8328-4da8-b8ef-73fbd8765c04 tempest-VolumesTransfersTest-1075135647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:57:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bbe72b3f-8328-4da8-b8ef-73fbd8765c04 tempest-VolumesTransfersTest-1075135647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1951699339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32e648d7-42a2-40bc-b72f-902d5a92f548,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b906c211702949b7817f4dd4cae0503a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:57:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:57:36Z,use_quota=True,user_id='624ec1bb2a7042d698db672f65ea87ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:57:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-bbe72b3f-8328-4da8-b8ef-73fbd8765c04 tempest-VolumesTransfersTest-1075135647 None] Creating volume 32e648d7-42a2-40bc-b72f-902d5a92f548 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:57:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bbe72b3f-8328-4da8-b8ef-73fbd8765c04 tempest-VolumesTransfersTest-1075135647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:57:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bbe72b3f-8328-4da8-b8ef-73fbd8765c04 tempest-VolumesTransfersTest-1075135647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:57:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bbe72b3f-8328-4da8-b8ef-73fbd8765c04 tempest-VolumesTransfersTest-1075135647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:57:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bbe72b3f-8328-4da8-b8ef-73fbd8765c04 tempest-VolumesTransfersTest-1075135647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:57:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bbe72b3f-8328-4da8-b8ef-73fbd8765c04 tempest-VolumesTransfersTest-1075135647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:57:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bbe72b3f-8328-4da8-b8ef-73fbd8765c04 tempest-VolumesTransfersTest-1075135647 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:57:36 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-bbe72b3f-8328-4da8-b8ef-73fbd8765c04 tempest-VolumesTransfersTest-1075135647 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:57:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bbe72b3f-8328-4da8-b8ef-73fbd8765c04 tempest-VolumesTransfersTest-1075135647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-32e648d7-42a2-40bc-b72f-902d5a92f548 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:57:36 devstack sudo[100955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-32e648d7-42a2-40bc-b72f-902d5a92f548 1073741824 Sep 28 11:57:36 devstack sudo[100955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:57:36 devstack sudo[100955]: pam_unix(sudo:session): session closed for user root Sep 28 11:57:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bbe72b3f-8328-4da8-b8ef-73fbd8765c04 tempest-VolumesTransfersTest-1075135647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-32e648d7-42a2-40bc-b72f-902d5a92f548 1073741824" returned: 0 in 0.569s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:57:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bbe72b3f-8328-4da8-b8ef-73fbd8765c04 tempest-VolumesTransfersTest-1075135647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-32e648d7-42a2-40bc-b72f-902d5a92f548 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:57:37 devstack sudo[100961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-32e648d7-42a2-40bc-b72f-902d5a92f548 Sep 28 11:57:37 devstack sudo[100961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:57:37 devstack sudo[100961]: pam_unix(sudo:session): session closed for user root Sep 28 11:57:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bbe72b3f-8328-4da8-b8ef-73fbd8765c04 tempest-VolumesTransfersTest-1075135647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-32e648d7-42a2-40bc-b72f-902d5a92f548" returned: 0 in 0.314s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:57:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bbe72b3f-8328-4da8-b8ef-73fbd8765c04 tempest-VolumesTransfersTest-1075135647 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:57:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bbe72b3f-8328-4da8-b8ef-73fbd8765c04 tempest-VolumesTransfersTest-1075135647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:57:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bbe72b3f-8328-4da8-b8ef-73fbd8765c04 tempest-VolumesTransfersTest-1075135647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b5b3eca-784f-4e2b-aca7-47ef7d37af99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32e648d7-42a2-40bc-b72f-902d5a92f548', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:57:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bbe72b3f-8328-4da8-b8ef-73fbd8765c04 tempest-VolumesTransfersTest-1075135647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5935d9b0-d6c8-4f10-a854-308fb45497d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:57:37 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-bbe72b3f-8328-4da8-b8ef-73fbd8765c04 tempest-VolumesTransfersTest-1075135647 None] Volume volume-32e648d7-42a2-40bc-b72f-902d5a92f548 (32e648d7-42a2-40bc-b72f-902d5a92f548): created successfully Sep 28 11:57:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bbe72b3f-8328-4da8-b8ef-73fbd8765c04 tempest-VolumesTransfersTest-1075135647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5935d9b0-d6c8-4f10-a854-308fb45497d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:57:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bbe72b3f-8328-4da8-b8ef-73fbd8765c04 tempest-VolumesTransfersTest-1075135647 None] Flow 'volume_create_manager' (4dda85cf-1907-4890-a020-16c0c587b06f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:57:37 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-bbe72b3f-8328-4da8-b8ef-73fbd8765c04 tempest-VolumesTransfersTest-1075135647 None] Created volume successfully. Sep 28 11:57:38 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 11:57:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:57:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:57:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:57:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:57:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:57:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:57:38 devstack sudo[100964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:57:38 devstack sudo[100964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:57:38 devstack sudo[100964]: pam_unix(sudo:session): session closed for user root Sep 28 11:57:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.350s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:57:38 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:57:39 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 11:57:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] thread count: 28 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 11:57:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] thread info: [<_MainThread(MainThread, started 135408582168704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 11:57:39 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e7e1d5f6-8a4b-461c-be2b-7368bce77dda tempest-VolumesTransfersTest-1814241869 None] Transfer volume completed successfully. Sep 28 11:57:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a9b854f3-7efa-4c9f-85f3-baeeebfdef8c tempest-VolumesTransfersTest-2010728293 None] Acquiring lock "cinder-32e648d7-42a2-40bc-b72f-902d5a92f548-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:57:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a9b854f3-7efa-4c9f-85f3-baeeebfdef8c tempest-VolumesTransfersTest-2010728293 None] Lock "cinder-32e648d7-42a2-40bc-b72f-902d5a92f548-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:57:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a9b854f3-7efa-4c9f-85f3-baeeebfdef8c tempest-VolumesTransfersTest-2010728293 None] Acquiring lock "cinder-quobyte-32e648d7-42a2-40bc-b72f-902d5a92f548" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:57:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a9b854f3-7efa-4c9f-85f3-baeeebfdef8c tempest-VolumesTransfersTest-2010728293 None] Lock "cinder-quobyte-32e648d7-42a2-40bc-b72f-902d5a92f548" acquired by "delete_volume" :: waited 0.021s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:57:40 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b35673c-36b9-45e8-b334-05b830b9af15]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:57:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a9b854f3-7efa-4c9f-85f3-baeeebfdef8c tempest-VolumesTransfersTest-2010728293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-32e648d7-42a2-40bc-b72f-902d5a92f548 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:57:40 devstack sudo[100968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-32e648d7-42a2-40bc-b72f-902d5a92f548 Sep 28 11:57:40 devstack sudo[100968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:57:40 devstack sudo[100968]: pam_unix(sudo:session): session closed for user root Sep 28 11:57:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a9b854f3-7efa-4c9f-85f3-baeeebfdef8c tempest-VolumesTransfersTest-2010728293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-32e648d7-42a2-40bc-b72f-902d5a92f548" returned: 0 in 0.414s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:57:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a9b854f3-7efa-4c9f-85f3-baeeebfdef8c tempest-VolumesTransfersTest-2010728293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-32e648d7-42a2-40bc-b72f-902d5a92f548 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:57:40 devstack sudo[100973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-32e648d7-42a2-40bc-b72f-902d5a92f548 Sep 28 11:57:40 devstack sudo[100973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:57:40 devstack sudo[100973]: pam_unix(sudo:session): session closed for user root Sep 28 11:57:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a9b854f3-7efa-4c9f-85f3-baeeebfdef8c tempest-VolumesTransfersTest-2010728293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-32e648d7-42a2-40bc-b72f-902d5a92f548" returned: 0 in 0.284s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:57:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a9b854f3-7efa-4c9f-85f3-baeeebfdef8c tempest-VolumesTransfersTest-2010728293 None] Lock "cinder-quobyte-32e648d7-42a2-40bc-b72f-902d5a92f548" released by "delete_volume" :: held 0.762s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:57:41 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-a9b854f3-7efa-4c9f-85f3-baeeebfdef8c tempest-VolumesTransfersTest-2010728293 None] Created reservations ['860f3662-7265-4adc-a633-3e2e9574e136', '4fb03135-7939-4806-9c04-9de6927906b9', '544e80cf-f9fa-4250-b886-0a006c62e4fd', '0a3a66bc-b9c6-4ee9-be4b-a928c19a28a0'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:57:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a9b854f3-7efa-4c9f-85f3-baeeebfdef8c tempest-VolumesTransfersTest-2010728293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:57:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a9b854f3-7efa-4c9f-85f3-baeeebfdef8c tempest-VolumesTransfersTest-2010728293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:57:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a9b854f3-7efa-4c9f-85f3-baeeebfdef8c tempest-VolumesTransfersTest-2010728293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:57:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a9b854f3-7efa-4c9f-85f3-baeeebfdef8c tempest-VolumesTransfersTest-2010728293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:57:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a9b854f3-7efa-4c9f-85f3-baeeebfdef8c tempest-VolumesTransfersTest-2010728293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:57:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a9b854f3-7efa-4c9f-85f3-baeeebfdef8c tempest-VolumesTransfersTest-2010728293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:57:41 devstack sudo[100976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:57:41 devstack sudo[100976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:57:41 devstack sudo[100976]: pam_unix(sudo:session): session closed for user root Sep 28 11:57:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a9b854f3-7efa-4c9f-85f3-baeeebfdef8c tempest-VolumesTransfersTest-2010728293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.323s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:57:41 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a9b854f3-7efa-4c9f-85f3-baeeebfdef8c tempest-VolumesTransfersTest-2010728293 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:57:41 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-a9b854f3-7efa-4c9f-85f3-baeeebfdef8c tempest-VolumesTransfersTest-2010728293 None] Deleted volume successfully. Sep 28 11:57:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a9b854f3-7efa-4c9f-85f3-baeeebfdef8c tempest-VolumesTransfersTest-2010728293 None] Lock "cinder-32e648d7-42a2-40bc-b72f-902d5a92f548-delete_volume" released by "delete_volume" :: held 1.399s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:57:41 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e28358f-7edf-422c-863d-9340b02511eb tempest-VolumesTransfersTest-1075135647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:57:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6e28358f-7edf-422c-863d-9340b02511eb tempest-VolumesTransfersTest-1075135647 None] Flow 'volume_create_manager' (b2ce4959-4fa4-4447-a020-6b9583f69013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:57:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6e28358f-7edf-422c-863d-9340b02511eb tempest-VolumesTransfersTest-1075135647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e513f8b-93be-40ba-931c-58e86af34c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:57:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6e28358f-7edf-422c-863d-9340b02511eb tempest-VolumesTransfersTest-1075135647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e513f8b-93be-40ba-931c-58e86af34c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:57:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1407036493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a39224d4-5154-430a-807d-5d424b07cb2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b906c211702949b7817f4dd4cae0503a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:57:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:57:42Z,use_quota=True,user_id='624ec1bb2a7042d698db672f65ea87ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:57:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6e28358f-7edf-422c-863d-9340b02511eb tempest-VolumesTransfersTest-1075135647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b206dd8e-c8e6-4504-84b3-72d4305ac384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:57:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6e28358f-7edf-422c-863d-9340b02511eb tempest-VolumesTransfersTest-1075135647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b206dd8e-c8e6-4504-84b3-72d4305ac384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:57:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6e28358f-7edf-422c-863d-9340b02511eb tempest-VolumesTransfersTest-1075135647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fc845d5-dcf8-4219-b6db-003a95f99a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:57:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6e28358f-7edf-422c-863d-9340b02511eb tempest-VolumesTransfersTest-1075135647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fc845d5-dcf8-4219-b6db-003a95f99a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a39224d4-5154-430a-807d-5d424b07cb2d', 'volume_name': 'volume-a39224d4-5154-430a-807d-5d424b07cb2d', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:57:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6e28358f-7edf-422c-863d-9340b02511eb tempest-VolumesTransfersTest-1075135647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be631029-6ac0-417f-853c-6cb0c0805dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:57:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6e28358f-7edf-422c-863d-9340b02511eb tempest-VolumesTransfersTest-1075135647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be631029-6ac0-417f-853c-6cb0c0805dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:57:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6e28358f-7edf-422c-863d-9340b02511eb tempest-VolumesTransfersTest-1075135647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a8abcc4-ac56-40fe-9a87-b4b7e6aa7201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:57:42 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-6e28358f-7edf-422c-863d-9340b02511eb tempest-VolumesTransfersTest-1075135647 None] Volume a39224d4-5154-430a-807d-5d424b07cb2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a39224d4-5154-430a-807d-5d424b07cb2d', 'volume_size': 1} Sep 28 11:57:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6e28358f-7edf-422c-863d-9340b02511eb tempest-VolumesTransfersTest-1075135647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:57:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6e28358f-7edf-422c-863d-9340b02511eb tempest-VolumesTransfersTest-1075135647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:57:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6e28358f-7edf-422c-863d-9340b02511eb tempest-VolumesTransfersTest-1075135647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:57:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1407036493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a39224d4-5154-430a-807d-5d424b07cb2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b906c211702949b7817f4dd4cae0503a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:57:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:57:42Z,use_quota=True,user_id='624ec1bb2a7042d698db672f65ea87ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:57:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-6e28358f-7edf-422c-863d-9340b02511eb tempest-VolumesTransfersTest-1075135647 None] Creating volume a39224d4-5154-430a-807d-5d424b07cb2d {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:57:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6e28358f-7edf-422c-863d-9340b02511eb tempest-VolumesTransfersTest-1075135647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:57:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6e28358f-7edf-422c-863d-9340b02511eb tempest-VolumesTransfersTest-1075135647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:57:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6e28358f-7edf-422c-863d-9340b02511eb tempest-VolumesTransfersTest-1075135647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:57:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6e28358f-7edf-422c-863d-9340b02511eb tempest-VolumesTransfersTest-1075135647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:57:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6e28358f-7edf-422c-863d-9340b02511eb tempest-VolumesTransfersTest-1075135647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:57:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6e28358f-7edf-422c-863d-9340b02511eb tempest-VolumesTransfersTest-1075135647 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:57:42 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-6e28358f-7edf-422c-863d-9340b02511eb tempest-VolumesTransfersTest-1075135647 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:57:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6e28358f-7edf-422c-863d-9340b02511eb tempest-VolumesTransfersTest-1075135647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a39224d4-5154-430a-807d-5d424b07cb2d 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:57:42 devstack sudo[100979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a39224d4-5154-430a-807d-5d424b07cb2d 1073741824 Sep 28 11:57:42 devstack sudo[100979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:57:42 devstack sudo[100979]: pam_unix(sudo:session): session closed for user root Sep 28 11:57:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6e28358f-7edf-422c-863d-9340b02511eb tempest-VolumesTransfersTest-1075135647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a39224d4-5154-430a-807d-5d424b07cb2d 1073741824" returned: 0 in 0.556s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:57:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6e28358f-7edf-422c-863d-9340b02511eb tempest-VolumesTransfersTest-1075135647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a39224d4-5154-430a-807d-5d424b07cb2d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:57:42 devstack sudo[100985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a39224d4-5154-430a-807d-5d424b07cb2d Sep 28 11:57:42 devstack sudo[100985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:57:43 devstack sudo[100985]: pam_unix(sudo:session): session closed for user root Sep 28 11:57:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6e28358f-7edf-422c-863d-9340b02511eb tempest-VolumesTransfersTest-1075135647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a39224d4-5154-430a-807d-5d424b07cb2d" returned: 0 in 0.349s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:57:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6e28358f-7edf-422c-863d-9340b02511eb tempest-VolumesTransfersTest-1075135647 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:57:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6e28358f-7edf-422c-863d-9340b02511eb tempest-VolumesTransfersTest-1075135647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:57:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6e28358f-7edf-422c-863d-9340b02511eb tempest-VolumesTransfersTest-1075135647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a8abcc4-ac56-40fe-9a87-b4b7e6aa7201) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a39224d4-5154-430a-807d-5d424b07cb2d', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:57:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6e28358f-7edf-422c-863d-9340b02511eb tempest-VolumesTransfersTest-1075135647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (010f7540-aece-4c13-86f0-2805e81027c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:57:43 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-6e28358f-7edf-422c-863d-9340b02511eb tempest-VolumesTransfersTest-1075135647 None] Volume volume-a39224d4-5154-430a-807d-5d424b07cb2d (a39224d4-5154-430a-807d-5d424b07cb2d): created successfully Sep 28 11:57:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6e28358f-7edf-422c-863d-9340b02511eb tempest-VolumesTransfersTest-1075135647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (010f7540-aece-4c13-86f0-2805e81027c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:57:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6e28358f-7edf-422c-863d-9340b02511eb tempest-VolumesTransfersTest-1075135647 None] Flow 'volume_create_manager' (b2ce4959-4fa4-4447-a020-6b9583f69013) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:57:43 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-6e28358f-7edf-422c-863d-9340b02511eb tempest-VolumesTransfersTest-1075135647 None] Created volume successfully. Sep 28 11:57:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3f11abc9-b5cf-4255-90d1-687e8c0791f6 tempest-VolumesTransfersTest-2010728293 None] Acquiring lock "cinder-a39224d4-5154-430a-807d-5d424b07cb2d-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:57:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3f11abc9-b5cf-4255-90d1-687e8c0791f6 tempest-VolumesTransfersTest-2010728293 None] Lock "cinder-a39224d4-5154-430a-807d-5d424b07cb2d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:57:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3f11abc9-b5cf-4255-90d1-687e8c0791f6 tempest-VolumesTransfersTest-2010728293 None] Acquiring lock "cinder-quobyte-a39224d4-5154-430a-807d-5d424b07cb2d" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:57:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3f11abc9-b5cf-4255-90d1-687e8c0791f6 tempest-VolumesTransfersTest-2010728293 None] Lock "cinder-quobyte-a39224d4-5154-430a-807d-5d424b07cb2d" acquired by "delete_volume" :: waited 0.024s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:57:44 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[1934ca9f-4b48-4da0-b2c6-744a1f9e96c8]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:57:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3f11abc9-b5cf-4255-90d1-687e8c0791f6 tempest-VolumesTransfersTest-2010728293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a39224d4-5154-430a-807d-5d424b07cb2d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:57:44 devstack sudo[100991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a39224d4-5154-430a-807d-5d424b07cb2d Sep 28 11:57:44 devstack sudo[100991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:57:45 devstack sudo[100991]: pam_unix(sudo:session): session closed for user root Sep 28 11:57:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3f11abc9-b5cf-4255-90d1-687e8c0791f6 tempest-VolumesTransfersTest-2010728293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a39224d4-5154-430a-807d-5d424b07cb2d" returned: 0 in 0.632s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:57:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3f11abc9-b5cf-4255-90d1-687e8c0791f6 tempest-VolumesTransfersTest-2010728293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a39224d4-5154-430a-807d-5d424b07cb2d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:57:45 devstack sudo[100997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a39224d4-5154-430a-807d-5d424b07cb2d Sep 28 11:57:45 devstack sudo[100997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:57:45 devstack sudo[100997]: pam_unix(sudo:session): session closed for user root Sep 28 11:57:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3f11abc9-b5cf-4255-90d1-687e8c0791f6 tempest-VolumesTransfersTest-2010728293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a39224d4-5154-430a-807d-5d424b07cb2d" returned: 0 in 0.304s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:57:45 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3f11abc9-b5cf-4255-90d1-687e8c0791f6 tempest-VolumesTransfersTest-2010728293 None] Lock "cinder-quobyte-a39224d4-5154-430a-807d-5d424b07cb2d" released by "delete_volume" :: held 1.062s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:57:45 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-3f11abc9-b5cf-4255-90d1-687e8c0791f6 tempest-VolumesTransfersTest-2010728293 None] Created reservations ['eb9d8ed3-7c80-44e7-9449-0f1c1fa41ae6', '981a09fd-5e71-49df-b090-92a174093030', 'd6416fcc-db74-4b40-8f37-d1a78703584e', '8210822d-3319-4901-82b6-a16273bd2f5b'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:57:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3f11abc9-b5cf-4255-90d1-687e8c0791f6 tempest-VolumesTransfersTest-2010728293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:57:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3f11abc9-b5cf-4255-90d1-687e8c0791f6 tempest-VolumesTransfersTest-2010728293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:57:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3f11abc9-b5cf-4255-90d1-687e8c0791f6 tempest-VolumesTransfersTest-2010728293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:57:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3f11abc9-b5cf-4255-90d1-687e8c0791f6 tempest-VolumesTransfersTest-2010728293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:57:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3f11abc9-b5cf-4255-90d1-687e8c0791f6 tempest-VolumesTransfersTest-2010728293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:57:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3f11abc9-b5cf-4255-90d1-687e8c0791f6 tempest-VolumesTransfersTest-2010728293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:57:45 devstack sudo[101000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:57:45 devstack sudo[101000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:57:46 devstack sudo[101000]: pam_unix(sudo:session): session closed for user root Sep 28 11:57:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3f11abc9-b5cf-4255-90d1-687e8c0791f6 tempest-VolumesTransfersTest-2010728293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.342s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:57:46 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-3f11abc9-b5cf-4255-90d1-687e8c0791f6 tempest-VolumesTransfersTest-2010728293 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:57:46 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-3f11abc9-b5cf-4255-90d1-687e8c0791f6 tempest-VolumesTransfersTest-2010728293 None] Deleted volume successfully. Sep 28 11:57:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3f11abc9-b5cf-4255-90d1-687e8c0791f6 tempest-VolumesTransfersTest-2010728293 None] Lock "cinder-a39224d4-5154-430a-807d-5d424b07cb2d-delete_volume" released by "delete_volume" :: held 1.761s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:57:55 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-37976c0b-59b4-449e-bfc5-5834e8eabc9c tempest-VolumesActionsTest-649771008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:57:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-37976c0b-59b4-449e-bfc5-5834e8eabc9c tempest-VolumesActionsTest-649771008 None] Flow 'volume_create_manager' (6b88ceec-33c3-46cc-af53-8d111d265568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:57:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-37976c0b-59b4-449e-bfc5-5834e8eabc9c tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0266bf4d-eab0-48b0-9725-11480b6d0303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:57:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-37976c0b-59b4-449e-bfc5-5834e8eabc9c tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0266bf4d-eab0-48b0-9725-11480b6d0303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:57:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1840021033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b222fce-a9ef-43ab-93f7-f0f9ac3709af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2a0e61cc2154702be4628e75f3c318f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:57:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:57:55Z,use_quota=True,user_id='dcd554c777564045a38816562cd3a7f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:57:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-37976c0b-59b4-449e-bfc5-5834e8eabc9c tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f40b104a-222a-4ef6-8a02-1c256100a226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:57:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-37976c0b-59b4-449e-bfc5-5834e8eabc9c tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f40b104a-222a-4ef6-8a02-1c256100a226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:57:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-37976c0b-59b4-449e-bfc5-5834e8eabc9c tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f75d67b2-106e-440d-ac99-4c1006c0ed23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:57:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-37976c0b-59b4-449e-bfc5-5834e8eabc9c tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f75d67b2-106e-440d-ac99-4c1006c0ed23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b222fce-a9ef-43ab-93f7-f0f9ac3709af', 'volume_name': 'volume-5b222fce-a9ef-43ab-93f7-f0f9ac3709af', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:57:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-37976c0b-59b4-449e-bfc5-5834e8eabc9c tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8f6e546-4393-48be-984a-76805b1a5026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:57:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-37976c0b-59b4-449e-bfc5-5834e8eabc9c tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8f6e546-4393-48be-984a-76805b1a5026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:57:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-37976c0b-59b4-449e-bfc5-5834e8eabc9c tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a00190af-afb9-4cd4-aa89-890e9b83223a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:57:55 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-37976c0b-59b4-449e-bfc5-5834e8eabc9c tempest-VolumesActionsTest-649771008 None] Volume 5b222fce-a9ef-43ab-93f7-f0f9ac3709af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b222fce-a9ef-43ab-93f7-f0f9ac3709af', 'volume_size': 1} Sep 28 11:57:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-37976c0b-59b4-449e-bfc5-5834e8eabc9c tempest-VolumesActionsTest-649771008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:57:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-37976c0b-59b4-449e-bfc5-5834e8eabc9c tempest-VolumesActionsTest-649771008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:57:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-37976c0b-59b4-449e-bfc5-5834e8eabc9c tempest-VolumesActionsTest-649771008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:57:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1840021033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b222fce-a9ef-43ab-93f7-f0f9ac3709af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2a0e61cc2154702be4628e75f3c318f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:57:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:57:55Z,use_quota=True,user_id='dcd554c777564045a38816562cd3a7f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:57:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-37976c0b-59b4-449e-bfc5-5834e8eabc9c tempest-VolumesActionsTest-649771008 None] Creating volume 5b222fce-a9ef-43ab-93f7-f0f9ac3709af {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:57:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-37976c0b-59b4-449e-bfc5-5834e8eabc9c tempest-VolumesActionsTest-649771008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:57:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-37976c0b-59b4-449e-bfc5-5834e8eabc9c tempest-VolumesActionsTest-649771008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:57:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-37976c0b-59b4-449e-bfc5-5834e8eabc9c tempest-VolumesActionsTest-649771008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:57:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-37976c0b-59b4-449e-bfc5-5834e8eabc9c tempest-VolumesActionsTest-649771008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:57:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-37976c0b-59b4-449e-bfc5-5834e8eabc9c tempest-VolumesActionsTest-649771008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:57:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-37976c0b-59b4-449e-bfc5-5834e8eabc9c tempest-VolumesActionsTest-649771008 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:57:55 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-37976c0b-59b4-449e-bfc5-5834e8eabc9c tempest-VolumesActionsTest-649771008 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:57:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-37976c0b-59b4-449e-bfc5-5834e8eabc9c tempest-VolumesActionsTest-649771008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5b222fce-a9ef-43ab-93f7-f0f9ac3709af 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:57:55 devstack sudo[101105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5b222fce-a9ef-43ab-93f7-f0f9ac3709af 1073741824 Sep 28 11:57:55 devstack sudo[101105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:57:56 devstack sudo[101105]: pam_unix(sudo:session): session closed for user root Sep 28 11:57:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-37976c0b-59b4-449e-bfc5-5834e8eabc9c tempest-VolumesActionsTest-649771008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5b222fce-a9ef-43ab-93f7-f0f9ac3709af 1073741824" returned: 0 in 0.650s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:57:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-37976c0b-59b4-449e-bfc5-5834e8eabc9c tempest-VolumesActionsTest-649771008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5b222fce-a9ef-43ab-93f7-f0f9ac3709af {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:57:56 devstack sudo[101113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5b222fce-a9ef-43ab-93f7-f0f9ac3709af Sep 28 11:57:56 devstack sudo[101113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:57:56 devstack sudo[101113]: pam_unix(sudo:session): session closed for user root Sep 28 11:57:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-37976c0b-59b4-449e-bfc5-5834e8eabc9c tempest-VolumesActionsTest-649771008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5b222fce-a9ef-43ab-93f7-f0f9ac3709af" returned: 0 in 0.499s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:57:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-37976c0b-59b4-449e-bfc5-5834e8eabc9c tempest-VolumesActionsTest-649771008 None] <== create_volume: return (1213ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:57:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-37976c0b-59b4-449e-bfc5-5834e8eabc9c tempest-VolumesActionsTest-649771008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:57:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-37976c0b-59b4-449e-bfc5-5834e8eabc9c tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a00190af-afb9-4cd4-aa89-890e9b83223a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b222fce-a9ef-43ab-93f7-f0f9ac3709af', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:57:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-37976c0b-59b4-449e-bfc5-5834e8eabc9c tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e941b25-e17b-47d2-9396-85178898c468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:57:56 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-37976c0b-59b4-449e-bfc5-5834e8eabc9c tempest-VolumesActionsTest-649771008 None] Volume volume-5b222fce-a9ef-43ab-93f7-f0f9ac3709af (5b222fce-a9ef-43ab-93f7-f0f9ac3709af): created successfully Sep 28 11:57:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-37976c0b-59b4-449e-bfc5-5834e8eabc9c tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e941b25-e17b-47d2-9396-85178898c468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:57:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-37976c0b-59b4-449e-bfc5-5834e8eabc9c tempest-VolumesActionsTest-649771008 None] Flow 'volume_create_manager' (6b88ceec-33c3-46cc-af53-8d111d265568) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:57:56 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-37976c0b-59b4-449e-bfc5-5834e8eabc9c tempest-VolumesActionsTest-649771008 None] Created volume successfully. Sep 28 11:57:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8dc0ab1f-7c4a-4831-9605-0d9671149b16 tempest-VolumesActionsTest-649771008 None] Acquiring lock "cinder-5b222fce-a9ef-43ab-93f7-f0f9ac3709af" by "attach_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:57:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8dc0ab1f-7c4a-4831-9605-0d9671149b16 tempest-VolumesActionsTest-649771008 None] Lock "cinder-5b222fce-a9ef-43ab-93f7-f0f9ac3709af" acquired by "attach_volume" :: waited 0.023s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:57:57 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-8dc0ab1f-7c4a-4831-9605-0d9671149b16 tempest-VolumesActionsTest-649771008 None] Attaching volume 5b222fce-a9ef-43ab-93f7-f0f9ac3709af to instance f79f4b55-d86b-4635-9ce7-a63be4edd8d8 at mountpoint /dev/vdb on host None. Sep 28 11:57:57 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-8dc0ab1f-7c4a-4831-9605-0d9671149b16 tempest-VolumesActionsTest-649771008 None] Attach volume completed successfully. Sep 28 11:57:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8dc0ab1f-7c4a-4831-9605-0d9671149b16 tempest-VolumesActionsTest-649771008 None] Lock "cinder-5b222fce-a9ef-43ab-93f7-f0f9ac3709af" released by "attach_volume" :: held 0.122s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:57:58 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-76f0b266-ebb7-4cef-b360-9b3bebce590e tempest-VolumesTransfersV355Test-331631471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:57:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-76f0b266-ebb7-4cef-b360-9b3bebce590e tempest-VolumesTransfersV355Test-331631471 None] Flow 'volume_create_manager' (b5a0efde-2f6d-4aa9-827d-d22a4054e601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:57:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-76f0b266-ebb7-4cef-b360-9b3bebce590e tempest-VolumesTransfersV355Test-331631471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd99b48c-2f83-42ca-9735-0dad9ad57f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:57:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-76f0b266-ebb7-4cef-b360-9b3bebce590e tempest-VolumesTransfersV355Test-331631471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd99b48c-2f83-42ca-9735-0dad9ad57f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1770452259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd069727-cd38-4d8f-ad5b-98bf793baea5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a29a531ae9c4d979eeb5df4865fd70c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:57:58Z,use_quota=True,user_id='a4e8e2d2e8fa4cfd8fcb2f5c3b8b88c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:57:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-76f0b266-ebb7-4cef-b360-9b3bebce590e tempest-VolumesTransfersV355Test-331631471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eedd8087-5194-4626-a1bf-c3fbf9351859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:57:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-76f0b266-ebb7-4cef-b360-9b3bebce590e tempest-VolumesTransfersV355Test-331631471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eedd8087-5194-4626-a1bf-c3fbf9351859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:57:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-76f0b266-ebb7-4cef-b360-9b3bebce590e tempest-VolumesTransfersV355Test-331631471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99165c48-0efc-4060-a2f5-0edd43e7ddc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:57:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-76f0b266-ebb7-4cef-b360-9b3bebce590e tempest-VolumesTransfersV355Test-331631471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99165c48-0efc-4060-a2f5-0edd43e7ddc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd069727-cd38-4d8f-ad5b-98bf793baea5', 'volume_name': 'volume-bd069727-cd38-4d8f-ad5b-98bf793baea5', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:57:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-76f0b266-ebb7-4cef-b360-9b3bebce590e tempest-VolumesTransfersV355Test-331631471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (244245ee-b1cc-4d05-a161-372a1d728232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:57:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-76f0b266-ebb7-4cef-b360-9b3bebce590e tempest-VolumesTransfersV355Test-331631471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (244245ee-b1cc-4d05-a161-372a1d728232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:57:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-76f0b266-ebb7-4cef-b360-9b3bebce590e tempest-VolumesTransfersV355Test-331631471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70710804-71e5-4400-809b-bbfaefbf8a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:57:58 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-76f0b266-ebb7-4cef-b360-9b3bebce590e tempest-VolumesTransfersV355Test-331631471 None] Volume bd069727-cd38-4d8f-ad5b-98bf793baea5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd069727-cd38-4d8f-ad5b-98bf793baea5', 'volume_size': 1} Sep 28 11:57:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-76f0b266-ebb7-4cef-b360-9b3bebce590e tempest-VolumesTransfersV355Test-331631471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:57:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-76f0b266-ebb7-4cef-b360-9b3bebce590e tempest-VolumesTransfersV355Test-331631471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:57:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-76f0b266-ebb7-4cef-b360-9b3bebce590e tempest-VolumesTransfersV355Test-331631471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1770452259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd069727-cd38-4d8f-ad5b-98bf793baea5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a29a531ae9c4d979eeb5df4865fd70c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:57:58Z,use_quota=True,user_id='a4e8e2d2e8fa4cfd8fcb2f5c3b8b88c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:57:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-76f0b266-ebb7-4cef-b360-9b3bebce590e tempest-VolumesTransfersV355Test-331631471 None] Creating volume bd069727-cd38-4d8f-ad5b-98bf793baea5 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:57:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-76f0b266-ebb7-4cef-b360-9b3bebce590e tempest-VolumesTransfersV355Test-331631471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:57:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-76f0b266-ebb7-4cef-b360-9b3bebce590e tempest-VolumesTransfersV355Test-331631471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:57:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-76f0b266-ebb7-4cef-b360-9b3bebce590e tempest-VolumesTransfersV355Test-331631471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:57:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-76f0b266-ebb7-4cef-b360-9b3bebce590e tempest-VolumesTransfersV355Test-331631471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:57:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-76f0b266-ebb7-4cef-b360-9b3bebce590e tempest-VolumesTransfersV355Test-331631471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:57:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-76f0b266-ebb7-4cef-b360-9b3bebce590e tempest-VolumesTransfersV355Test-331631471 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:57:58 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-76f0b266-ebb7-4cef-b360-9b3bebce590e tempest-VolumesTransfersV355Test-331631471 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:57:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-76f0b266-ebb7-4cef-b360-9b3bebce590e tempest-VolumesTransfersV355Test-331631471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bd069727-cd38-4d8f-ad5b-98bf793baea5 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:57:58 devstack sudo[101116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bd069727-cd38-4d8f-ad5b-98bf793baea5 1073741824 Sep 28 11:57:58 devstack sudo[101116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:57:58 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-9d6b4e61-7a0c-4535-ba92-fd9c6882c0b2 tempest-VolumesActionsTest-1006378351 None] Terminate volume connection completed successfully. Sep 28 11:57:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9d6b4e61-7a0c-4535-ba92-fd9c6882c0b2 tempest-VolumesActionsTest-1006378351 None] Acquiring lock "cinder-5b222fce-a9ef-43ab-93f7-f0f9ac3709af-detach_volume" by "detach_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:57:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9d6b4e61-7a0c-4535-ba92-fd9c6882c0b2 tempest-VolumesActionsTest-1006378351 None] Lock "cinder-5b222fce-a9ef-43ab-93f7-f0f9ac3709af-detach_volume" acquired by "detach_volume" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:57:58 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-9d6b4e61-7a0c-4535-ba92-fd9c6882c0b2 tempest-VolumesActionsTest-1006378351 None] Detaching volume 5b222fce-a9ef-43ab-93f7-f0f9ac3709af from instance f79f4b55-d86b-4635-9ce7-a63be4edd8d8. Sep 28 11:57:58 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-9d6b4e61-7a0c-4535-ba92-fd9c6882c0b2 tempest-VolumesActionsTest-1006378351 None] Detach volume completed successfully. Sep 28 11:57:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9d6b4e61-7a0c-4535-ba92-fd9c6882c0b2 tempest-VolumesActionsTest-1006378351 None] Lock "cinder-5b222fce-a9ef-43ab-93f7-f0f9ac3709af-detach_volume" released by "detach_volume" :: held 0.078s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:57:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0613f23a-695c-46e3-8b2d-84a88429bfe1 tempest-VolumesActionsTest-649771008 None] Acquiring lock "cinder-5b222fce-a9ef-43ab-93f7-f0f9ac3709af-detach_volume" by "detach_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:57:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0613f23a-695c-46e3-8b2d-84a88429bfe1 tempest-VolumesActionsTest-649771008 None] Lock "cinder-5b222fce-a9ef-43ab-93f7-f0f9ac3709af-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:57:58 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-0613f23a-695c-46e3-8b2d-84a88429bfe1 tempest-VolumesActionsTest-649771008 None] Volume detach called, but volume not attached. Sep 28 11:57:58 devstack sudo[101116]: pam_unix(sudo:session): session closed for user root Sep 28 11:57:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-76f0b266-ebb7-4cef-b360-9b3bebce590e tempest-VolumesTransfersV355Test-331631471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bd069727-cd38-4d8f-ad5b-98bf793baea5 1073741824" returned: 0 in 0.711s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:57:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0613f23a-695c-46e3-8b2d-84a88429bfe1 tempest-VolumesActionsTest-649771008 None] Lock "cinder-5b222fce-a9ef-43ab-93f7-f0f9ac3709af-detach_volume" released by "detach_volume" :: held 0.051s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:57:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-76f0b266-ebb7-4cef-b360-9b3bebce590e tempest-VolumesTransfersV355Test-331631471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bd069727-cd38-4d8f-ad5b-98bf793baea5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:57:59 devstack sudo[101122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bd069727-cd38-4d8f-ad5b-98bf793baea5 Sep 28 11:57:59 devstack sudo[101122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:57:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e9b68736-975b-4adb-b067-9f2d291b5a41 tempest-VolumesActionsTest-649771008 None] Acquiring lock "cinder-5b222fce-a9ef-43ab-93f7-f0f9ac3709af-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:57:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e9b68736-975b-4adb-b067-9f2d291b5a41 tempest-VolumesActionsTest-649771008 None] Lock "cinder-5b222fce-a9ef-43ab-93f7-f0f9ac3709af-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:57:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e9b68736-975b-4adb-b067-9f2d291b5a41 tempest-VolumesActionsTest-649771008 None] Acquiring lock "cinder-quobyte-5b222fce-a9ef-43ab-93f7-f0f9ac3709af" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:57:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e9b68736-975b-4adb-b067-9f2d291b5a41 tempest-VolumesActionsTest-649771008 None] Lock "cinder-quobyte-5b222fce-a9ef-43ab-93f7-f0f9ac3709af" acquired by "delete_volume" :: waited 0.021s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:57:59 devstack sudo[101122]: pam_unix(sudo:session): session closed for user root Sep 28 11:57:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-76f0b266-ebb7-4cef-b360-9b3bebce590e tempest-VolumesTransfersV355Test-331631471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bd069727-cd38-4d8f-ad5b-98bf793baea5" returned: 0 in 0.423s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:57:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-76f0b266-ebb7-4cef-b360-9b3bebce590e tempest-VolumesTransfersV355Test-331631471 None] <== create_volume: return (1231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:57:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-76f0b266-ebb7-4cef-b360-9b3bebce590e tempest-VolumesTransfersV355Test-331631471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.233s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:57:59 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0be2b5-dd51-4381-83f3-5fbb97a98743]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:57:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e9b68736-975b-4adb-b067-9f2d291b5a41 tempest-VolumesActionsTest-649771008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5b222fce-a9ef-43ab-93f7-f0f9ac3709af {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:57:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-76f0b266-ebb7-4cef-b360-9b3bebce590e tempest-VolumesTransfersV355Test-331631471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70710804-71e5-4400-809b-bbfaefbf8a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd069727-cd38-4d8f-ad5b-98bf793baea5', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:57:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-76f0b266-ebb7-4cef-b360-9b3bebce590e tempest-VolumesTransfersV355Test-331631471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5458d933-b573-4d41-ab64-934a20763b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:57:59 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-76f0b266-ebb7-4cef-b360-9b3bebce590e tempest-VolumesTransfersV355Test-331631471 None] Volume volume-bd069727-cd38-4d8f-ad5b-98bf793baea5 (bd069727-cd38-4d8f-ad5b-98bf793baea5): created successfully Sep 28 11:57:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-76f0b266-ebb7-4cef-b360-9b3bebce590e tempest-VolumesTransfersV355Test-331631471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5458d933-b573-4d41-ab64-934a20763b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:57:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-76f0b266-ebb7-4cef-b360-9b3bebce590e tempest-VolumesTransfersV355Test-331631471 None] Flow 'volume_create_manager' (b5a0efde-2f6d-4aa9-827d-d22a4054e601) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:57:59 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-76f0b266-ebb7-4cef-b360-9b3bebce590e tempest-VolumesTransfersV355Test-331631471 None] Created volume successfully. Sep 28 11:57:59 devstack sudo[101125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5b222fce-a9ef-43ab-93f7-f0f9ac3709af Sep 28 11:57:59 devstack sudo[101125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:57:59 devstack sudo[101125]: pam_unix(sudo:session): session closed for user root Sep 28 11:57:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e9b68736-975b-4adb-b067-9f2d291b5a41 tempest-VolumesActionsTest-649771008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5b222fce-a9ef-43ab-93f7-f0f9ac3709af" returned: 0 in 0.423s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:57:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e9b68736-975b-4adb-b067-9f2d291b5a41 tempest-VolumesActionsTest-649771008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5b222fce-a9ef-43ab-93f7-f0f9ac3709af {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:57:59 devstack sudo[101131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5b222fce-a9ef-43ab-93f7-f0f9ac3709af Sep 28 11:57:59 devstack sudo[101131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:58:00 devstack sudo[101131]: pam_unix(sudo:session): session closed for user root Sep 28 11:58:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e9b68736-975b-4adb-b067-9f2d291b5a41 tempest-VolumesActionsTest-649771008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5b222fce-a9ef-43ab-93f7-f0f9ac3709af" returned: 0 in 0.314s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:58:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e9b68736-975b-4adb-b067-9f2d291b5a41 tempest-VolumesActionsTest-649771008 None] Lock "cinder-quobyte-5b222fce-a9ef-43ab-93f7-f0f9ac3709af" released by "delete_volume" :: held 0.797s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:58:00 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-e9b68736-975b-4adb-b067-9f2d291b5a41 tempest-VolumesActionsTest-649771008 None] Created reservations ['13117c14-3d1d-4f28-a969-e6812623b145', '52ab70b5-86ab-414b-8890-86ea3020b897', '5d44647a-f81d-4d95-9a77-390471bfbca0', 'e9c16324-3d5b-40fa-a092-3663e95cf26a'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:58:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e9b68736-975b-4adb-b067-9f2d291b5a41 tempest-VolumesActionsTest-649771008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:58:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e9b68736-975b-4adb-b067-9f2d291b5a41 tempest-VolumesActionsTest-649771008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:58:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e9b68736-975b-4adb-b067-9f2d291b5a41 tempest-VolumesActionsTest-649771008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:58:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e9b68736-975b-4adb-b067-9f2d291b5a41 tempest-VolumesActionsTest-649771008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:58:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e9b68736-975b-4adb-b067-9f2d291b5a41 tempest-VolumesActionsTest-649771008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:58:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e9b68736-975b-4adb-b067-9f2d291b5a41 tempest-VolumesActionsTest-649771008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:58:00 devstack sudo[101135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:58:00 devstack sudo[101135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:58:01 devstack sudo[101135]: pam_unix(sudo:session): session closed for user root Sep 28 11:58:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e9b68736-975b-4adb-b067-9f2d291b5a41 tempest-VolumesActionsTest-649771008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.769s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:58:01 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-e9b68736-975b-4adb-b067-9f2d291b5a41 tempest-VolumesActionsTest-649771008 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:58:01 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e9b68736-975b-4adb-b067-9f2d291b5a41 tempest-VolumesActionsTest-649771008 None] Deleted volume successfully. Sep 28 11:58:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e9b68736-975b-4adb-b067-9f2d291b5a41 tempest-VolumesActionsTest-649771008 None] Lock "cinder-5b222fce-a9ef-43ab-93f7-f0f9ac3709af-delete_volume" released by "delete_volume" :: held 1.931s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:58:01 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-a45daac2-c18c-4e7f-b916-39a83806847f tempest-VolumesTransfersV355Test-1337059535 None] Transfer volume completed successfully. Sep 28 11:58:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7f41e697-4573-4608-ab1a-ba1bafca0700 tempest-VolumesTransfersV355Test-1076802972 None] Acquiring lock "cinder-bd069727-cd38-4d8f-ad5b-98bf793baea5-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:58:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7f41e697-4573-4608-ab1a-ba1bafca0700 tempest-VolumesTransfersV355Test-1076802972 None] Lock "cinder-bd069727-cd38-4d8f-ad5b-98bf793baea5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:58:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7f41e697-4573-4608-ab1a-ba1bafca0700 tempest-VolumesTransfersV355Test-1076802972 None] Acquiring lock "cinder-quobyte-bd069727-cd38-4d8f-ad5b-98bf793baea5" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:58:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7f41e697-4573-4608-ab1a-ba1bafca0700 tempest-VolumesTransfersV355Test-1076802972 None] Lock "cinder-quobyte-bd069727-cd38-4d8f-ad5b-98bf793baea5" acquired by "delete_volume" :: waited 0.027s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:58:02 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c78cb21-0d98-4507-a2fa-c8ff48c02425]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:58:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7f41e697-4573-4608-ab1a-ba1bafca0700 tempest-VolumesTransfersV355Test-1076802972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bd069727-cd38-4d8f-ad5b-98bf793baea5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:58:02 devstack sudo[101162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bd069727-cd38-4d8f-ad5b-98bf793baea5 Sep 28 11:58:02 devstack sudo[101162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:58:02 devstack sudo[101162]: pam_unix(sudo:session): session closed for user root Sep 28 11:58:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7f41e697-4573-4608-ab1a-ba1bafca0700 tempest-VolumesTransfersV355Test-1076802972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bd069727-cd38-4d8f-ad5b-98bf793baea5" returned: 0 in 0.420s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:58:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7f41e697-4573-4608-ab1a-ba1bafca0700 tempest-VolumesTransfersV355Test-1076802972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bd069727-cd38-4d8f-ad5b-98bf793baea5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:58:02 devstack sudo[101167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bd069727-cd38-4d8f-ad5b-98bf793baea5 Sep 28 11:58:02 devstack sudo[101167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:58:03 devstack sudo[101167]: pam_unix(sudo:session): session closed for user root Sep 28 11:58:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7f41e697-4573-4608-ab1a-ba1bafca0700 tempest-VolumesTransfersV355Test-1076802972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bd069727-cd38-4d8f-ad5b-98bf793baea5" returned: 0 in 0.290s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:58:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7f41e697-4573-4608-ab1a-ba1bafca0700 tempest-VolumesTransfersV355Test-1076802972 None] Lock "cinder-quobyte-bd069727-cd38-4d8f-ad5b-98bf793baea5" released by "delete_volume" :: held 0.772s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:58:03 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-7f41e697-4573-4608-ab1a-ba1bafca0700 tempest-VolumesTransfersV355Test-1076802972 None] Created reservations ['349e4ec5-7d4c-467f-97a1-2a77145507bc', 'f393aa6c-6a55-49d2-a2d0-2423f916debe', '023c4d4b-fb58-4a1b-a0d9-fb24eeb142b3', '547d3dac-b91b-40db-b907-eacc5dc04bbd'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:58:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7f41e697-4573-4608-ab1a-ba1bafca0700 tempest-VolumesTransfersV355Test-1076802972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:58:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7f41e697-4573-4608-ab1a-ba1bafca0700 tempest-VolumesTransfersV355Test-1076802972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:58:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7f41e697-4573-4608-ab1a-ba1bafca0700 tempest-VolumesTransfersV355Test-1076802972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:58:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7f41e697-4573-4608-ab1a-ba1bafca0700 tempest-VolumesTransfersV355Test-1076802972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:58:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7f41e697-4573-4608-ab1a-ba1bafca0700 tempest-VolumesTransfersV355Test-1076802972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:58:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7f41e697-4573-4608-ab1a-ba1bafca0700 tempest-VolumesTransfersV355Test-1076802972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:58:03 devstack sudo[101170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:58:03 devstack sudo[101170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:58:03 devstack sudo[101170]: pam_unix(sudo:session): session closed for user root Sep 28 11:58:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7f41e697-4573-4608-ab1a-ba1bafca0700 tempest-VolumesTransfersV355Test-1076802972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.456s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:58:03 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-7f41e697-4573-4608-ab1a-ba1bafca0700 tempest-VolumesTransfersV355Test-1076802972 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:58:03 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-7f41e697-4573-4608-ab1a-ba1bafca0700 tempest-VolumesTransfersV355Test-1076802972 None] Deleted volume successfully. Sep 28 11:58:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7f41e697-4573-4608-ab1a-ba1bafca0700 tempest-VolumesTransfersV355Test-1076802972 None] Lock "cinder-bd069727-cd38-4d8f-ad5b-98bf793baea5-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:58:04 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e400373-bbc6-4aaa-a099-deee41841d6f tempest-VolumesTransfersV355Test-331631471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:58:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0e400373-bbc6-4aaa-a099-deee41841d6f tempest-VolumesTransfersV355Test-331631471 None] Flow 'volume_create_manager' (02a6785a-4f53-493c-a07a-e0ef75f6e295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:58:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0e400373-bbc6-4aaa-a099-deee41841d6f tempest-VolumesTransfersV355Test-331631471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12a322a9-c6b5-49a7-b3f9-bfc28c95f349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:58:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0e400373-bbc6-4aaa-a099-deee41841d6f tempest-VolumesTransfersV355Test-331631471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12a322a9-c6b5-49a7-b3f9-bfc28c95f349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:58:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-51795880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57749dc0-0a6b-47d6-ae39-8147d0b1f1cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a29a531ae9c4d979eeb5df4865fd70c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:58:04Z,use_quota=True,user_id='a4e8e2d2e8fa4cfd8fcb2f5c3b8b88c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:58:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0e400373-bbc6-4aaa-a099-deee41841d6f tempest-VolumesTransfersV355Test-331631471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c69c567d-1e4d-474e-af37-c422fa474be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:58:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0e400373-bbc6-4aaa-a099-deee41841d6f tempest-VolumesTransfersV355Test-331631471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c69c567d-1e4d-474e-af37-c422fa474be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:58:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0e400373-bbc6-4aaa-a099-deee41841d6f tempest-VolumesTransfersV355Test-331631471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd57852d-b1ad-472b-a368-c54aec57e71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:58:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0e400373-bbc6-4aaa-a099-deee41841d6f tempest-VolumesTransfersV355Test-331631471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd57852d-b1ad-472b-a368-c54aec57e71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57749dc0-0a6b-47d6-ae39-8147d0b1f1cf', 'volume_name': 'volume-57749dc0-0a6b-47d6-ae39-8147d0b1f1cf', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:58:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0e400373-bbc6-4aaa-a099-deee41841d6f tempest-VolumesTransfersV355Test-331631471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74d7d9ff-3f78-4990-8392-3f5406bbcf45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:58:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0e400373-bbc6-4aaa-a099-deee41841d6f tempest-VolumesTransfersV355Test-331631471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74d7d9ff-3f78-4990-8392-3f5406bbcf45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:58:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0e400373-bbc6-4aaa-a099-deee41841d6f tempest-VolumesTransfersV355Test-331631471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee5a960c-3be1-4190-980d-0e61eccfead7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:58:04 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-0e400373-bbc6-4aaa-a099-deee41841d6f tempest-VolumesTransfersV355Test-331631471 None] Volume 57749dc0-0a6b-47d6-ae39-8147d0b1f1cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57749dc0-0a6b-47d6-ae39-8147d0b1f1cf', 'volume_size': 1} Sep 28 11:58:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0e400373-bbc6-4aaa-a099-deee41841d6f tempest-VolumesTransfersV355Test-331631471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:58:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0e400373-bbc6-4aaa-a099-deee41841d6f tempest-VolumesTransfersV355Test-331631471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:58:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0e400373-bbc6-4aaa-a099-deee41841d6f tempest-VolumesTransfersV355Test-331631471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:58:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-51795880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57749dc0-0a6b-47d6-ae39-8147d0b1f1cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a29a531ae9c4d979eeb5df4865fd70c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:58:04Z,use_quota=True,user_id='a4e8e2d2e8fa4cfd8fcb2f5c3b8b88c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:58:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-0e400373-bbc6-4aaa-a099-deee41841d6f tempest-VolumesTransfersV355Test-331631471 None] Creating volume 57749dc0-0a6b-47d6-ae39-8147d0b1f1cf {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:58:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0e400373-bbc6-4aaa-a099-deee41841d6f tempest-VolumesTransfersV355Test-331631471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:58:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0e400373-bbc6-4aaa-a099-deee41841d6f tempest-VolumesTransfersV355Test-331631471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:58:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0e400373-bbc6-4aaa-a099-deee41841d6f tempest-VolumesTransfersV355Test-331631471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:58:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0e400373-bbc6-4aaa-a099-deee41841d6f tempest-VolumesTransfersV355Test-331631471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:58:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0e400373-bbc6-4aaa-a099-deee41841d6f tempest-VolumesTransfersV355Test-331631471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:58:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0e400373-bbc6-4aaa-a099-deee41841d6f tempest-VolumesTransfersV355Test-331631471 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:58:04 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-0e400373-bbc6-4aaa-a099-deee41841d6f tempest-VolumesTransfersV355Test-331631471 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:58:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0e400373-bbc6-4aaa-a099-deee41841d6f tempest-VolumesTransfersV355Test-331631471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-57749dc0-0a6b-47d6-ae39-8147d0b1f1cf 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:58:04 devstack sudo[101175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-57749dc0-0a6b-47d6-ae39-8147d0b1f1cf 1073741824 Sep 28 11:58:04 devstack sudo[101175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:58:05 devstack sudo[101175]: pam_unix(sudo:session): session closed for user root Sep 28 11:58:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0e400373-bbc6-4aaa-a099-deee41841d6f tempest-VolumesTransfersV355Test-331631471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-57749dc0-0a6b-47d6-ae39-8147d0b1f1cf 1073741824" returned: 0 in 0.640s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:58:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0e400373-bbc6-4aaa-a099-deee41841d6f tempest-VolumesTransfersV355Test-331631471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-57749dc0-0a6b-47d6-ae39-8147d0b1f1cf {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:58:05 devstack sudo[101181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-57749dc0-0a6b-47d6-ae39-8147d0b1f1cf Sep 28 11:58:05 devstack sudo[101181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:58:05 devstack sudo[101181]: pam_unix(sudo:session): session closed for user root Sep 28 11:58:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0e400373-bbc6-4aaa-a099-deee41841d6f tempest-VolumesTransfersV355Test-331631471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-57749dc0-0a6b-47d6-ae39-8147d0b1f1cf" returned: 0 in 0.320s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:58:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0e400373-bbc6-4aaa-a099-deee41841d6f tempest-VolumesTransfersV355Test-331631471 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:58:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0e400373-bbc6-4aaa-a099-deee41841d6f tempest-VolumesTransfersV355Test-331631471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:58:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0e400373-bbc6-4aaa-a099-deee41841d6f tempest-VolumesTransfersV355Test-331631471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee5a960c-3be1-4190-980d-0e61eccfead7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57749dc0-0a6b-47d6-ae39-8147d0b1f1cf', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:58:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0e400373-bbc6-4aaa-a099-deee41841d6f tempest-VolumesTransfersV355Test-331631471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6adde355-79f2-4ced-a2e2-57845b992ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:58:05 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-0e400373-bbc6-4aaa-a099-deee41841d6f tempest-VolumesTransfersV355Test-331631471 None] Volume volume-57749dc0-0a6b-47d6-ae39-8147d0b1f1cf (57749dc0-0a6b-47d6-ae39-8147d0b1f1cf): created successfully Sep 28 11:58:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0e400373-bbc6-4aaa-a099-deee41841d6f tempest-VolumesTransfersV355Test-331631471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6adde355-79f2-4ced-a2e2-57845b992ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:58:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0e400373-bbc6-4aaa-a099-deee41841d6f tempest-VolumesTransfersV355Test-331631471 None] Flow 'volume_create_manager' (02a6785a-4f53-493c-a07a-e0ef75f6e295) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:58:05 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-0e400373-bbc6-4aaa-a099-deee41841d6f tempest-VolumesTransfersV355Test-331631471 None] Created volume successfully. Sep 28 11:58:05 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-d39d72c8-9a97-4f86-aafa-f2542c278705 tempest-VolumesActionsTest-649771008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:58:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d39d72c8-9a97-4f86-aafa-f2542c278705 tempest-VolumesActionsTest-649771008 None] Flow 'volume_create_manager' (012f666d-af1c-43b0-ab2b-d185a795adc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:58:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d39d72c8-9a97-4f86-aafa-f2542c278705 tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30880313-e150-4686-9b30-060ae1855bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:58:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d39d72c8-9a97-4f86-aafa-f2542c278705 tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30880313-e150-4686-9b30-060ae1855bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:58:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1245665465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7fb4991-9aab-4ead-8334-49a86283d731,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2a0e61cc2154702be4628e75f3c318f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:58:06Z,use_quota=True,user_id='dcd554c777564045a38816562cd3a7f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:58:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d39d72c8-9a97-4f86-aafa-f2542c278705 tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b4a36b7-a2eb-4363-89be-882f153adcf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:58:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d39d72c8-9a97-4f86-aafa-f2542c278705 tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b4a36b7-a2eb-4363-89be-882f153adcf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:58:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d39d72c8-9a97-4f86-aafa-f2542c278705 tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (651c8e25-b405-4dcc-8f53-3fa08da58924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:58:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d39d72c8-9a97-4f86-aafa-f2542c278705 tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (651c8e25-b405-4dcc-8f53-3fa08da58924) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7fb4991-9aab-4ead-8334-49a86283d731', 'volume_name': 'volume-f7fb4991-9aab-4ead-8334-49a86283d731', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:58:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d39d72c8-9a97-4f86-aafa-f2542c278705 tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db68bd12-53a9-4c0b-8018-c3f8a68e54d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:58:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d39d72c8-9a97-4f86-aafa-f2542c278705 tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db68bd12-53a9-4c0b-8018-c3f8a68e54d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:58:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d39d72c8-9a97-4f86-aafa-f2542c278705 tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b47a149-f6d4-4cb8-882d-896a70e3cea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:58:05 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-d39d72c8-9a97-4f86-aafa-f2542c278705 tempest-VolumesActionsTest-649771008 None] Volume f7fb4991-9aab-4ead-8334-49a86283d731: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7fb4991-9aab-4ead-8334-49a86283d731', 'volume_size': 1} Sep 28 11:58:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d39d72c8-9a97-4f86-aafa-f2542c278705 tempest-VolumesActionsTest-649771008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:58:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d39d72c8-9a97-4f86-aafa-f2542c278705 tempest-VolumesActionsTest-649771008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:58:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d39d72c8-9a97-4f86-aafa-f2542c278705 tempest-VolumesActionsTest-649771008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:58:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1245665465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7fb4991-9aab-4ead-8334-49a86283d731,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2a0e61cc2154702be4628e75f3c318f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:58:06Z,use_quota=True,user_id='dcd554c777564045a38816562cd3a7f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:58:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-d39d72c8-9a97-4f86-aafa-f2542c278705 tempest-VolumesActionsTest-649771008 None] Creating volume f7fb4991-9aab-4ead-8334-49a86283d731 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:58:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d39d72c8-9a97-4f86-aafa-f2542c278705 tempest-VolumesActionsTest-649771008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:58:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d39d72c8-9a97-4f86-aafa-f2542c278705 tempest-VolumesActionsTest-649771008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:58:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d39d72c8-9a97-4f86-aafa-f2542c278705 tempest-VolumesActionsTest-649771008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:58:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d39d72c8-9a97-4f86-aafa-f2542c278705 tempest-VolumesActionsTest-649771008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:58:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d39d72c8-9a97-4f86-aafa-f2542c278705 tempest-VolumesActionsTest-649771008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:58:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d39d72c8-9a97-4f86-aafa-f2542c278705 tempest-VolumesActionsTest-649771008 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:58:05 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-d39d72c8-9a97-4f86-aafa-f2542c278705 tempest-VolumesActionsTest-649771008 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:58:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d39d72c8-9a97-4f86-aafa-f2542c278705 tempest-VolumesActionsTest-649771008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f7fb4991-9aab-4ead-8334-49a86283d731 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:58:05 devstack sudo[101184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f7fb4991-9aab-4ead-8334-49a86283d731 1073741824 Sep 28 11:58:05 devstack sudo[101184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:58:06 devstack sudo[101184]: pam_unix(sudo:session): session closed for user root Sep 28 11:58:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d39d72c8-9a97-4f86-aafa-f2542c278705 tempest-VolumesActionsTest-649771008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f7fb4991-9aab-4ead-8334-49a86283d731 1073741824" returned: 0 in 0.532s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:58:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d39d72c8-9a97-4f86-aafa-f2542c278705 tempest-VolumesActionsTest-649771008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f7fb4991-9aab-4ead-8334-49a86283d731 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:58:06 devstack sudo[101190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f7fb4991-9aab-4ead-8334-49a86283d731 Sep 28 11:58:06 devstack sudo[101190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:58:06 devstack sudo[101190]: pam_unix(sudo:session): session closed for user root Sep 28 11:58:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d39d72c8-9a97-4f86-aafa-f2542c278705 tempest-VolumesActionsTest-649771008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f7fb4991-9aab-4ead-8334-49a86283d731" returned: 0 in 0.289s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:58:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d39d72c8-9a97-4f86-aafa-f2542c278705 tempest-VolumesActionsTest-649771008 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:58:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d39d72c8-9a97-4f86-aafa-f2542c278705 tempest-VolumesActionsTest-649771008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:58:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d39d72c8-9a97-4f86-aafa-f2542c278705 tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b47a149-f6d4-4cb8-882d-896a70e3cea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7fb4991-9aab-4ead-8334-49a86283d731', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:58:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d39d72c8-9a97-4f86-aafa-f2542c278705 tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9780334b-4ce9-4fec-9a04-52fc5c3bb6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:58:06 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-d39d72c8-9a97-4f86-aafa-f2542c278705 tempest-VolumesActionsTest-649771008 None] Volume volume-f7fb4991-9aab-4ead-8334-49a86283d731 (f7fb4991-9aab-4ead-8334-49a86283d731): created successfully Sep 28 11:58:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d39d72c8-9a97-4f86-aafa-f2542c278705 tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9780334b-4ce9-4fec-9a04-52fc5c3bb6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:58:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d39d72c8-9a97-4f86-aafa-f2542c278705 tempest-VolumesActionsTest-649771008 None] Flow 'volume_create_manager' (012f666d-af1c-43b0-ab2b-d185a795adc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:58:06 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-d39d72c8-9a97-4f86-aafa-f2542c278705 tempest-VolumesActionsTest-649771008 None] Created volume successfully. Sep 28 11:58:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-88913edd-5bb5-4d8f-a628-70a74e3e46ff tempest-VolumesTransfersV355Test-1076802972 None] Acquiring lock "cinder-57749dc0-0a6b-47d6-ae39-8147d0b1f1cf-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:58:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-88913edd-5bb5-4d8f-a628-70a74e3e46ff tempest-VolumesTransfersV355Test-1076802972 None] Lock "cinder-57749dc0-0a6b-47d6-ae39-8147d0b1f1cf-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:58:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-88913edd-5bb5-4d8f-a628-70a74e3e46ff tempest-VolumesTransfersV355Test-1076802972 None] Acquiring lock "cinder-quobyte-57749dc0-0a6b-47d6-ae39-8147d0b1f1cf" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:58:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-88913edd-5bb5-4d8f-a628-70a74e3e46ff tempest-VolumesTransfersV355Test-1076802972 None] Lock "cinder-quobyte-57749dc0-0a6b-47d6-ae39-8147d0b1f1cf" acquired by "delete_volume" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:58:06 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0266806-8342-40c5-8895-71cbc3a14764]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:58:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-88913edd-5bb5-4d8f-a628-70a74e3e46ff tempest-VolumesTransfersV355Test-1076802972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-57749dc0-0a6b-47d6-ae39-8147d0b1f1cf {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:58:06 devstack sudo[101193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-57749dc0-0a6b-47d6-ae39-8147d0b1f1cf Sep 28 11:58:06 devstack sudo[101193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:58:07 devstack sudo[101193]: pam_unix(sudo:session): session closed for user root Sep 28 11:58:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-88913edd-5bb5-4d8f-a628-70a74e3e46ff tempest-VolumesTransfersV355Test-1076802972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-57749dc0-0a6b-47d6-ae39-8147d0b1f1cf" returned: 0 in 0.396s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:58:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-88913edd-5bb5-4d8f-a628-70a74e3e46ff tempest-VolumesTransfersV355Test-1076802972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-57749dc0-0a6b-47d6-ae39-8147d0b1f1cf {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:58:07 devstack sudo[101200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-57749dc0-0a6b-47d6-ae39-8147d0b1f1cf Sep 28 11:58:07 devstack sudo[101200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:58:07 devstack sudo[101200]: pam_unix(sudo:session): session closed for user root Sep 28 11:58:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-88913edd-5bb5-4d8f-a628-70a74e3e46ff tempest-VolumesTransfersV355Test-1076802972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-57749dc0-0a6b-47d6-ae39-8147d0b1f1cf" returned: 0 in 0.279s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:58:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-88913edd-5bb5-4d8f-a628-70a74e3e46ff tempest-VolumesTransfersV355Test-1076802972 None] Lock "cinder-quobyte-57749dc0-0a6b-47d6-ae39-8147d0b1f1cf" released by "delete_volume" :: held 0.735s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:58:07 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-88913edd-5bb5-4d8f-a628-70a74e3e46ff tempest-VolumesTransfersV355Test-1076802972 None] Created reservations ['812bb5bd-31ee-4456-af35-d3b8891495c4', '82d90b1d-2e91-4a7e-bcea-914e5f755332', 'dc1770ec-900f-478d-9bba-4eb059971ec5', '6f29751a-ea8c-4260-ba38-fad99a3b0f50'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:58:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-88913edd-5bb5-4d8f-a628-70a74e3e46ff tempest-VolumesTransfersV355Test-1076802972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:58:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-88913edd-5bb5-4d8f-a628-70a74e3e46ff tempest-VolumesTransfersV355Test-1076802972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:58:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-88913edd-5bb5-4d8f-a628-70a74e3e46ff tempest-VolumesTransfersV355Test-1076802972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:58:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-88913edd-5bb5-4d8f-a628-70a74e3e46ff tempest-VolumesTransfersV355Test-1076802972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:58:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-88913edd-5bb5-4d8f-a628-70a74e3e46ff tempest-VolumesTransfersV355Test-1076802972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:58:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-88913edd-5bb5-4d8f-a628-70a74e3e46ff tempest-VolumesTransfersV355Test-1076802972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:58:07 devstack sudo[101237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:58:07 devstack sudo[101237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:58:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ce1efa65-3563-4993-b8b2-72cb9c4cc8c2 tempest-VolumesActionsTest-1006378351 None] Acquiring lock "cinder-f7fb4991-9aab-4ead-8334-49a86283d731-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:58:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ce1efa65-3563-4993-b8b2-72cb9c4cc8c2 tempest-VolumesActionsTest-1006378351 None] Lock "cinder-f7fb4991-9aab-4ead-8334-49a86283d731-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:58:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ce1efa65-3563-4993-b8b2-72cb9c4cc8c2 tempest-VolumesActionsTest-1006378351 None] Acquiring lock "cinder-quobyte-f7fb4991-9aab-4ead-8334-49a86283d731" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:58:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ce1efa65-3563-4993-b8b2-72cb9c4cc8c2 tempest-VolumesActionsTest-1006378351 None] Lock "cinder-quobyte-f7fb4991-9aab-4ead-8334-49a86283d731" acquired by "delete_volume" :: waited 0.027s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:58:08 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[923dcfcd-96dc-4b18-94e5-40186466419c]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:58:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ce1efa65-3563-4993-b8b2-72cb9c4cc8c2 tempest-VolumesActionsTest-1006378351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f7fb4991-9aab-4ead-8334-49a86283d731 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:58:08 devstack sudo[101237]: pam_unix(sudo:session): session closed for user root Sep 28 11:58:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-88913edd-5bb5-4d8f-a628-70a74e3e46ff tempest-VolumesTransfersV355Test-1076802972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.515s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:58:08 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-88913edd-5bb5-4d8f-a628-70a74e3e46ff tempest-VolumesTransfersV355Test-1076802972 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:58:08 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-88913edd-5bb5-4d8f-a628-70a74e3e46ff tempest-VolumesTransfersV355Test-1076802972 None] Deleted volume successfully. Sep 28 11:58:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-88913edd-5bb5-4d8f-a628-70a74e3e46ff tempest-VolumesTransfersV355Test-1076802972 None] Lock "cinder-57749dc0-0a6b-47d6-ae39-8147d0b1f1cf-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:58:08 devstack sudo[101242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f7fb4991-9aab-4ead-8334-49a86283d731 Sep 28 11:58:08 devstack sudo[101242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:58:08 devstack sudo[101242]: pam_unix(sudo:session): session closed for user root Sep 28 11:58:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ce1efa65-3563-4993-b8b2-72cb9c4cc8c2 tempest-VolumesActionsTest-1006378351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f7fb4991-9aab-4ead-8334-49a86283d731" returned: 0 in 0.458s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:58:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ce1efa65-3563-4993-b8b2-72cb9c4cc8c2 tempest-VolumesActionsTest-1006378351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f7fb4991-9aab-4ead-8334-49a86283d731 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:58:08 devstack sudo[101247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f7fb4991-9aab-4ead-8334-49a86283d731 Sep 28 11:58:08 devstack sudo[101247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:58:08 devstack sudo[101247]: pam_unix(sudo:session): session closed for user root Sep 28 11:58:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ce1efa65-3563-4993-b8b2-72cb9c4cc8c2 tempest-VolumesActionsTest-1006378351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f7fb4991-9aab-4ead-8334-49a86283d731" returned: 0 in 0.267s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:58:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ce1efa65-3563-4993-b8b2-72cb9c4cc8c2 tempest-VolumesActionsTest-1006378351 None] Lock "cinder-quobyte-f7fb4991-9aab-4ead-8334-49a86283d731" released by "delete_volume" :: held 0.803s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:58:09 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-ce1efa65-3563-4993-b8b2-72cb9c4cc8c2 tempest-VolumesActionsTest-1006378351 None] Created reservations ['59ebb048-1ce2-46db-b1b6-44ce02abd5b4', '298e22b9-b12b-4f91-9895-b681fd5c2dd5', '0bd2e4e3-0c70-4dbf-9123-db3ae4e0db3d', 'a923370c-a69f-49db-b151-7a47d0fc377b'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:58:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ce1efa65-3563-4993-b8b2-72cb9c4cc8c2 tempest-VolumesActionsTest-1006378351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:58:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ce1efa65-3563-4993-b8b2-72cb9c4cc8c2 tempest-VolumesActionsTest-1006378351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:58:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ce1efa65-3563-4993-b8b2-72cb9c4cc8c2 tempest-VolumesActionsTest-1006378351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:58:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ce1efa65-3563-4993-b8b2-72cb9c4cc8c2 tempest-VolumesActionsTest-1006378351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:58:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ce1efa65-3563-4993-b8b2-72cb9c4cc8c2 tempest-VolumesActionsTest-1006378351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:58:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ce1efa65-3563-4993-b8b2-72cb9c4cc8c2 tempest-VolumesActionsTest-1006378351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:58:09 devstack sudo[101250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:58:09 devstack sudo[101250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:58:09 devstack sudo[101250]: pam_unix(sudo:session): session closed for user root Sep 28 11:58:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ce1efa65-3563-4993-b8b2-72cb9c4cc8c2 tempest-VolumesActionsTest-1006378351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.323s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:58:09 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-ce1efa65-3563-4993-b8b2-72cb9c4cc8c2 tempest-VolumesActionsTest-1006378351 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:58:09 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-ce1efa65-3563-4993-b8b2-72cb9c4cc8c2 tempest-VolumesActionsTest-1006378351 None] Deleted volume successfully. Sep 28 11:58:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ce1efa65-3563-4993-b8b2-72cb9c4cc8c2 tempest-VolumesActionsTest-1006378351 None] Lock "cinder-f7fb4991-9aab-4ead-8334-49a86283d731-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:58:09 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-17d03ae5-41cb-456d-b950-933d6c2d0f0b tempest-VolumesActionsTest-649771008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:58:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-17d03ae5-41cb-456d-b950-933d6c2d0f0b tempest-VolumesActionsTest-649771008 None] Flow 'volume_create_manager' (5df32a3a-9f4a-4c8a-a519-70e01e9db616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:58:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-17d03ae5-41cb-456d-b950-933d6c2d0f0b tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7808ada2-cbb1-4162-bc11-e8a02a487914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:58:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-17d03ae5-41cb-456d-b950-933d6c2d0f0b tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7808ada2-cbb1-4162-bc11-e8a02a487914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:58:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1191315655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc1848bd-b403-43b0-aedd-e03a0d8f8b98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2a0e61cc2154702be4628e75f3c318f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:58:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:58:10Z,use_quota=True,user_id='dcd554c777564045a38816562cd3a7f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:58:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-17d03ae5-41cb-456d-b950-933d6c2d0f0b tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f62d5d37-2a04-41c7-9f6b-b6905649b3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:58:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-17d03ae5-41cb-456d-b950-933d6c2d0f0b tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f62d5d37-2a04-41c7-9f6b-b6905649b3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:58:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-17d03ae5-41cb-456d-b950-933d6c2d0f0b tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcfe13bd-7b03-45c3-bb0f-c0b106006d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:58:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-17d03ae5-41cb-456d-b950-933d6c2d0f0b tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcfe13bd-7b03-45c3-bb0f-c0b106006d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc1848bd-b403-43b0-aedd-e03a0d8f8b98', 'volume_name': 'volume-cc1848bd-b403-43b0-aedd-e03a0d8f8b98', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:58:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-17d03ae5-41cb-456d-b950-933d6c2d0f0b tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c0f4f53-c365-4d60-9a2a-daa89ec5929d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:58:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-17d03ae5-41cb-456d-b950-933d6c2d0f0b tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c0f4f53-c365-4d60-9a2a-daa89ec5929d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:58:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-17d03ae5-41cb-456d-b950-933d6c2d0f0b tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c7c8594-6fff-42f3-9174-3da84b918787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:58:09 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-17d03ae5-41cb-456d-b950-933d6c2d0f0b tempest-VolumesActionsTest-649771008 None] Volume cc1848bd-b403-43b0-aedd-e03a0d8f8b98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc1848bd-b403-43b0-aedd-e03a0d8f8b98', 'volume_size': 1} Sep 28 11:58:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-17d03ae5-41cb-456d-b950-933d6c2d0f0b tempest-VolumesActionsTest-649771008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:58:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-17d03ae5-41cb-456d-b950-933d6c2d0f0b tempest-VolumesActionsTest-649771008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:58:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-17d03ae5-41cb-456d-b950-933d6c2d0f0b tempest-VolumesActionsTest-649771008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:58:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1191315655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc1848bd-b403-43b0-aedd-e03a0d8f8b98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2a0e61cc2154702be4628e75f3c318f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:58:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:58:10Z,use_quota=True,user_id='dcd554c777564045a38816562cd3a7f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:58:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-17d03ae5-41cb-456d-b950-933d6c2d0f0b tempest-VolumesActionsTest-649771008 None] Creating volume cc1848bd-b403-43b0-aedd-e03a0d8f8b98 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:58:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-17d03ae5-41cb-456d-b950-933d6c2d0f0b tempest-VolumesActionsTest-649771008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:58:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-17d03ae5-41cb-456d-b950-933d6c2d0f0b tempest-VolumesActionsTest-649771008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:58:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-17d03ae5-41cb-456d-b950-933d6c2d0f0b tempest-VolumesActionsTest-649771008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:58:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-17d03ae5-41cb-456d-b950-933d6c2d0f0b tempest-VolumesActionsTest-649771008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:58:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-17d03ae5-41cb-456d-b950-933d6c2d0f0b tempest-VolumesActionsTest-649771008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:58:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-17d03ae5-41cb-456d-b950-933d6c2d0f0b tempest-VolumesActionsTest-649771008 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:58:09 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-17d03ae5-41cb-456d-b950-933d6c2d0f0b tempest-VolumesActionsTest-649771008 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:58:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-17d03ae5-41cb-456d-b950-933d6c2d0f0b tempest-VolumesActionsTest-649771008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cc1848bd-b403-43b0-aedd-e03a0d8f8b98 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:58:10 devstack sudo[101253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cc1848bd-b403-43b0-aedd-e03a0d8f8b98 1073741824 Sep 28 11:58:10 devstack sudo[101253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:58:10 devstack sudo[101253]: pam_unix(sudo:session): session closed for user root Sep 28 11:58:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-17d03ae5-41cb-456d-b950-933d6c2d0f0b tempest-VolumesActionsTest-649771008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cc1848bd-b403-43b0-aedd-e03a0d8f8b98 1073741824" returned: 0 in 0.517s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:58:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-17d03ae5-41cb-456d-b950-933d6c2d0f0b tempest-VolumesActionsTest-649771008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cc1848bd-b403-43b0-aedd-e03a0d8f8b98 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:58:10 devstack sudo[101260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cc1848bd-b403-43b0-aedd-e03a0d8f8b98 Sep 28 11:58:10 devstack sudo[101260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:58:10 devstack sudo[101260]: pam_unix(sudo:session): session closed for user root Sep 28 11:58:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-17d03ae5-41cb-456d-b950-933d6c2d0f0b tempest-VolumesActionsTest-649771008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cc1848bd-b403-43b0-aedd-e03a0d8f8b98" returned: 0 in 0.286s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:58:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-17d03ae5-41cb-456d-b950-933d6c2d0f0b tempest-VolumesActionsTest-649771008 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:58:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-17d03ae5-41cb-456d-b950-933d6c2d0f0b tempest-VolumesActionsTest-649771008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:58:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-17d03ae5-41cb-456d-b950-933d6c2d0f0b tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c7c8594-6fff-42f3-9174-3da84b918787) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc1848bd-b403-43b0-aedd-e03a0d8f8b98', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:58:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-17d03ae5-41cb-456d-b950-933d6c2d0f0b tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e703de9-dcc2-4d8e-a5e2-99cc2edbc4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:58:10 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-17d03ae5-41cb-456d-b950-933d6c2d0f0b tempest-VolumesActionsTest-649771008 None] Volume volume-cc1848bd-b403-43b0-aedd-e03a0d8f8b98 (cc1848bd-b403-43b0-aedd-e03a0d8f8b98): created successfully Sep 28 11:58:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-17d03ae5-41cb-456d-b950-933d6c2d0f0b tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e703de9-dcc2-4d8e-a5e2-99cc2edbc4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:58:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-17d03ae5-41cb-456d-b950-933d6c2d0f0b tempest-VolumesActionsTest-649771008 None] Flow 'volume_create_manager' (5df32a3a-9f4a-4c8a-a519-70e01e9db616) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:58:10 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-17d03ae5-41cb-456d-b950-933d6c2d0f0b tempest-VolumesActionsTest-649771008 None] Created volume successfully. Sep 28 11:58:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7bfb7904-35ac-4ced-a713-fff745646107 tempest-VolumesActionsTest-1006378351 None] Acquiring lock "cinder-cc1848bd-b403-43b0-aedd-e03a0d8f8b98-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:58:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7bfb7904-35ac-4ced-a713-fff745646107 tempest-VolumesActionsTest-1006378351 None] Lock "cinder-cc1848bd-b403-43b0-aedd-e03a0d8f8b98-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:58:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7bfb7904-35ac-4ced-a713-fff745646107 tempest-VolumesActionsTest-1006378351 None] Acquiring lock "cinder-quobyte-cc1848bd-b403-43b0-aedd-e03a0d8f8b98" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:58:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7bfb7904-35ac-4ced-a713-fff745646107 tempest-VolumesActionsTest-1006378351 None] Lock "cinder-quobyte-cc1848bd-b403-43b0-aedd-e03a0d8f8b98" acquired by "delete_volume" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:58:12 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[accd2f3b-f506-4bc1-91d0-4cb5720cdcbf]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:58:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7bfb7904-35ac-4ced-a713-fff745646107 tempest-VolumesActionsTest-1006378351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cc1848bd-b403-43b0-aedd-e03a0d8f8b98 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:58:12 devstack sudo[101266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cc1848bd-b403-43b0-aedd-e03a0d8f8b98 Sep 28 11:58:12 devstack sudo[101266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:58:12 devstack sudo[101266]: pam_unix(sudo:session): session closed for user root Sep 28 11:58:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7bfb7904-35ac-4ced-a713-fff745646107 tempest-VolumesActionsTest-1006378351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cc1848bd-b403-43b0-aedd-e03a0d8f8b98" returned: 0 in 0.467s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:58:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7bfb7904-35ac-4ced-a713-fff745646107 tempest-VolumesActionsTest-1006378351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cc1848bd-b403-43b0-aedd-e03a0d8f8b98 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:58:12 devstack sudo[101271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cc1848bd-b403-43b0-aedd-e03a0d8f8b98 Sep 28 11:58:12 devstack sudo[101271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:58:13 devstack sudo[101271]: pam_unix(sudo:session): session closed for user root Sep 28 11:58:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7bfb7904-35ac-4ced-a713-fff745646107 tempest-VolumesActionsTest-1006378351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cc1848bd-b403-43b0-aedd-e03a0d8f8b98" returned: 0 in 0.332s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:58:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7bfb7904-35ac-4ced-a713-fff745646107 tempest-VolumesActionsTest-1006378351 None] Lock "cinder-quobyte-cc1848bd-b403-43b0-aedd-e03a0d8f8b98" released by "delete_volume" :: held 0.872s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:58:13 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-7bfb7904-35ac-4ced-a713-fff745646107 tempest-VolumesActionsTest-1006378351 None] Created reservations ['aa80a4ee-c135-45e2-a136-ee1f75dd2043', '61ccbfb7-509b-4a8b-b7e9-7d9cff8bf2b9', '852178a1-f1d9-4fcd-9822-6f31569c67ba', '93ff42dd-2b1d-429b-a152-548c760f4a65'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:58:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7bfb7904-35ac-4ced-a713-fff745646107 tempest-VolumesActionsTest-1006378351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:58:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7bfb7904-35ac-4ced-a713-fff745646107 tempest-VolumesActionsTest-1006378351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:58:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7bfb7904-35ac-4ced-a713-fff745646107 tempest-VolumesActionsTest-1006378351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:58:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7bfb7904-35ac-4ced-a713-fff745646107 tempest-VolumesActionsTest-1006378351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:58:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7bfb7904-35ac-4ced-a713-fff745646107 tempest-VolumesActionsTest-1006378351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:58:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7bfb7904-35ac-4ced-a713-fff745646107 tempest-VolumesActionsTest-1006378351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:58:13 devstack sudo[101274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:58:13 devstack sudo[101274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:58:13 devstack sudo[101274]: pam_unix(sudo:session): session closed for user root Sep 28 11:58:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7bfb7904-35ac-4ced-a713-fff745646107 tempest-VolumesActionsTest-1006378351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.449s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:58:13 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-7bfb7904-35ac-4ced-a713-fff745646107 tempest-VolumesActionsTest-1006378351 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:58:13 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-7bfb7904-35ac-4ced-a713-fff745646107 tempest-VolumesActionsTest-1006378351 None] Deleted volume successfully. Sep 28 11:58:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7bfb7904-35ac-4ced-a713-fff745646107 tempest-VolumesActionsTest-1006378351 None] Lock "cinder-cc1848bd-b403-43b0-aedd-e03a0d8f8b98-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:58:14 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc7a870d-a529-4d47-8a2e-e858c4a3b867 tempest-VolumesActionsTest-649771008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:58:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bc7a870d-a529-4d47-8a2e-e858c4a3b867 tempest-VolumesActionsTest-649771008 None] Flow 'volume_create_manager' (36fd4a39-24d3-457a-bd88-5ec112ffd5da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:58:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bc7a870d-a529-4d47-8a2e-e858c4a3b867 tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9ab2941-c5f7-425f-9435-431787d794aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:58:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bc7a870d-a529-4d47-8a2e-e858c4a3b867 tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9ab2941-c5f7-425f-9435-431787d794aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-624214913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a459230-443c-4b0b-9c51-844fb178d4d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2a0e61cc2154702be4628e75f3c318f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:58:14Z,use_quota=True,user_id='dcd554c777564045a38816562cd3a7f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:58:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bc7a870d-a529-4d47-8a2e-e858c4a3b867 tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (638b4ef5-d489-4a15-be4c-51afa3e23bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:58:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bc7a870d-a529-4d47-8a2e-e858c4a3b867 tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (638b4ef5-d489-4a15-be4c-51afa3e23bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:58:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bc7a870d-a529-4d47-8a2e-e858c4a3b867 tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bec799a4-767f-48f0-8166-5511f7527bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:58:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bc7a870d-a529-4d47-8a2e-e858c4a3b867 tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bec799a4-767f-48f0-8166-5511f7527bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a459230-443c-4b0b-9c51-844fb178d4d7', 'volume_name': 'volume-3a459230-443c-4b0b-9c51-844fb178d4d7', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:58:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bc7a870d-a529-4d47-8a2e-e858c4a3b867 tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c6bab81-12c6-4fe5-a7e6-19fa3e38523b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:58:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bc7a870d-a529-4d47-8a2e-e858c4a3b867 tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c6bab81-12c6-4fe5-a7e6-19fa3e38523b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:58:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bc7a870d-a529-4d47-8a2e-e858c4a3b867 tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (945e7749-bf14-4dfb-95b8-001d86dc2dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:58:14 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-bc7a870d-a529-4d47-8a2e-e858c4a3b867 tempest-VolumesActionsTest-649771008 None] Volume 3a459230-443c-4b0b-9c51-844fb178d4d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a459230-443c-4b0b-9c51-844fb178d4d7', 'volume_size': 1} Sep 28 11:58:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bc7a870d-a529-4d47-8a2e-e858c4a3b867 tempest-VolumesActionsTest-649771008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:58:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bc7a870d-a529-4d47-8a2e-e858c4a3b867 tempest-VolumesActionsTest-649771008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:58:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bc7a870d-a529-4d47-8a2e-e858c4a3b867 tempest-VolumesActionsTest-649771008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-624214913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a459230-443c-4b0b-9c51-844fb178d4d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2a0e61cc2154702be4628e75f3c318f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:58:14Z,use_quota=True,user_id='dcd554c777564045a38816562cd3a7f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:58:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-bc7a870d-a529-4d47-8a2e-e858c4a3b867 tempest-VolumesActionsTest-649771008 None] Creating volume 3a459230-443c-4b0b-9c51-844fb178d4d7 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:58:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bc7a870d-a529-4d47-8a2e-e858c4a3b867 tempest-VolumesActionsTest-649771008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:58:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bc7a870d-a529-4d47-8a2e-e858c4a3b867 tempest-VolumesActionsTest-649771008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:58:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bc7a870d-a529-4d47-8a2e-e858c4a3b867 tempest-VolumesActionsTest-649771008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:58:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bc7a870d-a529-4d47-8a2e-e858c4a3b867 tempest-VolumesActionsTest-649771008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:58:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bc7a870d-a529-4d47-8a2e-e858c4a3b867 tempest-VolumesActionsTest-649771008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:58:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bc7a870d-a529-4d47-8a2e-e858c4a3b867 tempest-VolumesActionsTest-649771008 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:58:14 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-bc7a870d-a529-4d47-8a2e-e858c4a3b867 tempest-VolumesActionsTest-649771008 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:58:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bc7a870d-a529-4d47-8a2e-e858c4a3b867 tempest-VolumesActionsTest-649771008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3a459230-443c-4b0b-9c51-844fb178d4d7 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:58:14 devstack sudo[101278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3a459230-443c-4b0b-9c51-844fb178d4d7 1073741824 Sep 28 11:58:14 devstack sudo[101278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:58:15 devstack sudo[101278]: pam_unix(sudo:session): session closed for user root Sep 28 11:58:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bc7a870d-a529-4d47-8a2e-e858c4a3b867 tempest-VolumesActionsTest-649771008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3a459230-443c-4b0b-9c51-844fb178d4d7 1073741824" returned: 0 in 0.639s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:58:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bc7a870d-a529-4d47-8a2e-e858c4a3b867 tempest-VolumesActionsTest-649771008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3a459230-443c-4b0b-9c51-844fb178d4d7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:58:15 devstack sudo[101296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3a459230-443c-4b0b-9c51-844fb178d4d7 Sep 28 11:58:15 devstack sudo[101296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:58:15 devstack sudo[101296]: pam_unix(sudo:session): session closed for user root Sep 28 11:58:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bc7a870d-a529-4d47-8a2e-e858c4a3b867 tempest-VolumesActionsTest-649771008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3a459230-443c-4b0b-9c51-844fb178d4d7" returned: 0 in 0.348s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:58:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bc7a870d-a529-4d47-8a2e-e858c4a3b867 tempest-VolumesActionsTest-649771008 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:58:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bc7a870d-a529-4d47-8a2e-e858c4a3b867 tempest-VolumesActionsTest-649771008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:58:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bc7a870d-a529-4d47-8a2e-e858c4a3b867 tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (945e7749-bf14-4dfb-95b8-001d86dc2dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a459230-443c-4b0b-9c51-844fb178d4d7', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:58:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bc7a870d-a529-4d47-8a2e-e858c4a3b867 tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36d3f6a6-ebac-402e-af15-87cd050a4ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:58:15 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-bc7a870d-a529-4d47-8a2e-e858c4a3b867 tempest-VolumesActionsTest-649771008 None] Volume volume-3a459230-443c-4b0b-9c51-844fb178d4d7 (3a459230-443c-4b0b-9c51-844fb178d4d7): created successfully Sep 28 11:58:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bc7a870d-a529-4d47-8a2e-e858c4a3b867 tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36d3f6a6-ebac-402e-af15-87cd050a4ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:58:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bc7a870d-a529-4d47-8a2e-e858c4a3b867 tempest-VolumesActionsTest-649771008 None] Flow 'volume_create_manager' (36fd4a39-24d3-457a-bd88-5ec112ffd5da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:58:15 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-bc7a870d-a529-4d47-8a2e-e858c4a3b867 tempest-VolumesActionsTest-649771008 None] Created volume successfully. Sep 28 11:58:16 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-661c33fe-3907-46af-8cc8-3bf1e7f91f15 tempest-VolumesCloneNegativeTest-55259517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:58:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-661c33fe-3907-46af-8cc8-3bf1e7f91f15 tempest-VolumesCloneNegativeTest-55259517 None] Flow 'volume_create_manager' (1c83c1aa-03e4-4cec-86ab-49f02f9add16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:58:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-661c33fe-3907-46af-8cc8-3bf1e7f91f15 tempest-VolumesCloneNegativeTest-55259517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fe5e08a-c8ef-4c48-b2d5-d0a87fbe71d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:58:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-661c33fe-3907-46af-8cc8-3bf1e7f91f15 tempest-VolumesCloneNegativeTest-55259517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fe5e08a-c8ef-4c48-b2d5-d0a87fbe71d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-791288775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b807a7e8-885f-42c8-bdb5-09496c2974f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='408e7ded70534f85ae7954550e2b56a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:58:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:58:16Z,use_quota=True,user_id='54f0ac8f8a574e3d838ea58ac9286f0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:58:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-661c33fe-3907-46af-8cc8-3bf1e7f91f15 tempest-VolumesCloneNegativeTest-55259517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9320495-fbfc-463a-bd13-c41422d5e7d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:58:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-661c33fe-3907-46af-8cc8-3bf1e7f91f15 tempest-VolumesCloneNegativeTest-55259517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9320495-fbfc-463a-bd13-c41422d5e7d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:58:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-661c33fe-3907-46af-8cc8-3bf1e7f91f15 tempest-VolumesCloneNegativeTest-55259517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f054873-eaa7-4ec4-97f4-2abb4f644a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:58:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-661c33fe-3907-46af-8cc8-3bf1e7f91f15 tempest-VolumesCloneNegativeTest-55259517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f054873-eaa7-4ec4-97f4-2abb4f644a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b807a7e8-885f-42c8-bdb5-09496c2974f8', 'volume_name': 'volume-b807a7e8-885f-42c8-bdb5-09496c2974f8', 'volume_size': 2}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:58:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-661c33fe-3907-46af-8cc8-3bf1e7f91f15 tempest-VolumesCloneNegativeTest-55259517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c5cfb4e-a933-4f9d-8e48-a1440b378d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:58:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-661c33fe-3907-46af-8cc8-3bf1e7f91f15 tempest-VolumesCloneNegativeTest-55259517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c5cfb4e-a933-4f9d-8e48-a1440b378d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:58:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-661c33fe-3907-46af-8cc8-3bf1e7f91f15 tempest-VolumesCloneNegativeTest-55259517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (977d80dc-295a-458b-83cc-987f4c006fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:58:16 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-661c33fe-3907-46af-8cc8-3bf1e7f91f15 tempest-VolumesCloneNegativeTest-55259517 None] Volume b807a7e8-885f-42c8-bdb5-09496c2974f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b807a7e8-885f-42c8-bdb5-09496c2974f8', 'volume_size': 2} Sep 28 11:58:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-661c33fe-3907-46af-8cc8-3bf1e7f91f15 tempest-VolumesCloneNegativeTest-55259517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:58:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-661c33fe-3907-46af-8cc8-3bf1e7f91f15 tempest-VolumesCloneNegativeTest-55259517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:58:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-661c33fe-3907-46af-8cc8-3bf1e7f91f15 tempest-VolumesCloneNegativeTest-55259517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-791288775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b807a7e8-885f-42c8-bdb5-09496c2974f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='408e7ded70534f85ae7954550e2b56a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:58:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:58:16Z,use_quota=True,user_id='54f0ac8f8a574e3d838ea58ac9286f0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:58:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-661c33fe-3907-46af-8cc8-3bf1e7f91f15 tempest-VolumesCloneNegativeTest-55259517 None] Creating volume b807a7e8-885f-42c8-bdb5-09496c2974f8 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:58:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-661c33fe-3907-46af-8cc8-3bf1e7f91f15 tempest-VolumesCloneNegativeTest-55259517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:58:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-661c33fe-3907-46af-8cc8-3bf1e7f91f15 tempest-VolumesCloneNegativeTest-55259517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:58:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-661c33fe-3907-46af-8cc8-3bf1e7f91f15 tempest-VolumesCloneNegativeTest-55259517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:58:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-661c33fe-3907-46af-8cc8-3bf1e7f91f15 tempest-VolumesCloneNegativeTest-55259517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:58:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-661c33fe-3907-46af-8cc8-3bf1e7f91f15 tempest-VolumesCloneNegativeTest-55259517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:58:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-661c33fe-3907-46af-8cc8-3bf1e7f91f15 tempest-VolumesCloneNegativeTest-55259517 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:58:16 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-661c33fe-3907-46af-8cc8-3bf1e7f91f15 tempest-VolumesCloneNegativeTest-55259517 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:58:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-661c33fe-3907-46af-8cc8-3bf1e7f91f15 tempest-VolumesCloneNegativeTest-55259517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b807a7e8-885f-42c8-bdb5-09496c2974f8 2147483648 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:58:16 devstack sudo[101333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b807a7e8-885f-42c8-bdb5-09496c2974f8 2147483648 Sep 28 11:58:16 devstack sudo[101333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:58:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3db0f09d-df41-4898-a515-bbc1085625c5 tempest-VolumesActionsTest-1006378351 None] Acquiring lock "cinder-3a459230-443c-4b0b-9c51-844fb178d4d7-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:58:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3db0f09d-df41-4898-a515-bbc1085625c5 tempest-VolumesActionsTest-1006378351 None] Lock "cinder-3a459230-443c-4b0b-9c51-844fb178d4d7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:58:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3db0f09d-df41-4898-a515-bbc1085625c5 tempest-VolumesActionsTest-1006378351 None] Acquiring lock "cinder-quobyte-3a459230-443c-4b0b-9c51-844fb178d4d7" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:58:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3db0f09d-df41-4898-a515-bbc1085625c5 tempest-VolumesActionsTest-1006378351 None] Lock "cinder-quobyte-3a459230-443c-4b0b-9c51-844fb178d4d7" acquired by "delete_volume" :: waited 0.036s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:58:17 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceaa559b-c2b1-4fb9-bf35-7d40f978dfac]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:58:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3db0f09d-df41-4898-a515-bbc1085625c5 tempest-VolumesActionsTest-1006378351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3a459230-443c-4b0b-9c51-844fb178d4d7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:58:17 devstack sudo[101368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3a459230-443c-4b0b-9c51-844fb178d4d7 Sep 28 11:58:17 devstack sudo[101368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:58:17 devstack sudo[101333]: pam_unix(sudo:session): session closed for user root Sep 28 11:58:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-661c33fe-3907-46af-8cc8-3bf1e7f91f15 tempest-VolumesCloneNegativeTest-55259517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b807a7e8-885f-42c8-bdb5-09496c2974f8 2147483648" returned: 0 in 1.048s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:58:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-661c33fe-3907-46af-8cc8-3bf1e7f91f15 tempest-VolumesCloneNegativeTest-55259517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b807a7e8-885f-42c8-bdb5-09496c2974f8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:58:17 devstack sudo[101384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b807a7e8-885f-42c8-bdb5-09496c2974f8 Sep 28 11:58:17 devstack sudo[101384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:58:17 devstack sudo[101368]: pam_unix(sudo:session): session closed for user root Sep 28 11:58:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3db0f09d-df41-4898-a515-bbc1085625c5 tempest-VolumesActionsTest-1006378351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3a459230-443c-4b0b-9c51-844fb178d4d7" returned: 0 in 0.633s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:58:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3db0f09d-df41-4898-a515-bbc1085625c5 tempest-VolumesActionsTest-1006378351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3a459230-443c-4b0b-9c51-844fb178d4d7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:58:17 devstack sudo[101399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3a459230-443c-4b0b-9c51-844fb178d4d7 Sep 28 11:58:17 devstack sudo[101399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:58:17 devstack sudo[101384]: pam_unix(sudo:session): session closed for user root Sep 28 11:58:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-661c33fe-3907-46af-8cc8-3bf1e7f91f15 tempest-VolumesCloneNegativeTest-55259517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b807a7e8-885f-42c8-bdb5-09496c2974f8" returned: 0 in 0.302s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:58:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-661c33fe-3907-46af-8cc8-3bf1e7f91f15 tempest-VolumesCloneNegativeTest-55259517 None] <== create_volume: return (1421ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:58:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-661c33fe-3907-46af-8cc8-3bf1e7f91f15 tempest-VolumesCloneNegativeTest-55259517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.427s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:58:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-661c33fe-3907-46af-8cc8-3bf1e7f91f15 tempest-VolumesCloneNegativeTest-55259517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (977d80dc-295a-458b-83cc-987f4c006fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b807a7e8-885f-42c8-bdb5-09496c2974f8', 'volume_size': 2}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:58:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-661c33fe-3907-46af-8cc8-3bf1e7f91f15 tempest-VolumesCloneNegativeTest-55259517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a11a37d-1247-494f-96a7-67a039d2acdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:58:18 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-661c33fe-3907-46af-8cc8-3bf1e7f91f15 tempest-VolumesCloneNegativeTest-55259517 None] Volume volume-b807a7e8-885f-42c8-bdb5-09496c2974f8 (b807a7e8-885f-42c8-bdb5-09496c2974f8): created successfully Sep 28 11:58:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-661c33fe-3907-46af-8cc8-3bf1e7f91f15 tempest-VolumesCloneNegativeTest-55259517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a11a37d-1247-494f-96a7-67a039d2acdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:58:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-661c33fe-3907-46af-8cc8-3bf1e7f91f15 tempest-VolumesCloneNegativeTest-55259517 None] Flow 'volume_create_manager' (1c83c1aa-03e4-4cec-86ab-49f02f9add16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:58:18 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-661c33fe-3907-46af-8cc8-3bf1e7f91f15 tempest-VolumesCloneNegativeTest-55259517 None] Created volume successfully. Sep 28 11:58:18 devstack sudo[101399]: pam_unix(sudo:session): session closed for user root Sep 28 11:58:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3db0f09d-df41-4898-a515-bbc1085625c5 tempest-VolumesActionsTest-1006378351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3a459230-443c-4b0b-9c51-844fb178d4d7" returned: 0 in 0.286s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:58:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3db0f09d-df41-4898-a515-bbc1085625c5 tempest-VolumesActionsTest-1006378351 None] Lock "cinder-quobyte-3a459230-443c-4b0b-9c51-844fb178d4d7" released by "delete_volume" :: held 1.018s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:58:18 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-3db0f09d-df41-4898-a515-bbc1085625c5 tempest-VolumesActionsTest-1006378351 None] Created reservations ['739de188-a387-49ff-b582-cbdfdc35e845', 'fe3d9d5a-a145-457e-953e-dd5bf62becdd', 'a7e0bf89-52ec-4049-9dc6-d9f0072cba03', '15a22501-e068-4d4f-8652-277775623b4d'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:58:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3db0f09d-df41-4898-a515-bbc1085625c5 tempest-VolumesActionsTest-1006378351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:58:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3db0f09d-df41-4898-a515-bbc1085625c5 tempest-VolumesActionsTest-1006378351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:58:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3db0f09d-df41-4898-a515-bbc1085625c5 tempest-VolumesActionsTest-1006378351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:58:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3db0f09d-df41-4898-a515-bbc1085625c5 tempest-VolumesActionsTest-1006378351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:58:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3db0f09d-df41-4898-a515-bbc1085625c5 tempest-VolumesActionsTest-1006378351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:58:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3db0f09d-df41-4898-a515-bbc1085625c5 tempest-VolumesActionsTest-1006378351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:58:18 devstack sudo[101418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:58:18 devstack sudo[101418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:58:18 devstack sudo[101418]: pam_unix(sudo:session): session closed for user root Sep 28 11:58:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3db0f09d-df41-4898-a515-bbc1085625c5 tempest-VolumesActionsTest-1006378351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.268s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:58:18 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-3db0f09d-df41-4898-a515-bbc1085625c5 tempest-VolumesActionsTest-1006378351 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:58:18 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-3db0f09d-df41-4898-a515-bbc1085625c5 tempest-VolumesActionsTest-1006378351 None] Deleted volume successfully. Sep 28 11:58:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3db0f09d-df41-4898-a515-bbc1085625c5 tempest-VolumesActionsTest-1006378351 None] Lock "cinder-3a459230-443c-4b0b-9c51-844fb178d4d7-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:58:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1124dfc0-82d2-4be1-85b8-f80f6bfeb377 tempest-VolumesCloneNegativeTest-55259517 None] Acquiring lock "cinder-b807a7e8-885f-42c8-bdb5-09496c2974f8-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:58:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1124dfc0-82d2-4be1-85b8-f80f6bfeb377 tempest-VolumesCloneNegativeTest-55259517 None] Lock "cinder-b807a7e8-885f-42c8-bdb5-09496c2974f8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:58:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1124dfc0-82d2-4be1-85b8-f80f6bfeb377 tempest-VolumesCloneNegativeTest-55259517 None] Acquiring lock "cinder-quobyte-b807a7e8-885f-42c8-bdb5-09496c2974f8" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:58:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1124dfc0-82d2-4be1-85b8-f80f6bfeb377 tempest-VolumesCloneNegativeTest-55259517 None] Lock "cinder-quobyte-b807a7e8-885f-42c8-bdb5-09496c2974f8" acquired by "delete_volume" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:58:18 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37cb243-717e-4e1f-b98b-e9437083acfd]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:58:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1124dfc0-82d2-4be1-85b8-f80f6bfeb377 tempest-VolumesCloneNegativeTest-55259517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b807a7e8-885f-42c8-bdb5-09496c2974f8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:58:18 devstack sudo[101421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b807a7e8-885f-42c8-bdb5-09496c2974f8 Sep 28 11:58:18 devstack sudo[101421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:58:19 devstack sudo[101421]: pam_unix(sudo:session): session closed for user root Sep 28 11:58:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1124dfc0-82d2-4be1-85b8-f80f6bfeb377 tempest-VolumesCloneNegativeTest-55259517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b807a7e8-885f-42c8-bdb5-09496c2974f8" returned: 0 in 0.509s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:58:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1124dfc0-82d2-4be1-85b8-f80f6bfeb377 tempest-VolumesCloneNegativeTest-55259517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b807a7e8-885f-42c8-bdb5-09496c2974f8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:58:19 devstack sudo[101428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b807a7e8-885f-42c8-bdb5-09496c2974f8 Sep 28 11:58:19 devstack sudo[101428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:58:19 devstack sudo[101428]: pam_unix(sudo:session): session closed for user root Sep 28 11:58:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1124dfc0-82d2-4be1-85b8-f80f6bfeb377 tempest-VolumesCloneNegativeTest-55259517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b807a7e8-885f-42c8-bdb5-09496c2974f8" returned: 0 in 0.373s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:58:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1124dfc0-82d2-4be1-85b8-f80f6bfeb377 tempest-VolumesCloneNegativeTest-55259517 None] Lock "cinder-quobyte-b807a7e8-885f-42c8-bdb5-09496c2974f8" released by "delete_volume" :: held 0.945s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:58:19 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-1124dfc0-82d2-4be1-85b8-f80f6bfeb377 tempest-VolumesCloneNegativeTest-55259517 None] Created reservations ['b8e128cd-298b-4b6d-a330-242f6dd04e7e', '1938b029-8839-475e-a45f-1857900e4046', '0f163661-4e78-49b5-a1ad-b5aa131eea71', '5c66f4e9-cde2-48bb-ac74-01dba6461f6a'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:58:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1124dfc0-82d2-4be1-85b8-f80f6bfeb377 tempest-VolumesCloneNegativeTest-55259517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:58:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1124dfc0-82d2-4be1-85b8-f80f6bfeb377 tempest-VolumesCloneNegativeTest-55259517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:58:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1124dfc0-82d2-4be1-85b8-f80f6bfeb377 tempest-VolumesCloneNegativeTest-55259517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:58:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1124dfc0-82d2-4be1-85b8-f80f6bfeb377 tempest-VolumesCloneNegativeTest-55259517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:58:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1124dfc0-82d2-4be1-85b8-f80f6bfeb377 tempest-VolumesCloneNegativeTest-55259517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:58:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1124dfc0-82d2-4be1-85b8-f80f6bfeb377 tempest-VolumesCloneNegativeTest-55259517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:58:20 devstack sudo[101432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:58:20 devstack sudo[101432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:58:20 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-045572f2-4d6f-44e8-a6d2-e9bb290698bd tempest-VolumesActionsTest-649771008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:58:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-045572f2-4d6f-44e8-a6d2-e9bb290698bd tempest-VolumesActionsTest-649771008 None] Flow 'volume_create_manager' (6026e398-6645-4da4-ab4d-1612a752d3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:58:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-045572f2-4d6f-44e8-a6d2-e9bb290698bd tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (180d8e4f-1545-461a-bff1-d71414548663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:58:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-045572f2-4d6f-44e8-a6d2-e9bb290698bd tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (180d8e4f-1545-461a-bff1-d71414548663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-640028909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=153c1185-2e39-4012-9a1a-81a43ddf3d59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2a0e61cc2154702be4628e75f3c318f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:58:20Z,use_quota=True,user_id='dcd554c777564045a38816562cd3a7f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:58:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-045572f2-4d6f-44e8-a6d2-e9bb290698bd tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f5a22f2-51a7-4f8b-b7ed-d157722eed34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:58:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-045572f2-4d6f-44e8-a6d2-e9bb290698bd tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f5a22f2-51a7-4f8b-b7ed-d157722eed34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:58:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-045572f2-4d6f-44e8-a6d2-e9bb290698bd tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f63c4b90-b3af-4b53-9510-281d980d8a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:58:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-045572f2-4d6f-44e8-a6d2-e9bb290698bd tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f63c4b90-b3af-4b53-9510-281d980d8a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '153c1185-2e39-4012-9a1a-81a43ddf3d59', 'volume_name': 'volume-153c1185-2e39-4012-9a1a-81a43ddf3d59', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:58:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-045572f2-4d6f-44e8-a6d2-e9bb290698bd tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f60995fe-de29-4eb2-ac30-f24d70435ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:58:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-045572f2-4d6f-44e8-a6d2-e9bb290698bd tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f60995fe-de29-4eb2-ac30-f24d70435ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:58:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-045572f2-4d6f-44e8-a6d2-e9bb290698bd tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b41b19e2-2689-44de-bf7d-98f36c3e8317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:58:20 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-045572f2-4d6f-44e8-a6d2-e9bb290698bd tempest-VolumesActionsTest-649771008 None] Volume 153c1185-2e39-4012-9a1a-81a43ddf3d59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-153c1185-2e39-4012-9a1a-81a43ddf3d59', 'volume_size': 1} Sep 28 11:58:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-045572f2-4d6f-44e8-a6d2-e9bb290698bd tempest-VolumesActionsTest-649771008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:58:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-045572f2-4d6f-44e8-a6d2-e9bb290698bd tempest-VolumesActionsTest-649771008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:58:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-045572f2-4d6f-44e8-a6d2-e9bb290698bd tempest-VolumesActionsTest-649771008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-640028909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=153c1185-2e39-4012-9a1a-81a43ddf3d59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2a0e61cc2154702be4628e75f3c318f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:58:20Z,use_quota=True,user_id='dcd554c777564045a38816562cd3a7f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:58:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-045572f2-4d6f-44e8-a6d2-e9bb290698bd tempest-VolumesActionsTest-649771008 None] Creating volume 153c1185-2e39-4012-9a1a-81a43ddf3d59 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:58:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-045572f2-4d6f-44e8-a6d2-e9bb290698bd tempest-VolumesActionsTest-649771008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:58:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-045572f2-4d6f-44e8-a6d2-e9bb290698bd tempest-VolumesActionsTest-649771008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:58:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-045572f2-4d6f-44e8-a6d2-e9bb290698bd tempest-VolumesActionsTest-649771008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:58:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-045572f2-4d6f-44e8-a6d2-e9bb290698bd tempest-VolumesActionsTest-649771008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:58:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-045572f2-4d6f-44e8-a6d2-e9bb290698bd tempest-VolumesActionsTest-649771008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:58:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-045572f2-4d6f-44e8-a6d2-e9bb290698bd tempest-VolumesActionsTest-649771008 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:58:20 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-045572f2-4d6f-44e8-a6d2-e9bb290698bd tempest-VolumesActionsTest-649771008 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:58:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-045572f2-4d6f-44e8-a6d2-e9bb290698bd tempest-VolumesActionsTest-649771008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-153c1185-2e39-4012-9a1a-81a43ddf3d59 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:58:20 devstack sudo[101432]: pam_unix(sudo:session): session closed for user root Sep 28 11:58:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1124dfc0-82d2-4be1-85b8-f80f6bfeb377 tempest-VolumesCloneNegativeTest-55259517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.333s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:58:20 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-1124dfc0-82d2-4be1-85b8-f80f6bfeb377 tempest-VolumesCloneNegativeTest-55259517 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:58:20 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-1124dfc0-82d2-4be1-85b8-f80f6bfeb377 tempest-VolumesCloneNegativeTest-55259517 None] Deleted volume successfully. Sep 28 11:58:20 devstack sudo[101435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-153c1185-2e39-4012-9a1a-81a43ddf3d59 1073741824 Sep 28 11:58:20 devstack sudo[101435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:58:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1124dfc0-82d2-4be1-85b8-f80f6bfeb377 tempest-VolumesCloneNegativeTest-55259517 None] Lock "cinder-b807a7e8-885f-42c8-bdb5-09496c2974f8-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:58:20 devstack sudo[101435]: pam_unix(sudo:session): session closed for user root Sep 28 11:58:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-045572f2-4d6f-44e8-a6d2-e9bb290698bd tempest-VolumesActionsTest-649771008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-153c1185-2e39-4012-9a1a-81a43ddf3d59 1073741824" returned: 0 in 0.569s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:58:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-045572f2-4d6f-44e8-a6d2-e9bb290698bd tempest-VolumesActionsTest-649771008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-153c1185-2e39-4012-9a1a-81a43ddf3d59 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:58:20 devstack sudo[101441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-153c1185-2e39-4012-9a1a-81a43ddf3d59 Sep 28 11:58:20 devstack sudo[101441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:58:21 devstack sudo[101441]: pam_unix(sudo:session): session closed for user root Sep 28 11:58:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-045572f2-4d6f-44e8-a6d2-e9bb290698bd tempest-VolumesActionsTest-649771008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-153c1185-2e39-4012-9a1a-81a43ddf3d59" returned: 0 in 0.334s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:58:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-045572f2-4d6f-44e8-a6d2-e9bb290698bd tempest-VolumesActionsTest-649771008 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:58:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-045572f2-4d6f-44e8-a6d2-e9bb290698bd tempest-VolumesActionsTest-649771008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:58:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-045572f2-4d6f-44e8-a6d2-e9bb290698bd tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b41b19e2-2689-44de-bf7d-98f36c3e8317) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-153c1185-2e39-4012-9a1a-81a43ddf3d59', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:58:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-045572f2-4d6f-44e8-a6d2-e9bb290698bd tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69b509e4-4e50-4488-a9a4-aae239a93631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:58:21 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-045572f2-4d6f-44e8-a6d2-e9bb290698bd tempest-VolumesActionsTest-649771008 None] Volume volume-153c1185-2e39-4012-9a1a-81a43ddf3d59 (153c1185-2e39-4012-9a1a-81a43ddf3d59): created successfully Sep 28 11:58:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-045572f2-4d6f-44e8-a6d2-e9bb290698bd tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69b509e4-4e50-4488-a9a4-aae239a93631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:58:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-045572f2-4d6f-44e8-a6d2-e9bb290698bd tempest-VolumesActionsTest-649771008 None] Flow 'volume_create_manager' (6026e398-6645-4da4-ab4d-1612a752d3da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:58:21 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-045572f2-4d6f-44e8-a6d2-e9bb290698bd tempest-VolumesActionsTest-649771008 None] Created volume successfully. Sep 28 11:58:21 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-252e1002-cc2d-4e65-acd4-d32183104473 tempest-TestMinimumBasicScenario-1300663101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:58:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-252e1002-cc2d-4e65-acd4-d32183104473 tempest-TestMinimumBasicScenario-1300663101 None] Flow 'volume_create_manager' (e0f1617f-e5e1-4d97-abaa-93d5f86976b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:58:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-252e1002-cc2d-4e65-acd4-d32183104473 tempest-TestMinimumBasicScenario-1300663101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79b66634-e48c-466c-9a82-2a204b50f6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:58:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-252e1002-cc2d-4e65-acd4-d32183104473 tempest-TestMinimumBasicScenario-1300663101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79b66634-e48c-466c-9a82-2a204b50f6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:58:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-487548770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fe75320-b09b-42c5-8597-38489f79e35e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fddeb3fd58d04cbfa5acadf1b77b6a32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:58:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:58:22Z,use_quota=True,user_id='9038d92c65154a4782ff9bc07fd908a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:58:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-252e1002-cc2d-4e65-acd4-d32183104473 tempest-TestMinimumBasicScenario-1300663101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb59a47a-6b6d-4491-829c-d28b765ec757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:58:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-252e1002-cc2d-4e65-acd4-d32183104473 tempest-TestMinimumBasicScenario-1300663101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb59a47a-6b6d-4491-829c-d28b765ec757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:58:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-252e1002-cc2d-4e65-acd4-d32183104473 tempest-TestMinimumBasicScenario-1300663101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (896bebdd-63e9-41ec-ac9e-a71e83701f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:58:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-252e1002-cc2d-4e65-acd4-d32183104473 tempest-TestMinimumBasicScenario-1300663101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (896bebdd-63e9-41ec-ac9e-a71e83701f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fe75320-b09b-42c5-8597-38489f79e35e', 'volume_name': 'volume-5fe75320-b09b-42c5-8597-38489f79e35e', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:58:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-252e1002-cc2d-4e65-acd4-d32183104473 tempest-TestMinimumBasicScenario-1300663101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e16fb304-4608-40a6-88d6-5f1e10c94c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:58:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-252e1002-cc2d-4e65-acd4-d32183104473 tempest-TestMinimumBasicScenario-1300663101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e16fb304-4608-40a6-88d6-5f1e10c94c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:58:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-252e1002-cc2d-4e65-acd4-d32183104473 tempest-TestMinimumBasicScenario-1300663101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf267906-04c8-40e8-9e52-cd3206fedc9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:58:21 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-252e1002-cc2d-4e65-acd4-d32183104473 tempest-TestMinimumBasicScenario-1300663101 None] Volume 5fe75320-b09b-42c5-8597-38489f79e35e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fe75320-b09b-42c5-8597-38489f79e35e', 'volume_size': 1} Sep 28 11:58:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-252e1002-cc2d-4e65-acd4-d32183104473 tempest-TestMinimumBasicScenario-1300663101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:58:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-252e1002-cc2d-4e65-acd4-d32183104473 tempest-TestMinimumBasicScenario-1300663101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:58:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-252e1002-cc2d-4e65-acd4-d32183104473 tempest-TestMinimumBasicScenario-1300663101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:58:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-487548770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fe75320-b09b-42c5-8597-38489f79e35e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fddeb3fd58d04cbfa5acadf1b77b6a32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:58:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:58:22Z,use_quota=True,user_id='9038d92c65154a4782ff9bc07fd908a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:58:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-252e1002-cc2d-4e65-acd4-d32183104473 tempest-TestMinimumBasicScenario-1300663101 None] Creating volume 5fe75320-b09b-42c5-8597-38489f79e35e {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:58:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-252e1002-cc2d-4e65-acd4-d32183104473 tempest-TestMinimumBasicScenario-1300663101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:58:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-252e1002-cc2d-4e65-acd4-d32183104473 tempest-TestMinimumBasicScenario-1300663101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:58:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-252e1002-cc2d-4e65-acd4-d32183104473 tempest-TestMinimumBasicScenario-1300663101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:58:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-252e1002-cc2d-4e65-acd4-d32183104473 tempest-TestMinimumBasicScenario-1300663101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:58:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-252e1002-cc2d-4e65-acd4-d32183104473 tempest-TestMinimumBasicScenario-1300663101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:58:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-252e1002-cc2d-4e65-acd4-d32183104473 tempest-TestMinimumBasicScenario-1300663101 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:58:21 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-252e1002-cc2d-4e65-acd4-d32183104473 tempest-TestMinimumBasicScenario-1300663101 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:58:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-252e1002-cc2d-4e65-acd4-d32183104473 tempest-TestMinimumBasicScenario-1300663101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5fe75320-b09b-42c5-8597-38489f79e35e 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:58:21 devstack sudo[101444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5fe75320-b09b-42c5-8597-38489f79e35e 1073741824 Sep 28 11:58:21 devstack sudo[101444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:58:22 devstack sudo[101444]: pam_unix(sudo:session): session closed for user root Sep 28 11:58:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-252e1002-cc2d-4e65-acd4-d32183104473 tempest-TestMinimumBasicScenario-1300663101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5fe75320-b09b-42c5-8597-38489f79e35e 1073741824" returned: 0 in 0.616s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:58:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1451665f-3f31-466a-9084-faa4d2f800f9 tempest-VolumesActionsTest-1006378351 None] Acquiring lock "cinder-153c1185-2e39-4012-9a1a-81a43ddf3d59-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:58:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1451665f-3f31-466a-9084-faa4d2f800f9 tempest-VolumesActionsTest-1006378351 None] Lock "cinder-153c1185-2e39-4012-9a1a-81a43ddf3d59-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:58:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-252e1002-cc2d-4e65-acd4-d32183104473 tempest-TestMinimumBasicScenario-1300663101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5fe75320-b09b-42c5-8597-38489f79e35e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:58:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1451665f-3f31-466a-9084-faa4d2f800f9 tempest-VolumesActionsTest-1006378351 None] Acquiring lock "cinder-quobyte-153c1185-2e39-4012-9a1a-81a43ddf3d59" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:58:22 devstack sudo[101450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5fe75320-b09b-42c5-8597-38489f79e35e Sep 28 11:58:22 devstack sudo[101450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:58:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1451665f-3f31-466a-9084-faa4d2f800f9 tempest-VolumesActionsTest-1006378351 None] Lock "cinder-quobyte-153c1185-2e39-4012-9a1a-81a43ddf3d59" acquired by "delete_volume" :: waited 0.029s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:58:22 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[15156f7d-a9c0-43a8-b0a6-95cdeae194d5]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:58:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1451665f-3f31-466a-9084-faa4d2f800f9 tempest-VolumesActionsTest-1006378351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-153c1185-2e39-4012-9a1a-81a43ddf3d59 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:58:22 devstack sudo[101452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-153c1185-2e39-4012-9a1a-81a43ddf3d59 Sep 28 11:58:22 devstack sudo[101452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:58:22 devstack sudo[101450]: pam_unix(sudo:session): session closed for user root Sep 28 11:58:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-252e1002-cc2d-4e65-acd4-d32183104473 tempest-TestMinimumBasicScenario-1300663101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5fe75320-b09b-42c5-8597-38489f79e35e" returned: 0 in 0.332s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:58:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-252e1002-cc2d-4e65-acd4-d32183104473 tempest-TestMinimumBasicScenario-1300663101 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:58:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-252e1002-cc2d-4e65-acd4-d32183104473 tempest-TestMinimumBasicScenario-1300663101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:58:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-252e1002-cc2d-4e65-acd4-d32183104473 tempest-TestMinimumBasicScenario-1300663101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf267906-04c8-40e8-9e52-cd3206fedc9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fe75320-b09b-42c5-8597-38489f79e35e', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:58:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-252e1002-cc2d-4e65-acd4-d32183104473 tempest-TestMinimumBasicScenario-1300663101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdaf4111-a30c-4375-9918-2f101895101b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:58:22 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-252e1002-cc2d-4e65-acd4-d32183104473 tempest-TestMinimumBasicScenario-1300663101 None] Volume volume-5fe75320-b09b-42c5-8597-38489f79e35e (5fe75320-b09b-42c5-8597-38489f79e35e): created successfully Sep 28 11:58:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-252e1002-cc2d-4e65-acd4-d32183104473 tempest-TestMinimumBasicScenario-1300663101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdaf4111-a30c-4375-9918-2f101895101b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:58:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-252e1002-cc2d-4e65-acd4-d32183104473 tempest-TestMinimumBasicScenario-1300663101 None] Flow 'volume_create_manager' (e0f1617f-e5e1-4d97-abaa-93d5f86976b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:58:23 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-252e1002-cc2d-4e65-acd4-d32183104473 tempest-TestMinimumBasicScenario-1300663101 None] Created volume successfully. Sep 28 11:58:23 devstack sudo[101452]: pam_unix(sudo:session): session closed for user root Sep 28 11:58:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1451665f-3f31-466a-9084-faa4d2f800f9 tempest-VolumesActionsTest-1006378351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-153c1185-2e39-4012-9a1a-81a43ddf3d59" returned: 0 in 0.503s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:58:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1451665f-3f31-466a-9084-faa4d2f800f9 tempest-VolumesActionsTest-1006378351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-153c1185-2e39-4012-9a1a-81a43ddf3d59 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:58:23 devstack sudo[101458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-153c1185-2e39-4012-9a1a-81a43ddf3d59 Sep 28 11:58:23 devstack sudo[101458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:58:23 devstack sudo[101458]: pam_unix(sudo:session): session closed for user root Sep 28 11:58:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1451665f-3f31-466a-9084-faa4d2f800f9 tempest-VolumesActionsTest-1006378351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-153c1185-2e39-4012-9a1a-81a43ddf3d59" returned: 0 in 0.279s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:58:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1451665f-3f31-466a-9084-faa4d2f800f9 tempest-VolumesActionsTest-1006378351 None] Lock "cinder-quobyte-153c1185-2e39-4012-9a1a-81a43ddf3d59" released by "delete_volume" :: held 0.854s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:58:23 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-1451665f-3f31-466a-9084-faa4d2f800f9 tempest-VolumesActionsTest-1006378351 None] Created reservations ['d0b6c787-d536-485d-93e2-d50e1a0bd344', '820e49f2-1248-4de1-9d28-f15b0ed7894f', '4a0bb945-2109-49df-8a6d-cf31f708b903', '67ba6979-899f-46ab-88c3-dd580201c800'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:58:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1451665f-3f31-466a-9084-faa4d2f800f9 tempest-VolumesActionsTest-1006378351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:58:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1451665f-3f31-466a-9084-faa4d2f800f9 tempest-VolumesActionsTest-1006378351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:58:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1451665f-3f31-466a-9084-faa4d2f800f9 tempest-VolumesActionsTest-1006378351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:58:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1451665f-3f31-466a-9084-faa4d2f800f9 tempest-VolumesActionsTest-1006378351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:58:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1451665f-3f31-466a-9084-faa4d2f800f9 tempest-VolumesActionsTest-1006378351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:58:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1451665f-3f31-466a-9084-faa4d2f800f9 tempest-VolumesActionsTest-1006378351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:58:23 devstack sudo[101461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:58:23 devstack sudo[101461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:58:23 devstack sudo[101461]: pam_unix(sudo:session): session closed for user root Sep 28 11:58:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1451665f-3f31-466a-9084-faa4d2f800f9 tempest-VolumesActionsTest-1006378351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.343s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:58:23 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-1451665f-3f31-466a-9084-faa4d2f800f9 tempest-VolumesActionsTest-1006378351 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:58:24 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-1451665f-3f31-466a-9084-faa4d2f800f9 tempest-VolumesActionsTest-1006378351 None] Deleted volume successfully. Sep 28 11:58:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1451665f-3f31-466a-9084-faa4d2f800f9 tempest-VolumesActionsTest-1006378351 None] Lock "cinder-153c1185-2e39-4012-9a1a-81a43ddf3d59-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:58:24 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-5abb0928-bd02-463a-9204-7297f59e6cf5 tempest-VolumesActionsTest-649771008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:58:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5abb0928-bd02-463a-9204-7297f59e6cf5 tempest-VolumesActionsTest-649771008 None] Flow 'volume_create_manager' (69f77041-d439-4f3a-8598-59303174d627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:58:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5abb0928-bd02-463a-9204-7297f59e6cf5 tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8ff108c-28df-499a-af23-235c0518e732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:58:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5abb0928-bd02-463a-9204-7297f59e6cf5 tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8ff108c-28df-499a-af23-235c0518e732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:58:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1135475689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d6789de-6460-43cb-a256-d50100803bc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2a0e61cc2154702be4628e75f3c318f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:58:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:58:25Z,use_quota=True,user_id='dcd554c777564045a38816562cd3a7f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:58:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5abb0928-bd02-463a-9204-7297f59e6cf5 tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd8c9942-1ea5-4a29-9324-af140d9083b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:58:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5abb0928-bd02-463a-9204-7297f59e6cf5 tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd8c9942-1ea5-4a29-9324-af140d9083b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:58:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5abb0928-bd02-463a-9204-7297f59e6cf5 tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9815742b-207b-4a74-9f5e-9a2697bd8df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:58:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5abb0928-bd02-463a-9204-7297f59e6cf5 tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9815742b-207b-4a74-9f5e-9a2697bd8df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d6789de-6460-43cb-a256-d50100803bc5', 'volume_name': 'volume-4d6789de-6460-43cb-a256-d50100803bc5', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:58:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5abb0928-bd02-463a-9204-7297f59e6cf5 tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (805276b5-352e-4c40-ae3e-e8aa71b277e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:58:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5abb0928-bd02-463a-9204-7297f59e6cf5 tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (805276b5-352e-4c40-ae3e-e8aa71b277e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:58:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5abb0928-bd02-463a-9204-7297f59e6cf5 tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (133c928d-8acf-40f9-a53e-e3234a8e52c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:58:24 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-5abb0928-bd02-463a-9204-7297f59e6cf5 tempest-VolumesActionsTest-649771008 None] Volume 4d6789de-6460-43cb-a256-d50100803bc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d6789de-6460-43cb-a256-d50100803bc5', 'volume_size': 1} Sep 28 11:58:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5abb0928-bd02-463a-9204-7297f59e6cf5 tempest-VolumesActionsTest-649771008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:58:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5abb0928-bd02-463a-9204-7297f59e6cf5 tempest-VolumesActionsTest-649771008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:58:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5abb0928-bd02-463a-9204-7297f59e6cf5 tempest-VolumesActionsTest-649771008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:58:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1135475689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d6789de-6460-43cb-a256-d50100803bc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2a0e61cc2154702be4628e75f3c318f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:58:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:58:25Z,use_quota=True,user_id='dcd554c777564045a38816562cd3a7f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:58:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-5abb0928-bd02-463a-9204-7297f59e6cf5 tempest-VolumesActionsTest-649771008 None] Creating volume 4d6789de-6460-43cb-a256-d50100803bc5 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:58:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5abb0928-bd02-463a-9204-7297f59e6cf5 tempest-VolumesActionsTest-649771008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:58:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5abb0928-bd02-463a-9204-7297f59e6cf5 tempest-VolumesActionsTest-649771008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:58:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5abb0928-bd02-463a-9204-7297f59e6cf5 tempest-VolumesActionsTest-649771008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:58:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5abb0928-bd02-463a-9204-7297f59e6cf5 tempest-VolumesActionsTest-649771008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:58:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5abb0928-bd02-463a-9204-7297f59e6cf5 tempest-VolumesActionsTest-649771008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:58:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5abb0928-bd02-463a-9204-7297f59e6cf5 tempest-VolumesActionsTest-649771008 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:58:24 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-5abb0928-bd02-463a-9204-7297f59e6cf5 tempest-VolumesActionsTest-649771008 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:58:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5abb0928-bd02-463a-9204-7297f59e6cf5 tempest-VolumesActionsTest-649771008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4d6789de-6460-43cb-a256-d50100803bc5 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:58:24 devstack sudo[101467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4d6789de-6460-43cb-a256-d50100803bc5 1073741824 Sep 28 11:58:24 devstack sudo[101467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:58:25 devstack sudo[101467]: pam_unix(sudo:session): session closed for user root Sep 28 11:58:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5abb0928-bd02-463a-9204-7297f59e6cf5 tempest-VolumesActionsTest-649771008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4d6789de-6460-43cb-a256-d50100803bc5 1073741824" returned: 0 in 0.656s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:58:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5abb0928-bd02-463a-9204-7297f59e6cf5 tempest-VolumesActionsTest-649771008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4d6789de-6460-43cb-a256-d50100803bc5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:58:25 devstack sudo[101483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4d6789de-6460-43cb-a256-d50100803bc5 Sep 28 11:58:25 devstack sudo[101483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:58:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-88014d6b-4cfd-4a16-b83f-aae905125899 req-749a587b-5fe4-489c-bc75-39dfadc2aba0 tempest-TestMinimumBasicScenario-1300663101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:58:25 devstack sudo[101483]: pam_unix(sudo:session): session closed for user root Sep 28 11:58:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5abb0928-bd02-463a-9204-7297f59e6cf5 tempest-VolumesActionsTest-649771008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4d6789de-6460-43cb-a256-d50100803bc5" returned: 0 in 0.346s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:58:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5abb0928-bd02-463a-9204-7297f59e6cf5 tempest-VolumesActionsTest-649771008 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:58:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5abb0928-bd02-463a-9204-7297f59e6cf5 tempest-VolumesActionsTest-649771008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:58:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-88014d6b-4cfd-4a16-b83f-aae905125899 req-749a587b-5fe4-489c-bc75-39dfadc2aba0 tempest-TestMinimumBasicScenario-1300663101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.205s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:58:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-88014d6b-4cfd-4a16-b83f-aae905125899 req-749a587b-5fe4-489c-bc75-39dfadc2aba0 tempest-TestMinimumBasicScenario-1300663101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:58:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5abb0928-bd02-463a-9204-7297f59e6cf5 tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (133c928d-8acf-40f9-a53e-e3234a8e52c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d6789de-6460-43cb-a256-d50100803bc5', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:58:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5abb0928-bd02-463a-9204-7297f59e6cf5 tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c885b092-d346-4eb3-aac3-7f98d4fb1a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:58:25 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-5abb0928-bd02-463a-9204-7297f59e6cf5 tempest-VolumesActionsTest-649771008 None] Volume volume-4d6789de-6460-43cb-a256-d50100803bc5 (4d6789de-6460-43cb-a256-d50100803bc5): created successfully Sep 28 11:58:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5abb0928-bd02-463a-9204-7297f59e6cf5 tempest-VolumesActionsTest-649771008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c885b092-d346-4eb3-aac3-7f98d4fb1a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:58:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5abb0928-bd02-463a-9204-7297f59e6cf5 tempest-VolumesActionsTest-649771008 None] Flow 'volume_create_manager' (69f77041-d439-4f3a-8598-59303174d627) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:58:25 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-5abb0928-bd02-463a-9204-7297f59e6cf5 tempest-VolumesActionsTest-649771008 None] Created volume successfully. Sep 28 11:58:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-88014d6b-4cfd-4a16-b83f-aae905125899 req-749a587b-5fe4-489c-bc75-39dfadc2aba0 tempest-TestMinimumBasicScenario-1300663101 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0', 'name': 'volume-5fe75320-b09b-42c5-8597-38489f79e35e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'be0545f3-dcfc-4128-bdf6-6aa620d5efe1', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 11:58:26 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-88014d6b-4cfd-4a16-b83f-aae905125899 req-749a587b-5fe4-489c-bc75-39dfadc2aba0 tempest-TestMinimumBasicScenario-1300663101 None] attachment_update completed successfully. Sep 28 11:58:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6d692e96-ab2c-4755-8fc2-18006adf08bf tempest-VolumesActionsTest-649771008 None] Acquiring lock "cinder-4d6789de-6460-43cb-a256-d50100803bc5-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:58:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6d692e96-ab2c-4755-8fc2-18006adf08bf tempest-VolumesActionsTest-649771008 None] Lock "cinder-4d6789de-6460-43cb-a256-d50100803bc5-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:58:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6d692e96-ab2c-4755-8fc2-18006adf08bf tempest-VolumesActionsTest-649771008 None] Acquiring lock "cinder-quobyte-4d6789de-6460-43cb-a256-d50100803bc5" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:58:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6d692e96-ab2c-4755-8fc2-18006adf08bf tempest-VolumesActionsTest-649771008 None] Lock "cinder-quobyte-4d6789de-6460-43cb-a256-d50100803bc5" acquired by "delete_volume" :: waited 0.036s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:58:27 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea360b1-4016-4454-af05-079d73e40bd5]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:58:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6d692e96-ab2c-4755-8fc2-18006adf08bf tempest-VolumesActionsTest-649771008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4d6789de-6460-43cb-a256-d50100803bc5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:58:28 devstack sudo[101902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4d6789de-6460-43cb-a256-d50100803bc5 Sep 28 11:58:28 devstack sudo[101902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:58:28 devstack sudo[101902]: pam_unix(sudo:session): session closed for user root Sep 28 11:58:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6d692e96-ab2c-4755-8fc2-18006adf08bf tempest-VolumesActionsTest-649771008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4d6789de-6460-43cb-a256-d50100803bc5" returned: 0 in 0.497s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:58:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6d692e96-ab2c-4755-8fc2-18006adf08bf tempest-VolumesActionsTest-649771008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4d6789de-6460-43cb-a256-d50100803bc5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:58:28 devstack sudo[101907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4d6789de-6460-43cb-a256-d50100803bc5 Sep 28 11:58:28 devstack sudo[101907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:58:28 devstack sudo[101907]: pam_unix(sudo:session): session closed for user root Sep 28 11:58:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6d692e96-ab2c-4755-8fc2-18006adf08bf tempest-VolumesActionsTest-649771008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4d6789de-6460-43cb-a256-d50100803bc5" returned: 0 in 0.294s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:58:28 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6d692e96-ab2c-4755-8fc2-18006adf08bf tempest-VolumesActionsTest-649771008 None] Lock "cinder-quobyte-4d6789de-6460-43cb-a256-d50100803bc5" released by "delete_volume" :: held 0.866s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:58:28 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:UPDATE=123,cinder:SELECT=98,cinder:INSERT=26,cinder:DELETE=15 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 11:58:28 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-6d692e96-ab2c-4755-8fc2-18006adf08bf tempest-VolumesActionsTest-649771008 None] Created reservations ['3cc613db-3edf-430d-95fb-17cf79c08653', '48d87465-7853-4959-bb42-e7826267ee42', '721fa6a0-b1a2-41bf-b693-b2062179fbea', '04ddf89f-695a-42ad-9781-a3d2bcae412e'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:58:28 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=89,cinder:UPDATE=127,cinder:INSERT=32,cinder:DELETE=7 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 11:58:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6d692e96-ab2c-4755-8fc2-18006adf08bf tempest-VolumesActionsTest-649771008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:58:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6d692e96-ab2c-4755-8fc2-18006adf08bf tempest-VolumesActionsTest-649771008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:58:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6d692e96-ab2c-4755-8fc2-18006adf08bf tempest-VolumesActionsTest-649771008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:58:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6d692e96-ab2c-4755-8fc2-18006adf08bf tempest-VolumesActionsTest-649771008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:58:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6d692e96-ab2c-4755-8fc2-18006adf08bf tempest-VolumesActionsTest-649771008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:58:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6d692e96-ab2c-4755-8fc2-18006adf08bf tempest-VolumesActionsTest-649771008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:58:29 devstack sudo[101910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:58:29 devstack sudo[101910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:58:29 devstack sudo[101910]: pam_unix(sudo:session): session closed for user root Sep 28 11:58:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6d692e96-ab2c-4755-8fc2-18006adf08bf tempest-VolumesActionsTest-649771008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.395s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:58:29 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-6d692e96-ab2c-4755-8fc2-18006adf08bf tempest-VolumesActionsTest-649771008 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:58:29 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-6d692e96-ab2c-4755-8fc2-18006adf08bf tempest-VolumesActionsTest-649771008 None] Deleted volume successfully. Sep 28 11:58:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6d692e96-ab2c-4755-8fc2-18006adf08bf tempest-VolumesActionsTest-649771008 None] Lock "cinder-4d6789de-6460-43cb-a256-d50100803bc5-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:58:30 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3f61573-40d5-4a70-90d7-64b92e79c2a7 tempest-VolumesNegativeTest-1161828544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:58:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b3f61573-40d5-4a70-90d7-64b92e79c2a7 tempest-VolumesNegativeTest-1161828544 None] Flow 'volume_create_manager' (c4f74b8b-afc3-4c73-b88e-ad94ee0484a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:58:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b3f61573-40d5-4a70-90d7-64b92e79c2a7 tempest-VolumesNegativeTest-1161828544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3a0e568-2ce4-47f6-a455-28a03819020b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:58:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b3f61573-40d5-4a70-90d7-64b92e79c2a7 tempest-VolumesNegativeTest-1161828544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3a0e568-2ce4-47f6-a455-28a03819020b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:58:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-613209934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a184328-2118-4f79-b33c-d9d4f26ca3e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70ef57133889422f9b3df648449e7a7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:58:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:58:31Z,use_quota=True,user_id='5d26896357aa4b63ac4dbd4ef93432e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:58:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b3f61573-40d5-4a70-90d7-64b92e79c2a7 tempest-VolumesNegativeTest-1161828544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba5a9c69-8b13-4594-8fe1-8eb9b2c75873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:58:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b3f61573-40d5-4a70-90d7-64b92e79c2a7 tempest-VolumesNegativeTest-1161828544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba5a9c69-8b13-4594-8fe1-8eb9b2c75873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:58:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b3f61573-40d5-4a70-90d7-64b92e79c2a7 tempest-VolumesNegativeTest-1161828544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef9a905a-2f29-4853-9a89-acb76e5be12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:58:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b3f61573-40d5-4a70-90d7-64b92e79c2a7 tempest-VolumesNegativeTest-1161828544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef9a905a-2f29-4853-9a89-acb76e5be12e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a184328-2118-4f79-b33c-d9d4f26ca3e9', 'volume_name': 'volume-0a184328-2118-4f79-b33c-d9d4f26ca3e9', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:58:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b3f61573-40d5-4a70-90d7-64b92e79c2a7 tempest-VolumesNegativeTest-1161828544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfa7d863-adfe-4444-8f97-c293919a72fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:58:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b3f61573-40d5-4a70-90d7-64b92e79c2a7 tempest-VolumesNegativeTest-1161828544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfa7d863-adfe-4444-8f97-c293919a72fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:58:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b3f61573-40d5-4a70-90d7-64b92e79c2a7 tempest-VolumesNegativeTest-1161828544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f56e4765-7f60-4ed1-88b0-0ea9149f76db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:58:30 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-b3f61573-40d5-4a70-90d7-64b92e79c2a7 tempest-VolumesNegativeTest-1161828544 None] Volume 0a184328-2118-4f79-b33c-d9d4f26ca3e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a184328-2118-4f79-b33c-d9d4f26ca3e9', 'volume_size': 1} Sep 28 11:58:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b3f61573-40d5-4a70-90d7-64b92e79c2a7 tempest-VolumesNegativeTest-1161828544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:58:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b3f61573-40d5-4a70-90d7-64b92e79c2a7 tempest-VolumesNegativeTest-1161828544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:58:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b3f61573-40d5-4a70-90d7-64b92e79c2a7 tempest-VolumesNegativeTest-1161828544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:58:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-613209934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a184328-2118-4f79-b33c-d9d4f26ca3e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70ef57133889422f9b3df648449e7a7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:58:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:58:31Z,use_quota=True,user_id='5d26896357aa4b63ac4dbd4ef93432e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:58:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-b3f61573-40d5-4a70-90d7-64b92e79c2a7 tempest-VolumesNegativeTest-1161828544 None] Creating volume 0a184328-2118-4f79-b33c-d9d4f26ca3e9 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:58:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b3f61573-40d5-4a70-90d7-64b92e79c2a7 tempest-VolumesNegativeTest-1161828544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:58:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b3f61573-40d5-4a70-90d7-64b92e79c2a7 tempest-VolumesNegativeTest-1161828544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:58:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b3f61573-40d5-4a70-90d7-64b92e79c2a7 tempest-VolumesNegativeTest-1161828544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:58:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b3f61573-40d5-4a70-90d7-64b92e79c2a7 tempest-VolumesNegativeTest-1161828544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:58:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b3f61573-40d5-4a70-90d7-64b92e79c2a7 tempest-VolumesNegativeTest-1161828544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:58:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b3f61573-40d5-4a70-90d7-64b92e79c2a7 tempest-VolumesNegativeTest-1161828544 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:58:30 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-b3f61573-40d5-4a70-90d7-64b92e79c2a7 tempest-VolumesNegativeTest-1161828544 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:58:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b3f61573-40d5-4a70-90d7-64b92e79c2a7 tempest-VolumesNegativeTest-1161828544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-0a184328-2118-4f79-b33c-d9d4f26ca3e9 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:58:30 devstack sudo[101914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-0a184328-2118-4f79-b33c-d9d4f26ca3e9 1073741824 Sep 28 11:58:30 devstack sudo[101914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:58:31 devstack sudo[101914]: pam_unix(sudo:session): session closed for user root Sep 28 11:58:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b3f61573-40d5-4a70-90d7-64b92e79c2a7 tempest-VolumesNegativeTest-1161828544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-0a184328-2118-4f79-b33c-d9d4f26ca3e9 1073741824" returned: 0 in 0.664s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:58:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b3f61573-40d5-4a70-90d7-64b92e79c2a7 tempest-VolumesNegativeTest-1161828544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-0a184328-2118-4f79-b33c-d9d4f26ca3e9 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:58:31 devstack sudo[101921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-0a184328-2118-4f79-b33c-d9d4f26ca3e9 Sep 28 11:58:31 devstack sudo[101921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:58:31 devstack sudo[101921]: pam_unix(sudo:session): session closed for user root Sep 28 11:58:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b3f61573-40d5-4a70-90d7-64b92e79c2a7 tempest-VolumesNegativeTest-1161828544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-0a184328-2118-4f79-b33c-d9d4f26ca3e9" returned: 0 in 0.384s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:58:31 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b3f61573-40d5-4a70-90d7-64b92e79c2a7 tempest-VolumesNegativeTest-1161828544 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:58:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b3f61573-40d5-4a70-90d7-64b92e79c2a7 tempest-VolumesNegativeTest-1161828544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:58:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b3f61573-40d5-4a70-90d7-64b92e79c2a7 tempest-VolumesNegativeTest-1161828544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f56e4765-7f60-4ed1-88b0-0ea9149f76db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a184328-2118-4f79-b33c-d9d4f26ca3e9', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:58:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b3f61573-40d5-4a70-90d7-64b92e79c2a7 tempest-VolumesNegativeTest-1161828544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5582265-7913-42db-a0e3-d468c4064d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:58:32 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-b3f61573-40d5-4a70-90d7-64b92e79c2a7 tempest-VolumesNegativeTest-1161828544 None] Volume volume-0a184328-2118-4f79-b33c-d9d4f26ca3e9 (0a184328-2118-4f79-b33c-d9d4f26ca3e9): created successfully Sep 28 11:58:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b3f61573-40d5-4a70-90d7-64b92e79c2a7 tempest-VolumesNegativeTest-1161828544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5582265-7913-42db-a0e3-d468c4064d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:58:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b3f61573-40d5-4a70-90d7-64b92e79c2a7 tempest-VolumesNegativeTest-1161828544 None] Flow 'volume_create_manager' (c4f74b8b-afc3-4c73-b88e-ad94ee0484a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:58:32 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b3f61573-40d5-4a70-90d7-64b92e79c2a7 tempest-VolumesNegativeTest-1161828544 None] Created volume successfully. Sep 28 11:58:38 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 11:58:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:58:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:58:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:58:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:58:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:58:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:58:38 devstack sudo[101971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:58:38 devstack sudo[101971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:58:38 devstack sudo[101971]: pam_unix(sudo:session): session closed for user root Sep 28 11:58:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.348s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:58:39 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:58:39 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 11:58:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] thread count: 28 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 11:58:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] thread info: [<_MainThread(MainThread, started 135408582168704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 11:58:42 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=5,cinder:UPDATE=12,cinder:INSERT=1 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 11:58:42 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:DELETE=2,cinder:UPDATE=3,cinder:SELECT=1 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 11:58:47 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:58:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] Flow 'volume_create_manager' (e9d16f80-f06e-4132-b65c-e84af3183d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:58:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e899436-977f-42f2-bf42-433db0d0f805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:58:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e899436-977f-42f2-bf42-433db0d0f805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:58:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2018445799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73df7494-03d8-44c5-a524-3683c23e96bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f38e8a5f6512497ebf4d916c11c3246a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:58:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:58:47Z,use_quota=True,user_id='29afc6ca4c57401292668ce8224b21f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:58:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a376969a-a54d-4d69-86d2-43d95a2b8145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:58:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a376969a-a54d-4d69-86d2-43d95a2b8145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:58:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b5f7a47-50fb-4d9d-8071-b2b117d83119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:58:47 devstack cinder-volume[86916]: DEBUG cinder.image.glance [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] Creating Keystone auth plugin from conf {{(pid=86916) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 11:58:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b5f7a47-50fb-4d9d-8071-b2b117d83119) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '73df7494-03d8-44c5-a524-3683c23e96bc', 'volume_name': 'volume-73df7494-03d8-44c5-a524-3683c23e96bc', 'volume_size': 1, 'image_id': '5400a738-7bf7-408f-b314-8b5954ac2b81', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5400a738-7bf7-408f-b314-8b5954ac2b81', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0c8ef073bf9e4608b40db55c7aa6c23c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5400a738-7bf7-408f-b314-8b5954ac2b81', 'created_at': datetime.datetime(2026, 9, 28, 9, 39, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 9, 39, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5400a738-7bf7-408f-b314-8b5954ac2b81/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:58:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (447654d8-7d13-4467-af29-42309046fa70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:58:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (447654d8-7d13-4467-af29-42309046fa70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:58:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8b3d15e-7c86-489f-a0db-8b97f98c53fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:58:47 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] Volume 73df7494-03d8-44c5-a524-3683c23e96bc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-73df7494-03d8-44c5-a524-3683c23e96bc', 'volume_size': 1, 'image_id': '5400a738-7bf7-408f-b314-8b5954ac2b81', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5400a738-7bf7-408f-b314-8b5954ac2b81', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0c8ef073bf9e4608b40db55c7aa6c23c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5400a738-7bf7-408f-b314-8b5954ac2b81', 'created_at': datetime.datetime(2026, 9, 28, 9, 39, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 9, 39, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5400a738-7bf7-408f-b314-8b5954ac2b81/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 11:58:47 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] Trying to clone 73df7494-03d8-44c5-a524-3683c23e96bc from image 5400a738-7bf7-408f-b314-8b5954ac2b81 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5400a738-7bf7-408f-b314-8b5954ac2b81', 'metadata': {}}]). {{(pid=86916) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 11:58:48 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_86qo0gpbdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 11:58:48 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] Image download 20.69 MB at 20.69 MB/s Sep 28 11:58:48 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b20070-2ac4-446c-8d1c-65343173e0b8]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:58:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_86qo0gpbdevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:58:48 devstack sudo[102159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_86qo0gpbdevstack@QuobyteHD Sep 28 11:58:48 devstack sudo[102159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:58:48 devstack sudo[102159]: pam_unix(sudo:session): session closed for user root Sep 28 11:58:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_86qo0gpbdevstack@QuobyteHD" returned: 0 in 0.402s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:58:48 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] Temporary image 5400a738-7bf7-408f-b314-8b5954ac2b81 is fetched for user 29afc6ca4c57401292668ce8224b21f4. {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 11:58:48 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[055e00fd-8832-4f72-aaca-cdb1fe0285e4]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:58:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_86qo0gpbdevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:58:48 devstack sudo[102164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_86qo0gpbdevstack@QuobyteHD Sep 28 11:58:48 devstack sudo[102164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:58:49 devstack sudo[102164]: pam_unix(sudo:session): session closed for user root Sep 28 11:58:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_86qo0gpbdevstack@QuobyteHD" returned: 0 in 0.345s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:58:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:58:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:58:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:58:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2018445799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73df7494-03d8-44c5-a524-3683c23e96bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f38e8a5f6512497ebf4d916c11c3246a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:58:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:58:47Z,use_quota=True,user_id='29afc6ca4c57401292668ce8224b21f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:58:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] Creating volume 73df7494-03d8-44c5-a524-3683c23e96bc {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:58:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:58:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:58:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:58:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:58:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:58:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:58:49 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:58:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-73df7494-03d8-44c5-a524-3683c23e96bc 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:58:49 devstack sudo[102169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-73df7494-03d8-44c5-a524-3683c23e96bc 1073741824 Sep 28 11:58:49 devstack sudo[102169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:58:49 devstack sudo[102169]: pam_unix(sudo:session): session closed for user root Sep 28 11:58:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-73df7494-03d8-44c5-a524-3683c23e96bc 1073741824" returned: 0 in 0.693s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:58:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-73df7494-03d8-44c5-a524-3683c23e96bc {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:58:49 devstack sudo[102177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-73df7494-03d8-44c5-a524-3683c23e96bc Sep 28 11:58:49 devstack sudo[102177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:58:50 devstack sudo[102177]: pam_unix(sudo:session): session closed for user root Sep 28 11:58:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-73df7494-03d8-44c5-a524-3683c23e96bc" returned: 0 in 0.288s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:58:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:58:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:58:50 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] Attempting download of 5400a738-7bf7-408f-b314-8b5954ac2b81 ((None, [{'url': 'file:///opt/stack/data/glance/images/5400a738-7bf7-408f-b314-8b5954ac2b81', 'metadata': {}}])) to volume 73df7494-03d8-44c5-a524-3683c23e96bc. {{(pid=86916) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 11:58:50 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[607b4d08-f349-4dab-b78c-af51eefa7796]: (4, 'raw') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:58:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5400a738-7bf7-408f-b314-8b5954ac2b81_dj8ncijp {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:58:50 devstack sudo[102182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5400a738-7bf7-408f-b314-8b5954ac2b81_dj8ncijp Sep 28 11:58:50 devstack sudo[102182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:58:50 devstack sudo[102182]: pam_unix(sudo:session): session closed for user root Sep 28 11:58:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5400a738-7bf7-408f-b314-8b5954ac2b81_dj8ncijp" returned: 0 in 0.409s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:58:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5400a738-7bf7-408f-b314-8b5954ac2b81_dj8ncijp {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:58:50 devstack sudo[102186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5400a738-7bf7-408f-b314-8b5954ac2b81_dj8ncijp Sep 28 11:58:50 devstack sudo[102186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:58:51 devstack sudo[102186]: pam_unix(sudo:session): session closed for user root Sep 28 11:58:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5400a738-7bf7-408f-b314-8b5954ac2b81_dj8ncijp" returned: 1 in 0.397s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:58:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5400a738-7bf7-408f-b314-8b5954ac2b81_dj8ncijp' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 11:58:51 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6c385b-ea70-45ec-8535-1911faee1de9]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:58:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_86qo0gpbdevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:58:51 devstack sudo[102191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_86qo0gpbdevstack@QuobyteHD Sep 28 11:58:51 devstack sudo[102191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:58:51 devstack sudo[102191]: pam_unix(sudo:session): session closed for user root Sep 28 11:58:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_86qo0gpbdevstack@QuobyteHD" returned: 0 in 0.402s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:58:51 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] 5400a738-7bf7-408f-b314-8b5954ac2b81 was qcow2, converting to qcow2 {{(pid=86916) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 11:58:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_86qo0gpbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-73df7494-03d8-44c5-a524-3683c23e96bc {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:58:51 devstack sudo[102197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_86qo0gpbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-73df7494-03d8-44c5-a524-3683c23e96bc Sep 28 11:58:51 devstack sudo[102197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:58:53 devstack sudo[102197]: pam_unix(sudo:session): session closed for user root Sep 28 11:58:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_86qo0gpbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-73df7494-03d8-44c5-a524-3683c23e96bc" returned: 0 in 2.214s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:58:53 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_86qo0gpbdevstack@QuobyteHD, size 112.00 MB, duration 2.21 sec, destination /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-73df7494-03d8-44c5-a524-3683c23e96bc {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 11:58:53 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] Converted 112.00 MB image at 50.57 MB/s Sep 28 11:58:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-73df7494-03d8-44c5-a524-3683c23e96bc 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:58:53 devstack sudo[102210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-73df7494-03d8-44c5-a524-3683c23e96bc 1G Sep 28 11:58:53 devstack sudo[102210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:58:54 devstack sudo[102210]: pam_unix(sudo:session): session closed for user root Sep 28 11:58:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-73df7494-03d8-44c5-a524-3683c23e96bc 1G" returned: 0 in 0.356s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:58:54 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] Downloaded image 5400a738-7bf7-408f-b314-8b5954ac2b81 ((None, [{'url': 'file:///opt/stack/data/glance/images/5400a738-7bf7-408f-b314-8b5954ac2b81', 'metadata': {}}])) to volume 73df7494-03d8-44c5-a524-3683c23e96bc successfully. {{(pid=86916) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 11:58:54 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] Temporary image 5400a738-7bf7-408f-b314-8b5954ac2b81 for user 29afc6ca4c57401292668ce8224b21f4 is deleted. {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 11:58:54 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] Marking volume 73df7494-03d8-44c5-a524-3683c23e96bc as bootable. {{(pid=86916) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 11:58:54 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] Copying metadata from image 5400a738-7bf7-408f-b314-8b5954ac2b81 to 73df7494-03d8-44c5-a524-3683c23e96bc. {{(pid=86916) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 11:58:54 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] Creating volume glance metadata for volume 73df7494-03d8-44c5-a524-3683c23e96bc backed by image 5400a738-7bf7-408f-b314-8b5954ac2b81 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5400a738-7bf7-408f-b314-8b5954ac2b81', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86916) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 11:58:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8b3d15e-7c86-489f-a0db-8b97f98c53fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73df7494-03d8-44c5-a524-3683c23e96bc', 'volume_size': 1, 'image_id': '5400a738-7bf7-408f-b314-8b5954ac2b81', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5400a738-7bf7-408f-b314-8b5954ac2b81', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0c8ef073bf9e4608b40db55c7aa6c23c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5400a738-7bf7-408f-b314-8b5954ac2b81', 'created_at': datetime.datetime(2026, 9, 28, 9, 39, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 9, 39, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5400a738-7bf7-408f-b314-8b5954ac2b81/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:58:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26f27311-b1d0-4477-8fc2-d8cf2b605b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:58:54 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] Volume volume-73df7494-03d8-44c5-a524-3683c23e96bc (73df7494-03d8-44c5-a524-3683c23e96bc): created successfully Sep 28 11:58:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26f27311-b1d0-4477-8fc2-d8cf2b605b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:58:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] Flow 'volume_create_manager' (e9d16f80-f06e-4132-b65c-e84af3183d10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:58:54 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b2488890-b193-4a19-92d5-afd721c44ed9 tempest-VolumesImageMetadata-1715877973 None] Created volume successfully. Sep 28 11:58:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8e123a2b-52f2-42bb-80ff-7f30dc5c2b91 tempest-VolumesImageMetadata-1715877973 None] Acquiring lock "cinder-73df7494-03d8-44c5-a524-3683c23e96bc-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:58:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8e123a2b-52f2-42bb-80ff-7f30dc5c2b91 tempest-VolumesImageMetadata-1715877973 None] Lock "cinder-73df7494-03d8-44c5-a524-3683c23e96bc-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:58:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8e123a2b-52f2-42bb-80ff-7f30dc5c2b91 tempest-VolumesImageMetadata-1715877973 None] Acquiring lock "cinder-quobyte-73df7494-03d8-44c5-a524-3683c23e96bc" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:58:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8e123a2b-52f2-42bb-80ff-7f30dc5c2b91 tempest-VolumesImageMetadata-1715877973 None] Lock "cinder-quobyte-73df7494-03d8-44c5-a524-3683c23e96bc" acquired by "delete_volume" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:58:55 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb55294f-3da6-452d-8237-4d57aec4fe1c]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:58:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8e123a2b-52f2-42bb-80ff-7f30dc5c2b91 tempest-VolumesImageMetadata-1715877973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-73df7494-03d8-44c5-a524-3683c23e96bc {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:58:55 devstack sudo[102216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-73df7494-03d8-44c5-a524-3683c23e96bc Sep 28 11:58:55 devstack sudo[102216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:58:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bd73dec4-a492-445c-acc5-f21be63b5459 tempest-VolumesNegativeTest-1161828544 None] Acquiring lock "cinder-0a184328-2118-4f79-b33c-d9d4f26ca3e9-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:58:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bd73dec4-a492-445c-acc5-f21be63b5459 tempest-VolumesNegativeTest-1161828544 None] Lock "cinder-0a184328-2118-4f79-b33c-d9d4f26ca3e9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:58:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bd73dec4-a492-445c-acc5-f21be63b5459 tempest-VolumesNegativeTest-1161828544 None] Acquiring lock "cinder-quobyte-0a184328-2118-4f79-b33c-d9d4f26ca3e9" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:58:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bd73dec4-a492-445c-acc5-f21be63b5459 tempest-VolumesNegativeTest-1161828544 None] Lock "cinder-quobyte-0a184328-2118-4f79-b33c-d9d4f26ca3e9" acquired by "delete_volume" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:58:55 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[96148981-ea98-4b37-87c9-590b3fd430f6]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:58:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bd73dec4-a492-445c-acc5-f21be63b5459 tempest-VolumesNegativeTest-1161828544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-0a184328-2118-4f79-b33c-d9d4f26ca3e9 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:58:56 devstack sudo[102218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-0a184328-2118-4f79-b33c-d9d4f26ca3e9 Sep 28 11:58:56 devstack sudo[102218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:58:56 devstack sudo[102216]: pam_unix(sudo:session): session closed for user root Sep 28 11:58:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8e123a2b-52f2-42bb-80ff-7f30dc5c2b91 tempest-VolumesImageMetadata-1715877973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-73df7494-03d8-44c5-a524-3683c23e96bc" returned: 0 in 0.442s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:58:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8e123a2b-52f2-42bb-80ff-7f30dc5c2b91 tempest-VolumesImageMetadata-1715877973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-73df7494-03d8-44c5-a524-3683c23e96bc {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:58:56 devstack sudo[102225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-73df7494-03d8-44c5-a524-3683c23e96bc Sep 28 11:58:56 devstack sudo[102225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:58:56 devstack sudo[102218]: pam_unix(sudo:session): session closed for user root Sep 28 11:58:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bd73dec4-a492-445c-acc5-f21be63b5459 tempest-VolumesNegativeTest-1161828544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-0a184328-2118-4f79-b33c-d9d4f26ca3e9" returned: 0 in 0.414s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:58:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bd73dec4-a492-445c-acc5-f21be63b5459 tempest-VolumesNegativeTest-1161828544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-0a184328-2118-4f79-b33c-d9d4f26ca3e9 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:58:56 devstack sudo[102225]: pam_unix(sudo:session): session closed for user root Sep 28 11:58:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8e123a2b-52f2-42bb-80ff-7f30dc5c2b91 tempest-VolumesImageMetadata-1715877973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-73df7494-03d8-44c5-a524-3683c23e96bc" returned: 0 in 0.285s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:58:56 devstack sudo[102231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-0a184328-2118-4f79-b33c-d9d4f26ca3e9 Sep 28 11:58:56 devstack sudo[102231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:58:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8e123a2b-52f2-42bb-80ff-7f30dc5c2b91 tempest-VolumesImageMetadata-1715877973 None] Lock "cinder-quobyte-73df7494-03d8-44c5-a524-3683c23e96bc" released by "delete_volume" :: held 0.791s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:58:56 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-8e123a2b-52f2-42bb-80ff-7f30dc5c2b91 tempest-VolumesImageMetadata-1715877973 None] Created reservations ['5cba33a1-277a-4e52-b830-08ee3cda6a88', 'a1f754fd-69fe-4b37-81b0-959fed0ce04c', 'a8addf95-4a04-4607-b8da-b6a50a9b18b6', 'cc35b0a3-dbc5-4b21-9a5c-e64d402c6b7a'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:58:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8e123a2b-52f2-42bb-80ff-7f30dc5c2b91 tempest-VolumesImageMetadata-1715877973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:58:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8e123a2b-52f2-42bb-80ff-7f30dc5c2b91 tempest-VolumesImageMetadata-1715877973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:58:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8e123a2b-52f2-42bb-80ff-7f30dc5c2b91 tempest-VolumesImageMetadata-1715877973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:58:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8e123a2b-52f2-42bb-80ff-7f30dc5c2b91 tempest-VolumesImageMetadata-1715877973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:58:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8e123a2b-52f2-42bb-80ff-7f30dc5c2b91 tempest-VolumesImageMetadata-1715877973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:58:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8e123a2b-52f2-42bb-80ff-7f30dc5c2b91 tempest-VolumesImageMetadata-1715877973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:58:56 devstack sudo[102234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:58:56 devstack sudo[102234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:58:56 devstack sudo[102231]: pam_unix(sudo:session): session closed for user root Sep 28 11:58:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bd73dec4-a492-445c-acc5-f21be63b5459 tempest-VolumesNegativeTest-1161828544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-0a184328-2118-4f79-b33c-d9d4f26ca3e9" returned: 0 in 0.319s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:58:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bd73dec4-a492-445c-acc5-f21be63b5459 tempest-VolumesNegativeTest-1161828544 None] Lock "cinder-quobyte-0a184328-2118-4f79-b33c-d9d4f26ca3e9" released by "delete_volume" :: held 0.794s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:58:56 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-bd73dec4-a492-445c-acc5-f21be63b5459 tempest-VolumesNegativeTest-1161828544 None] Created reservations ['d1ef1f71-326a-4606-94d8-3bd68559b045', '55440201-40b6-4db6-9629-d0710df59861', '78256f3f-c10e-4bea-8e14-24c8739770f6', 'c8fe1b1a-4165-45a5-8ee6-96bbfe7fab69'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:58:56 devstack sudo[102234]: pam_unix(sudo:session): session closed for user root Sep 28 11:58:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8e123a2b-52f2-42bb-80ff-7f30dc5c2b91 tempest-VolumesImageMetadata-1715877973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.402s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:58:56 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-8e123a2b-52f2-42bb-80ff-7f30dc5c2b91 tempest-VolumesImageMetadata-1715877973 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:58:56 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-8e123a2b-52f2-42bb-80ff-7f30dc5c2b91 tempest-VolumesImageMetadata-1715877973 None] Deleted volume successfully. Sep 28 11:58:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8e123a2b-52f2-42bb-80ff-7f30dc5c2b91 tempest-VolumesImageMetadata-1715877973 None] Lock "cinder-73df7494-03d8-44c5-a524-3683c23e96bc-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:58:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bd73dec4-a492-445c-acc5-f21be63b5459 tempest-VolumesNegativeTest-1161828544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:58:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bd73dec4-a492-445c-acc5-f21be63b5459 tempest-VolumesNegativeTest-1161828544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:58:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bd73dec4-a492-445c-acc5-f21be63b5459 tempest-VolumesNegativeTest-1161828544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:58:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bd73dec4-a492-445c-acc5-f21be63b5459 tempest-VolumesNegativeTest-1161828544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:58:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bd73dec4-a492-445c-acc5-f21be63b5459 tempest-VolumesNegativeTest-1161828544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:58:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bd73dec4-a492-445c-acc5-f21be63b5459 tempest-VolumesNegativeTest-1161828544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:58:57 devstack sudo[102237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:58:57 devstack sudo[102237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:58:57 devstack sudo[102237]: pam_unix(sudo:session): session closed for user root Sep 28 11:58:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bd73dec4-a492-445c-acc5-f21be63b5459 tempest-VolumesNegativeTest-1161828544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.417s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:58:57 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-bd73dec4-a492-445c-acc5-f21be63b5459 tempest-VolumesNegativeTest-1161828544 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:58:57 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-bd73dec4-a492-445c-acc5-f21be63b5459 tempest-VolumesNegativeTest-1161828544 None] Deleted volume successfully. Sep 28 11:58:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bd73dec4-a492-445c-acc5-f21be63b5459 tempest-VolumesNegativeTest-1161828544 None] Lock "cinder-0a184328-2118-4f79-b33c-d9d4f26ca3e9-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:59:02 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-2319feaa-be5d-4269-bf87-18f052a752f1 tempest-AbsoluteLimitsTests-1097671169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:59:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2319feaa-be5d-4269-bf87-18f052a752f1 tempest-AbsoluteLimitsTests-1097671169 None] Flow 'volume_create_manager' (194f411a-4069-4ffc-b819-7ba64533fdcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:59:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2319feaa-be5d-4269-bf87-18f052a752f1 tempest-AbsoluteLimitsTests-1097671169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52487ada-59df-4b95-b3a2-58ddd30bfea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2319feaa-be5d-4269-bf87-18f052a752f1 tempest-AbsoluteLimitsTests-1097671169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52487ada-59df-4b95-b3a2-58ddd30bfea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:59:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1209375851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3553ce1-221d-4339-a0ab-2c246edfdd64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fd864ddebc7406fa43066ed8c7ec371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:59:03Z,use_quota=True,user_id='0d9ffc23bfda4bdca0ac9ac11581a5f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2319feaa-be5d-4269-bf87-18f052a752f1 tempest-AbsoluteLimitsTests-1097671169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caddbac0-4148-45f5-b225-8e2ff8564a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2319feaa-be5d-4269-bf87-18f052a752f1 tempest-AbsoluteLimitsTests-1097671169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caddbac0-4148-45f5-b225-8e2ff8564a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2319feaa-be5d-4269-bf87-18f052a752f1 tempest-AbsoluteLimitsTests-1097671169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50a3a246-9485-4a9d-a92c-d66358d8927c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2319feaa-be5d-4269-bf87-18f052a752f1 tempest-AbsoluteLimitsTests-1097671169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50a3a246-9485-4a9d-a92c-d66358d8927c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3553ce1-221d-4339-a0ab-2c246edfdd64', 'volume_name': 'volume-d3553ce1-221d-4339-a0ab-2c246edfdd64', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2319feaa-be5d-4269-bf87-18f052a752f1 tempest-AbsoluteLimitsTests-1097671169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7baae30d-37dc-4492-a2fd-4e08c33c4b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2319feaa-be5d-4269-bf87-18f052a752f1 tempest-AbsoluteLimitsTests-1097671169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7baae30d-37dc-4492-a2fd-4e08c33c4b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2319feaa-be5d-4269-bf87-18f052a752f1 tempest-AbsoluteLimitsTests-1097671169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c750d98e-bb04-4e71-83c4-b0aa5bdbdc14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:03 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-2319feaa-be5d-4269-bf87-18f052a752f1 tempest-AbsoluteLimitsTests-1097671169 None] Volume d3553ce1-221d-4339-a0ab-2c246edfdd64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3553ce1-221d-4339-a0ab-2c246edfdd64', 'volume_size': 1} Sep 28 11:59:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2319feaa-be5d-4269-bf87-18f052a752f1 tempest-AbsoluteLimitsTests-1097671169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:59:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2319feaa-be5d-4269-bf87-18f052a752f1 tempest-AbsoluteLimitsTests-1097671169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:59:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2319feaa-be5d-4269-bf87-18f052a752f1 tempest-AbsoluteLimitsTests-1097671169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:59:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1209375851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3553ce1-221d-4339-a0ab-2c246edfdd64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fd864ddebc7406fa43066ed8c7ec371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:59:03Z,use_quota=True,user_id='0d9ffc23bfda4bdca0ac9ac11581a5f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:59:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-2319feaa-be5d-4269-bf87-18f052a752f1 tempest-AbsoluteLimitsTests-1097671169 None] Creating volume d3553ce1-221d-4339-a0ab-2c246edfdd64 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:59:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2319feaa-be5d-4269-bf87-18f052a752f1 tempest-AbsoluteLimitsTests-1097671169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:59:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2319feaa-be5d-4269-bf87-18f052a752f1 tempest-AbsoluteLimitsTests-1097671169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:59:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2319feaa-be5d-4269-bf87-18f052a752f1 tempest-AbsoluteLimitsTests-1097671169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:59:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2319feaa-be5d-4269-bf87-18f052a752f1 tempest-AbsoluteLimitsTests-1097671169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:59:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2319feaa-be5d-4269-bf87-18f052a752f1 tempest-AbsoluteLimitsTests-1097671169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:59:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2319feaa-be5d-4269-bf87-18f052a752f1 tempest-AbsoluteLimitsTests-1097671169 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:59:03 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-2319feaa-be5d-4269-bf87-18f052a752f1 tempest-AbsoluteLimitsTests-1097671169 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:59:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2319feaa-be5d-4269-bf87-18f052a752f1 tempest-AbsoluteLimitsTests-1097671169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d3553ce1-221d-4339-a0ab-2c246edfdd64 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:03 devstack sudo[102244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d3553ce1-221d-4339-a0ab-2c246edfdd64 1073741824 Sep 28 11:59:03 devstack sudo[102244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:03 devstack sudo[102244]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2319feaa-be5d-4269-bf87-18f052a752f1 tempest-AbsoluteLimitsTests-1097671169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d3553ce1-221d-4339-a0ab-2c246edfdd64 1073741824" returned: 0 in 0.477s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2319feaa-be5d-4269-bf87-18f052a752f1 tempest-AbsoluteLimitsTests-1097671169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d3553ce1-221d-4339-a0ab-2c246edfdd64 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:03 devstack sudo[102250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d3553ce1-221d-4339-a0ab-2c246edfdd64 Sep 28 11:59:03 devstack sudo[102250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:03 devstack sudo[102250]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2319feaa-be5d-4269-bf87-18f052a752f1 tempest-AbsoluteLimitsTests-1097671169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d3553ce1-221d-4339-a0ab-2c246edfdd64" returned: 0 in 0.266s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2319feaa-be5d-4269-bf87-18f052a752f1 tempest-AbsoluteLimitsTests-1097671169 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:59:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2319feaa-be5d-4269-bf87-18f052a752f1 tempest-AbsoluteLimitsTests-1097671169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:59:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2319feaa-be5d-4269-bf87-18f052a752f1 tempest-AbsoluteLimitsTests-1097671169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c750d98e-bb04-4e71-83c4-b0aa5bdbdc14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3553ce1-221d-4339-a0ab-2c246edfdd64', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2319feaa-be5d-4269-bf87-18f052a752f1 tempest-AbsoluteLimitsTests-1097671169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8546fc2-a605-4608-82a1-bc5ada0d1824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:03 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-2319feaa-be5d-4269-bf87-18f052a752f1 tempest-AbsoluteLimitsTests-1097671169 None] Volume volume-d3553ce1-221d-4339-a0ab-2c246edfdd64 (d3553ce1-221d-4339-a0ab-2c246edfdd64): created successfully Sep 28 11:59:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2319feaa-be5d-4269-bf87-18f052a752f1 tempest-AbsoluteLimitsTests-1097671169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8546fc2-a605-4608-82a1-bc5ada0d1824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2319feaa-be5d-4269-bf87-18f052a752f1 tempest-AbsoluteLimitsTests-1097671169 None] Flow 'volume_create_manager' (194f411a-4069-4ffc-b819-7ba64533fdcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:59:03 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-2319feaa-be5d-4269-bf87-18f052a752f1 tempest-AbsoluteLimitsTests-1097671169 None] Created volume successfully. Sep 28 11:59:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b3593c99-13b4-4e7b-b24f-209b50a4cb46 tempest-AbsoluteLimitsTests-1097671169 None] Acquiring lock "cinder-d3553ce1-221d-4339-a0ab-2c246edfdd64-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:59:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b3593c99-13b4-4e7b-b24f-209b50a4cb46 tempest-AbsoluteLimitsTests-1097671169 None] Lock "cinder-d3553ce1-221d-4339-a0ab-2c246edfdd64-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:59:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b3593c99-13b4-4e7b-b24f-209b50a4cb46 tempest-AbsoluteLimitsTests-1097671169 None] Acquiring lock "cinder-quobyte-d3553ce1-221d-4339-a0ab-2c246edfdd64" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:59:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b3593c99-13b4-4e7b-b24f-209b50a4cb46 tempest-AbsoluteLimitsTests-1097671169 None] Lock "cinder-quobyte-d3553ce1-221d-4339-a0ab-2c246edfdd64" acquired by "delete_volume" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:59:05 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8726ba5-9a20-4c44-be20-3198cf9ae6ee]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:59:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b3593c99-13b4-4e7b-b24f-209b50a4cb46 tempest-AbsoluteLimitsTests-1097671169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d3553ce1-221d-4339-a0ab-2c246edfdd64 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:05 devstack sudo[102253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d3553ce1-221d-4339-a0ab-2c246edfdd64 Sep 28 11:59:05 devstack sudo[102253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:05 devstack sudo[102253]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b3593c99-13b4-4e7b-b24f-209b50a4cb46 tempest-AbsoluteLimitsTests-1097671169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d3553ce1-221d-4339-a0ab-2c246edfdd64" returned: 0 in 0.458s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b3593c99-13b4-4e7b-b24f-209b50a4cb46 tempest-AbsoluteLimitsTests-1097671169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d3553ce1-221d-4339-a0ab-2c246edfdd64 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:05 devstack sudo[102258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d3553ce1-221d-4339-a0ab-2c246edfdd64 Sep 28 11:59:05 devstack sudo[102258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:06 devstack sudo[102258]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b3593c99-13b4-4e7b-b24f-209b50a4cb46 tempest-AbsoluteLimitsTests-1097671169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d3553ce1-221d-4339-a0ab-2c246edfdd64" returned: 0 in 0.268s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b3593c99-13b4-4e7b-b24f-209b50a4cb46 tempest-AbsoluteLimitsTests-1097671169 None] Lock "cinder-quobyte-d3553ce1-221d-4339-a0ab-2c246edfdd64" released by "delete_volume" :: held 0.816s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:59:06 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-b3593c99-13b4-4e7b-b24f-209b50a4cb46 tempest-AbsoluteLimitsTests-1097671169 None] Created reservations ['8c249acf-9fc9-4de1-96ea-cc85796996d1', '49818b21-c5b7-4482-9c83-eb0e8ef13e15', 'a1e1be5a-6198-4963-a68b-71fd85c2d881', 'add209d0-1a4a-4763-abc6-d7e992b4bc89'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:59:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b3593c99-13b4-4e7b-b24f-209b50a4cb46 tempest-AbsoluteLimitsTests-1097671169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:59:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b3593c99-13b4-4e7b-b24f-209b50a4cb46 tempest-AbsoluteLimitsTests-1097671169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:59:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b3593c99-13b4-4e7b-b24f-209b50a4cb46 tempest-AbsoluteLimitsTests-1097671169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:59:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b3593c99-13b4-4e7b-b24f-209b50a4cb46 tempest-AbsoluteLimitsTests-1097671169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:59:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b3593c99-13b4-4e7b-b24f-209b50a4cb46 tempest-AbsoluteLimitsTests-1097671169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:59:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b3593c99-13b4-4e7b-b24f-209b50a4cb46 tempest-AbsoluteLimitsTests-1097671169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:06 devstack sudo[102261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:59:06 devstack sudo[102261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:06 devstack sudo[102261]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b3593c99-13b4-4e7b-b24f-209b50a4cb46 tempest-AbsoluteLimitsTests-1097671169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.275s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:06 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-b3593c99-13b4-4e7b-b24f-209b50a4cb46 tempest-AbsoluteLimitsTests-1097671169 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:59:06 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b3593c99-13b4-4e7b-b24f-209b50a4cb46 tempest-AbsoluteLimitsTests-1097671169 None] Deleted volume successfully. Sep 28 11:59:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b3593c99-13b4-4e7b-b24f-209b50a4cb46 tempest-AbsoluteLimitsTests-1097671169 None] Lock "cinder-d3553ce1-221d-4339-a0ab-2c246edfdd64-delete_volume" released by "delete_volume" :: held 1.357s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:59:16 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:UPDATE=27,cinder:SELECT=23,cinder:INSERT=14,cinder:DELETE=3 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 11:59:16 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=30,cinder:UPDATE=36,cinder:INSERT=13,cinder:DELETE=2 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 11:59:19 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-22ad2de8-7ef6-491e-bfca-8fb0c648ab9d req-eda526f0-f2a2-4c89-9aed-5d5292252c8d tempest-TestMinimumBasicScenario-1300663101 None] Terminate volume connection completed successfully. Sep 28 11:59:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-22ad2de8-7ef6-491e-bfca-8fb0c648ab9d req-eda526f0-f2a2-4c89-9aed-5d5292252c8d tempest-TestMinimumBasicScenario-1300663101 None] Deleting attachment be0545f3-dcfc-4128-bdf6-6aa620d5efe1. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 11:59:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-478f0cc9-cf81-4b06-8a08-3b46e97aa3ff tempest-TestMinimumBasicScenario-1300663101 None] Acquiring lock "cinder-5fe75320-b09b-42c5-8597-38489f79e35e-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:59:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-478f0cc9-cf81-4b06-8a08-3b46e97aa3ff tempest-TestMinimumBasicScenario-1300663101 None] Lock "cinder-5fe75320-b09b-42c5-8597-38489f79e35e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:59:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-478f0cc9-cf81-4b06-8a08-3b46e97aa3ff tempest-TestMinimumBasicScenario-1300663101 None] Acquiring lock "cinder-quobyte-5fe75320-b09b-42c5-8597-38489f79e35e" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:59:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-478f0cc9-cf81-4b06-8a08-3b46e97aa3ff tempest-TestMinimumBasicScenario-1300663101 None] Lock "cinder-quobyte-5fe75320-b09b-42c5-8597-38489f79e35e" acquired by "delete_volume" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:59:20 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d011f2-29c3-4ec8-968c-c4e7d27c007f]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:59:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-478f0cc9-cf81-4b06-8a08-3b46e97aa3ff tempest-TestMinimumBasicScenario-1300663101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5fe75320-b09b-42c5-8597-38489f79e35e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:20 devstack sudo[102328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5fe75320-b09b-42c5-8597-38489f79e35e Sep 28 11:59:20 devstack sudo[102328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:20 devstack sudo[102328]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-478f0cc9-cf81-4b06-8a08-3b46e97aa3ff tempest-TestMinimumBasicScenario-1300663101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5fe75320-b09b-42c5-8597-38489f79e35e" returned: 0 in 0.475s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-478f0cc9-cf81-4b06-8a08-3b46e97aa3ff tempest-TestMinimumBasicScenario-1300663101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5fe75320-b09b-42c5-8597-38489f79e35e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:20 devstack sudo[102334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5fe75320-b09b-42c5-8597-38489f79e35e Sep 28 11:59:20 devstack sudo[102334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:20 devstack sudo[102334]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-478f0cc9-cf81-4b06-8a08-3b46e97aa3ff tempest-TestMinimumBasicScenario-1300663101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5fe75320-b09b-42c5-8597-38489f79e35e" returned: 0 in 0.285s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-478f0cc9-cf81-4b06-8a08-3b46e97aa3ff tempest-TestMinimumBasicScenario-1300663101 None] Lock "cinder-quobyte-5fe75320-b09b-42c5-8597-38489f79e35e" released by "delete_volume" :: held 0.810s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:59:21 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-478f0cc9-cf81-4b06-8a08-3b46e97aa3ff tempest-TestMinimumBasicScenario-1300663101 None] Created reservations ['87a8cbb7-7997-4653-b3ab-8fdee5c38242', 'f5dbefcf-4464-4d5c-945d-21f55045223c', '4f84815c-f78d-4e8f-9989-0abe5115a65f', '577725cb-7262-49bd-8c89-ff73da67ed6c'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:59:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-478f0cc9-cf81-4b06-8a08-3b46e97aa3ff tempest-TestMinimumBasicScenario-1300663101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:59:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-478f0cc9-cf81-4b06-8a08-3b46e97aa3ff tempest-TestMinimumBasicScenario-1300663101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:59:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-478f0cc9-cf81-4b06-8a08-3b46e97aa3ff tempest-TestMinimumBasicScenario-1300663101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:59:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-478f0cc9-cf81-4b06-8a08-3b46e97aa3ff tempest-TestMinimumBasicScenario-1300663101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:59:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-478f0cc9-cf81-4b06-8a08-3b46e97aa3ff tempest-TestMinimumBasicScenario-1300663101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:59:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-478f0cc9-cf81-4b06-8a08-3b46e97aa3ff tempest-TestMinimumBasicScenario-1300663101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:21 devstack sudo[102337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:59:21 devstack sudo[102337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:21 devstack sudo[102337]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-478f0cc9-cf81-4b06-8a08-3b46e97aa3ff tempest-TestMinimumBasicScenario-1300663101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.356s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:21 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-478f0cc9-cf81-4b06-8a08-3b46e97aa3ff tempest-TestMinimumBasicScenario-1300663101 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:59:21 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-478f0cc9-cf81-4b06-8a08-3b46e97aa3ff tempest-TestMinimumBasicScenario-1300663101 None] Deleted volume successfully. Sep 28 11:59:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-478f0cc9-cf81-4b06-8a08-3b46e97aa3ff tempest-TestMinimumBasicScenario-1300663101 None] Lock "cinder-5fe75320-b09b-42c5-8597-38489f79e35e-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:59:23 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9509cf9-54d2-45b8-b12b-f90efdb756c8 tempest-VolumesSnapshotTestJSON-234340527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:59:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a9509cf9-54d2-45b8-b12b-f90efdb756c8 tempest-VolumesSnapshotTestJSON-234340527 None] Flow 'volume_create_manager' (32232411-3b9b-44d5-9a3c-5ca37aa1b725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:59:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a9509cf9-54d2-45b8-b12b-f90efdb756c8 tempest-VolumesSnapshotTestJSON-234340527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fb86f50-30ec-4237-8bbd-287cf90d6b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a9509cf9-54d2-45b8-b12b-f90efdb756c8 tempest-VolumesSnapshotTestJSON-234340527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fb86f50-30ec-4237-8bbd-287cf90d6b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:59:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-959772101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8102cf13-9a5b-47cf-aa0f-7d4404f39485,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb928adbcb8b424f94e03b26751e1eb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:59:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:59:23Z,use_quota=True,user_id='1708eb324dc5445894a1a92f35e5d748',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a9509cf9-54d2-45b8-b12b-f90efdb756c8 tempest-VolumesSnapshotTestJSON-234340527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3822566-2a6a-4c5e-bec3-0f67b454bef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a9509cf9-54d2-45b8-b12b-f90efdb756c8 tempest-VolumesSnapshotTestJSON-234340527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3822566-2a6a-4c5e-bec3-0f67b454bef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a9509cf9-54d2-45b8-b12b-f90efdb756c8 tempest-VolumesSnapshotTestJSON-234340527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e88e6bd3-7acf-4322-88e5-e4f07f27e83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a9509cf9-54d2-45b8-b12b-f90efdb756c8 tempest-VolumesSnapshotTestJSON-234340527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e88e6bd3-7acf-4322-88e5-e4f07f27e83c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8102cf13-9a5b-47cf-aa0f-7d4404f39485', 'volume_name': 'volume-8102cf13-9a5b-47cf-aa0f-7d4404f39485', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a9509cf9-54d2-45b8-b12b-f90efdb756c8 tempest-VolumesSnapshotTestJSON-234340527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ae7d6ed-9509-4451-8557-8044d316a6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a9509cf9-54d2-45b8-b12b-f90efdb756c8 tempest-VolumesSnapshotTestJSON-234340527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ae7d6ed-9509-4451-8557-8044d316a6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a9509cf9-54d2-45b8-b12b-f90efdb756c8 tempest-VolumesSnapshotTestJSON-234340527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88767bb1-7a97-438e-9ec8-38820ac7f874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:23 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-a9509cf9-54d2-45b8-b12b-f90efdb756c8 tempest-VolumesSnapshotTestJSON-234340527 None] Volume 8102cf13-9a5b-47cf-aa0f-7d4404f39485: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8102cf13-9a5b-47cf-aa0f-7d4404f39485', 'volume_size': 1} Sep 28 11:59:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a9509cf9-54d2-45b8-b12b-f90efdb756c8 tempest-VolumesSnapshotTestJSON-234340527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:59:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a9509cf9-54d2-45b8-b12b-f90efdb756c8 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:59:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a9509cf9-54d2-45b8-b12b-f90efdb756c8 tempest-VolumesSnapshotTestJSON-234340527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:59:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-959772101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8102cf13-9a5b-47cf-aa0f-7d4404f39485,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb928adbcb8b424f94e03b26751e1eb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:59:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:59:23Z,use_quota=True,user_id='1708eb324dc5445894a1a92f35e5d748',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:59:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-a9509cf9-54d2-45b8-b12b-f90efdb756c8 tempest-VolumesSnapshotTestJSON-234340527 None] Creating volume 8102cf13-9a5b-47cf-aa0f-7d4404f39485 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:59:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a9509cf9-54d2-45b8-b12b-f90efdb756c8 tempest-VolumesSnapshotTestJSON-234340527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:59:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a9509cf9-54d2-45b8-b12b-f90efdb756c8 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:59:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a9509cf9-54d2-45b8-b12b-f90efdb756c8 tempest-VolumesSnapshotTestJSON-234340527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:59:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a9509cf9-54d2-45b8-b12b-f90efdb756c8 tempest-VolumesSnapshotTestJSON-234340527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:59:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a9509cf9-54d2-45b8-b12b-f90efdb756c8 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:59:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a9509cf9-54d2-45b8-b12b-f90efdb756c8 tempest-VolumesSnapshotTestJSON-234340527 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:59:23 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-a9509cf9-54d2-45b8-b12b-f90efdb756c8 tempest-VolumesSnapshotTestJSON-234340527 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:59:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a9509cf9-54d2-45b8-b12b-f90efdb756c8 tempest-VolumesSnapshotTestJSON-234340527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8102cf13-9a5b-47cf-aa0f-7d4404f39485 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:23 devstack sudo[102363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8102cf13-9a5b-47cf-aa0f-7d4404f39485 1073741824 Sep 28 11:59:23 devstack sudo[102363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:24 devstack sudo[102363]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a9509cf9-54d2-45b8-b12b-f90efdb756c8 tempest-VolumesSnapshotTestJSON-234340527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8102cf13-9a5b-47cf-aa0f-7d4404f39485 1073741824" returned: 0 in 0.481s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a9509cf9-54d2-45b8-b12b-f90efdb756c8 tempest-VolumesSnapshotTestJSON-234340527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8102cf13-9a5b-47cf-aa0f-7d4404f39485 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:24 devstack sudo[102369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8102cf13-9a5b-47cf-aa0f-7d4404f39485 Sep 28 11:59:24 devstack sudo[102369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:24 devstack sudo[102369]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a9509cf9-54d2-45b8-b12b-f90efdb756c8 tempest-VolumesSnapshotTestJSON-234340527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8102cf13-9a5b-47cf-aa0f-7d4404f39485" returned: 0 in 0.485s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a9509cf9-54d2-45b8-b12b-f90efdb756c8 tempest-VolumesSnapshotTestJSON-234340527 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:59:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a9509cf9-54d2-45b8-b12b-f90efdb756c8 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:59:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a9509cf9-54d2-45b8-b12b-f90efdb756c8 tempest-VolumesSnapshotTestJSON-234340527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88767bb1-7a97-438e-9ec8-38820ac7f874) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8102cf13-9a5b-47cf-aa0f-7d4404f39485', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a9509cf9-54d2-45b8-b12b-f90efdb756c8 tempest-VolumesSnapshotTestJSON-234340527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f814d4c3-971c-4669-a1c3-ca72e119d9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:24 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-a9509cf9-54d2-45b8-b12b-f90efdb756c8 tempest-VolumesSnapshotTestJSON-234340527 None] Volume volume-8102cf13-9a5b-47cf-aa0f-7d4404f39485 (8102cf13-9a5b-47cf-aa0f-7d4404f39485): created successfully Sep 28 11:59:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a9509cf9-54d2-45b8-b12b-f90efdb756c8 tempest-VolumesSnapshotTestJSON-234340527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f814d4c3-971c-4669-a1c3-ca72e119d9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a9509cf9-54d2-45b8-b12b-f90efdb756c8 tempest-VolumesSnapshotTestJSON-234340527 None] Flow 'volume_create_manager' (32232411-3b9b-44d5-9a3c-5ca37aa1b725) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:59:24 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-a9509cf9-54d2-45b8-b12b-f90efdb756c8 tempest-VolumesSnapshotTestJSON-234340527 None] Created volume successfully. Sep 28 11:59:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-94ac38db-cbbe-42a0-8fa2-9158aa710694 tempest-VolumesSnapshotTestJSON-234340527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:59:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-94ac38db-cbbe-42a0-8fa2-9158aa710694 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:59:26 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-94ac38db-cbbe-42a0-8fa2-9158aa710694 tempest-VolumesSnapshotTestJSON-234340527 None] Creating offline snapshot ca66b3aa-5d68-4fda-84ed-e65d3ed924a7 of volume 8102cf13-9a5b-47cf-aa0f-7d4404f39485 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 11:59:26 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6606750-f99f-4c88-bb6e-e34d711d4892]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:59:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-94ac38db-cbbe-42a0-8fa2-9158aa710694 tempest-VolumesSnapshotTestJSON-234340527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8102cf13-9a5b-47cf-aa0f-7d4404f39485 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:26 devstack sudo[102373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8102cf13-9a5b-47cf-aa0f-7d4404f39485 Sep 28 11:59:26 devstack sudo[102373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:26 devstack sudo[102373]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-94ac38db-cbbe-42a0-8fa2-9158aa710694 tempest-VolumesSnapshotTestJSON-234340527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8102cf13-9a5b-47cf-aa0f-7d4404f39485" returned: 0 in 0.495s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-94ac38db-cbbe-42a0-8fa2-9158aa710694 tempest-VolumesSnapshotTestJSON-234340527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8102cf13-9a5b-47cf-aa0f-7d4404f39485,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8102cf13-9a5b-47cf-aa0f-7d4404f39485.ca66b3aa-5d68-4fda-84ed-e65d3ed924a7 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:26 devstack sudo[102378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8102cf13-9a5b-47cf-aa0f-7d4404f39485,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8102cf13-9a5b-47cf-aa0f-7d4404f39485.ca66b3aa-5d68-4fda-84ed-e65d3ed924a7 1G Sep 28 11:59:26 devstack sudo[102378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:27 devstack sudo[102378]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-94ac38db-cbbe-42a0-8fa2-9158aa710694 tempest-VolumesSnapshotTestJSON-234340527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8102cf13-9a5b-47cf-aa0f-7d4404f39485,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8102cf13-9a5b-47cf-aa0f-7d4404f39485.ca66b3aa-5d68-4fda-84ed-e65d3ed924a7 1G" returned: 0 in 0.538s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-94ac38db-cbbe-42a0-8fa2-9158aa710694 tempest-VolumesSnapshotTestJSON-234340527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8102cf13-9a5b-47cf-aa0f-7d4404f39485 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8102cf13-9a5b-47cf-aa0f-7d4404f39485.ca66b3aa-5d68-4fda-84ed-e65d3ed924a7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:27 devstack sudo[102383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8102cf13-9a5b-47cf-aa0f-7d4404f39485 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8102cf13-9a5b-47cf-aa0f-7d4404f39485.ca66b3aa-5d68-4fda-84ed-e65d3ed924a7 Sep 28 11:59:27 devstack sudo[102383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:27 devstack sudo[102383]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-94ac38db-cbbe-42a0-8fa2-9158aa710694 tempest-VolumesSnapshotTestJSON-234340527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8102cf13-9a5b-47cf-aa0f-7d4404f39485 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8102cf13-9a5b-47cf-aa0f-7d4404f39485.ca66b3aa-5d68-4fda-84ed-e65d3ed924a7" returned: 0 in 0.319s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:27 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-94ac38db-cbbe-42a0-8fa2-9158aa710694 tempest-VolumesSnapshotTestJSON-234340527 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8102cf13-9a5b-47cf-aa0f-7d4404f39485.ca66b3aa-5d68-4fda-84ed-e65d3ed924a7 is being set with open permissions: ugo+rw Sep 28 11:59:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-94ac38db-cbbe-42a0-8fa2-9158aa710694 tempest-VolumesSnapshotTestJSON-234340527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8102cf13-9a5b-47cf-aa0f-7d4404f39485.ca66b3aa-5d68-4fda-84ed-e65d3ed924a7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:27 devstack sudo[102388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8102cf13-9a5b-47cf-aa0f-7d4404f39485.ca66b3aa-5d68-4fda-84ed-e65d3ed924a7 Sep 28 11:59:27 devstack sudo[102388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:27 devstack sudo[102388]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-94ac38db-cbbe-42a0-8fa2-9158aa710694 tempest-VolumesSnapshotTestJSON-234340527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8102cf13-9a5b-47cf-aa0f-7d4404f39485.ca66b3aa-5d68-4fda-84ed-e65d3ed924a7" returned: 0 in 0.250s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-94ac38db-cbbe-42a0-8fa2-9158aa710694 tempest-VolumesSnapshotTestJSON-234340527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8102cf13-9a5b-47cf-aa0f-7d4404f39485.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:27 devstack sudo[102391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8102cf13-9a5b-47cf-aa0f-7d4404f39485.info Sep 28 11:59:27 devstack sudo[102391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:28 devstack sudo[102391]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-94ac38db-cbbe-42a0-8fa2-9158aa710694 tempest-VolumesSnapshotTestJSON-234340527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8102cf13-9a5b-47cf-aa0f-7d4404f39485.info" returned: 0 in 0.356s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:28 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-94ac38db-cbbe-42a0-8fa2-9158aa710694 tempest-VolumesSnapshotTestJSON-234340527 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8102cf13-9a5b-47cf-aa0f-7d4404f39485.info is being set with open permissions: ugo+rw Sep 28 11:59:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-94ac38db-cbbe-42a0-8fa2-9158aa710694 tempest-VolumesSnapshotTestJSON-234340527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8102cf13-9a5b-47cf-aa0f-7d4404f39485.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:28 devstack sudo[102395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8102cf13-9a5b-47cf-aa0f-7d4404f39485.info Sep 28 11:59:28 devstack sudo[102395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:28 devstack sudo[102395]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-94ac38db-cbbe-42a0-8fa2-9158aa710694 tempest-VolumesSnapshotTestJSON-234340527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8102cf13-9a5b-47cf-aa0f-7d4404f39485.info" returned: 0 in 0.270s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-94ac38db-cbbe-42a0-8fa2-9158aa710694 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.361s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:59:28 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-94ac38db-cbbe-42a0-8fa2-9158aa710694 tempest-VolumesSnapshotTestJSON-234340527 None] Create snapshot completed successfully Sep 28 11:59:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-77502a35-15e1-4832-b1de-3dbf892350c5 tempest-VolumesSnapshotTestJSON-234340527 None] Acquiring lock "cinder-ca66b3aa-5d68-4fda-84ed-e65d3ed924a7-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:59:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-77502a35-15e1-4832-b1de-3dbf892350c5 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "cinder-ca66b3aa-5d68-4fda-84ed-e65d3ed924a7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:59:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-77502a35-15e1-4832-b1de-3dbf892350c5 tempest-VolumesSnapshotTestJSON-234340527 None] Acquiring lock "cinder-quobyte-8102cf13-9a5b-47cf-aa0f-7d4404f39485" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:59:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-77502a35-15e1-4832-b1de-3dbf892350c5 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "cinder-quobyte-8102cf13-9a5b-47cf-aa0f-7d4404f39485" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:59:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-77502a35-15e1-4832-b1de-3dbf892350c5 tempest-VolumesSnapshotTestJSON-234340527 None] Acquiring lock "cinder-quobyte-ca66b3aa-5d68-4fda-84ed-e65d3ed924a7" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:59:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-77502a35-15e1-4832-b1de-3dbf892350c5 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "cinder-quobyte-ca66b3aa-5d68-4fda-84ed-e65d3ed924a7" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:59:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-77502a35-15e1-4832-b1de-3dbf892350c5 tempest-VolumesSnapshotTestJSON-234340527 None] Deleting offline snapshot ca66b3aa-5d68-4fda-84ed-e65d3ed924a7 of volume 8102cf13-9a5b-47cf-aa0f-7d4404f39485 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 11:59:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-77502a35-15e1-4832-b1de-3dbf892350c5 tempest-VolumesSnapshotTestJSON-234340527 None] snapshot_file for this snap is: volume-8102cf13-9a5b-47cf-aa0f-7d4404f39485.ca66b3aa-5d68-4fda-84ed-e65d3ed924a7 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 11:59:29 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c92683-77e0-438f-b4cf-a41a0a349212]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:59:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-77502a35-15e1-4832-b1de-3dbf892350c5 tempest-VolumesSnapshotTestJSON-234340527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8102cf13-9a5b-47cf-aa0f-7d4404f39485.ca66b3aa-5d68-4fda-84ed-e65d3ed924a7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:29 devstack sudo[102398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8102cf13-9a5b-47cf-aa0f-7d4404f39485.ca66b3aa-5d68-4fda-84ed-e65d3ed924a7 Sep 28 11:59:29 devstack sudo[102398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:29 devstack sudo[102398]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-77502a35-15e1-4832-b1de-3dbf892350c5 tempest-VolumesSnapshotTestJSON-234340527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8102cf13-9a5b-47cf-aa0f-7d4404f39485.ca66b3aa-5d68-4fda-84ed-e65d3ed924a7" returned: 0 in 0.425s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-77502a35-15e1-4832-b1de-3dbf892350c5 tempest-VolumesSnapshotTestJSON-234340527 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8102cf13-9a5b-47cf-aa0f-7d4404f39485(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 11:59:30 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb3b343-faa5-4626-9b6c-beb2853d55e8]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:59:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-77502a35-15e1-4832-b1de-3dbf892350c5 tempest-VolumesSnapshotTestJSON-234340527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8102cf13-9a5b-47cf-aa0f-7d4404f39485 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:30 devstack sudo[102403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8102cf13-9a5b-47cf-aa0f-7d4404f39485 Sep 28 11:59:30 devstack sudo[102403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:30 devstack sudo[102403]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-77502a35-15e1-4832-b1de-3dbf892350c5 tempest-VolumesSnapshotTestJSON-234340527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8102cf13-9a5b-47cf-aa0f-7d4404f39485" returned: 0 in 0.485s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-77502a35-15e1-4832-b1de-3dbf892350c5 tempest-VolumesSnapshotTestJSON-234340527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8102cf13-9a5b-47cf-aa0f-7d4404f39485.ca66b3aa-5d68-4fda-84ed-e65d3ed924a7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:30 devstack sudo[102409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8102cf13-9a5b-47cf-aa0f-7d4404f39485.ca66b3aa-5d68-4fda-84ed-e65d3ed924a7 Sep 28 11:59:30 devstack sudo[102409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:31 devstack sudo[102409]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-77502a35-15e1-4832-b1de-3dbf892350c5 tempest-VolumesSnapshotTestJSON-234340527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8102cf13-9a5b-47cf-aa0f-7d4404f39485.ca66b3aa-5d68-4fda-84ed-e65d3ed924a7" returned: 0 in 0.504s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-77502a35-15e1-4832-b1de-3dbf892350c5 tempest-VolumesSnapshotTestJSON-234340527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8102cf13-9a5b-47cf-aa0f-7d4404f39485.ca66b3aa-5d68-4fda-84ed-e65d3ed924a7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:31 devstack sudo[102419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8102cf13-9a5b-47cf-aa0f-7d4404f39485.ca66b3aa-5d68-4fda-84ed-e65d3ed924a7 Sep 28 11:59:31 devstack sudo[102419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:31 devstack sudo[102419]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-77502a35-15e1-4832-b1de-3dbf892350c5 tempest-VolumesSnapshotTestJSON-234340527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8102cf13-9a5b-47cf-aa0f-7d4404f39485.ca66b3aa-5d68-4fda-84ed-e65d3ed924a7" returned: 0 in 0.273s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-77502a35-15e1-4832-b1de-3dbf892350c5 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "cinder-quobyte-ca66b3aa-5d68-4fda-84ed-e65d3ed924a7" released by "_delete_snapshot" :: held 1.838s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:59:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-77502a35-15e1-4832-b1de-3dbf892350c5 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "cinder-quobyte-8102cf13-9a5b-47cf-aa0f-7d4404f39485" released by "delete_snapshot" :: held 1.861s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:59:31 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-77502a35-15e1-4832-b1de-3dbf892350c5 tempest-VolumesSnapshotTestJSON-234340527 None] Created reservations ['5e8ef291-b8c3-4ddf-b6f6-e478f2da4b0f', 'ef058e53-185b-4aa9-a92f-becbe2586981', '3878c060-0a42-4edc-8592-4e29f96e8901', '298c1bc7-7bac-447d-9960-bbbf7f7aa11c'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:59:31 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-77502a35-15e1-4832-b1de-3dbf892350c5 tempest-VolumesSnapshotTestJSON-234340527 None] Delete snapshot completed successfully. Sep 28 11:59:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-77502a35-15e1-4832-b1de-3dbf892350c5 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "cinder-ca66b3aa-5d68-4fda-84ed-e65d3ed924a7-delete_snapshot" released by "delete_snapshot" :: held 2.058s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:59:32 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-933833ca-ac65-4b64-9c03-ca360cdef8d1 tempest-VolumesSnapshotTestJSON-234340527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:59:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-933833ca-ac65-4b64-9c03-ca360cdef8d1 tempest-VolumesSnapshotTestJSON-234340527 None] Flow 'volume_create_manager' (bb35316f-2e8e-40a3-9fd6-f343456e41ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:59:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-933833ca-ac65-4b64-9c03-ca360cdef8d1 tempest-VolumesSnapshotTestJSON-234340527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67b28fec-79b9-45d8-ba2f-cb0762a46f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-933833ca-ac65-4b64-9c03-ca360cdef8d1 tempest-VolumesSnapshotTestJSON-234340527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67b28fec-79b9-45d8-ba2f-cb0762a46f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:59:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1137065737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af0a1c30-4cdf-420e-a887-caec4321e33f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb928adbcb8b424f94e03b26751e1eb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:59:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:59:32Z,use_quota=True,user_id='1708eb324dc5445894a1a92f35e5d748',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-933833ca-ac65-4b64-9c03-ca360cdef8d1 tempest-VolumesSnapshotTestJSON-234340527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54a276bc-6c80-4421-9db3-ff4b0389e352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-933833ca-ac65-4b64-9c03-ca360cdef8d1 tempest-VolumesSnapshotTestJSON-234340527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54a276bc-6c80-4421-9db3-ff4b0389e352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-933833ca-ac65-4b64-9c03-ca360cdef8d1 tempest-VolumesSnapshotTestJSON-234340527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1d9795a-bd21-4bbe-a53f-1564179c5776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-933833ca-ac65-4b64-9c03-ca360cdef8d1 tempest-VolumesSnapshotTestJSON-234340527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1d9795a-bd21-4bbe-a53f-1564179c5776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af0a1c30-4cdf-420e-a887-caec4321e33f', 'volume_name': 'volume-af0a1c30-4cdf-420e-a887-caec4321e33f', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-933833ca-ac65-4b64-9c03-ca360cdef8d1 tempest-VolumesSnapshotTestJSON-234340527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a38229c-d783-45cf-9d7f-b63a18f3bc2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-933833ca-ac65-4b64-9c03-ca360cdef8d1 tempest-VolumesSnapshotTestJSON-234340527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a38229c-d783-45cf-9d7f-b63a18f3bc2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-933833ca-ac65-4b64-9c03-ca360cdef8d1 tempest-VolumesSnapshotTestJSON-234340527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edd5e9af-534b-45fb-a9e5-35311cd67ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:32 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-933833ca-ac65-4b64-9c03-ca360cdef8d1 tempest-VolumesSnapshotTestJSON-234340527 None] Volume af0a1c30-4cdf-420e-a887-caec4321e33f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af0a1c30-4cdf-420e-a887-caec4321e33f', 'volume_size': 1} Sep 28 11:59:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-933833ca-ac65-4b64-9c03-ca360cdef8d1 tempest-VolumesSnapshotTestJSON-234340527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:59:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-933833ca-ac65-4b64-9c03-ca360cdef8d1 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:59:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-933833ca-ac65-4b64-9c03-ca360cdef8d1 tempest-VolumesSnapshotTestJSON-234340527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:59:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1137065737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af0a1c30-4cdf-420e-a887-caec4321e33f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb928adbcb8b424f94e03b26751e1eb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:59:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:59:32Z,use_quota=True,user_id='1708eb324dc5445894a1a92f35e5d748',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:59:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-933833ca-ac65-4b64-9c03-ca360cdef8d1 tempest-VolumesSnapshotTestJSON-234340527 None] Creating volume af0a1c30-4cdf-420e-a887-caec4321e33f {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:59:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-933833ca-ac65-4b64-9c03-ca360cdef8d1 tempest-VolumesSnapshotTestJSON-234340527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:59:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-933833ca-ac65-4b64-9c03-ca360cdef8d1 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:59:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-933833ca-ac65-4b64-9c03-ca360cdef8d1 tempest-VolumesSnapshotTestJSON-234340527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:59:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-933833ca-ac65-4b64-9c03-ca360cdef8d1 tempest-VolumesSnapshotTestJSON-234340527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:59:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-933833ca-ac65-4b64-9c03-ca360cdef8d1 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:59:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-933833ca-ac65-4b64-9c03-ca360cdef8d1 tempest-VolumesSnapshotTestJSON-234340527 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:59:32 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-933833ca-ac65-4b64-9c03-ca360cdef8d1 tempest-VolumesSnapshotTestJSON-234340527 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:59:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-933833ca-ac65-4b64-9c03-ca360cdef8d1 tempest-VolumesSnapshotTestJSON-234340527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af0a1c30-4cdf-420e-a887-caec4321e33f 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:32 devstack sudo[102422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af0a1c30-4cdf-420e-a887-caec4321e33f 1073741824 Sep 28 11:59:32 devstack sudo[102422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:32 devstack sudo[102422]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-933833ca-ac65-4b64-9c03-ca360cdef8d1 tempest-VolumesSnapshotTestJSON-234340527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af0a1c30-4cdf-420e-a887-caec4321e33f 1073741824" returned: 0 in 0.576s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-933833ca-ac65-4b64-9c03-ca360cdef8d1 tempest-VolumesSnapshotTestJSON-234340527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af0a1c30-4cdf-420e-a887-caec4321e33f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:33 devstack sudo[102429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af0a1c30-4cdf-420e-a887-caec4321e33f Sep 28 11:59:33 devstack sudo[102429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:33 devstack sudo[102429]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-933833ca-ac65-4b64-9c03-ca360cdef8d1 tempest-VolumesSnapshotTestJSON-234340527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af0a1c30-4cdf-420e-a887-caec4321e33f" returned: 0 in 0.417s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-933833ca-ac65-4b64-9c03-ca360cdef8d1 tempest-VolumesSnapshotTestJSON-234340527 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:59:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-933833ca-ac65-4b64-9c03-ca360cdef8d1 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:59:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-933833ca-ac65-4b64-9c03-ca360cdef8d1 tempest-VolumesSnapshotTestJSON-234340527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edd5e9af-534b-45fb-a9e5-35311cd67ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af0a1c30-4cdf-420e-a887-caec4321e33f', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-933833ca-ac65-4b64-9c03-ca360cdef8d1 tempest-VolumesSnapshotTestJSON-234340527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38f0291e-abd3-42cd-b4c7-1acbc6881ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:33 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-933833ca-ac65-4b64-9c03-ca360cdef8d1 tempest-VolumesSnapshotTestJSON-234340527 None] Volume volume-af0a1c30-4cdf-420e-a887-caec4321e33f (af0a1c30-4cdf-420e-a887-caec4321e33f): created successfully Sep 28 11:59:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-933833ca-ac65-4b64-9c03-ca360cdef8d1 tempest-VolumesSnapshotTestJSON-234340527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38f0291e-abd3-42cd-b4c7-1acbc6881ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-933833ca-ac65-4b64-9c03-ca360cdef8d1 tempest-VolumesSnapshotTestJSON-234340527 None] Flow 'volume_create_manager' (bb35316f-2e8e-40a3-9fd6-f343456e41ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:59:33 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-933833ca-ac65-4b64-9c03-ca360cdef8d1 tempest-VolumesSnapshotTestJSON-234340527 None] Created volume successfully. Sep 28 11:59:33 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:59:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] Flow 'volume_create_manager' (81345fd4-63f7-4bea-8320-dfb8fd443fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:59:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (206b91c3-61f4-4feb-b80a-d5ad5f6b16b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (206b91c3-61f4-4feb-b80a-d5ad5f6b16b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:59:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-987720030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3abe0bd6-edc9-4431-851c-171bed97922b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d7cf83e409c45b2b6e1a84205dabbaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:59:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:59:33Z,use_quota=True,user_id='8751ab72ad7d4280be13b704f8c0c72b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e134261-7936-4cdd-b717-628faaad83a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e134261-7936-4cdd-b717-628faaad83a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c99a578c-d07a-4b37-a305-2ae7e85529e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:33 devstack cinder-volume[86916]: DEBUG cinder.image.glance [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] Creating Keystone auth plugin from conf {{(pid=86916) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 11:59:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c99a578c-d07a-4b37-a305-2ae7e85529e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3abe0bd6-edc9-4431-851c-171bed97922b', 'volume_name': 'volume-3abe0bd6-edc9-4431-851c-171bed97922b', 'volume_size': 1, 'image_id': '5400a738-7bf7-408f-b314-8b5954ac2b81', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5400a738-7bf7-408f-b314-8b5954ac2b81', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0c8ef073bf9e4608b40db55c7aa6c23c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5400a738-7bf7-408f-b314-8b5954ac2b81', 'created_at': datetime.datetime(2026, 9, 28, 9, 39, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 9, 39, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5400a738-7bf7-408f-b314-8b5954ac2b81/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af8f747e-6ec2-4240-baf6-d509d0926f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af8f747e-6ec2-4240-baf6-d509d0926f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f68210e2-36f4-457c-88a1-f3ff7c10aafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:33 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] Volume 3abe0bd6-edc9-4431-851c-171bed97922b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3abe0bd6-edc9-4431-851c-171bed97922b', 'volume_size': 1, 'image_id': '5400a738-7bf7-408f-b314-8b5954ac2b81', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5400a738-7bf7-408f-b314-8b5954ac2b81', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0c8ef073bf9e4608b40db55c7aa6c23c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5400a738-7bf7-408f-b314-8b5954ac2b81', 'created_at': datetime.datetime(2026, 9, 28, 9, 39, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 9, 39, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5400a738-7bf7-408f-b314-8b5954ac2b81/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 11:59:33 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] Trying to clone 3abe0bd6-edc9-4431-851c-171bed97922b from image 5400a738-7bf7-408f-b314-8b5954ac2b81 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5400a738-7bf7-408f-b314-8b5954ac2b81', 'metadata': {}}]). {{(pid=86916) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 11:59:34 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_y8vf03yndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 11:59:34 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] Image download 20.69 MB at 20.69 MB/s Sep 28 11:59:34 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eae4843-71b4-4977-89b7-f7d1e48f307f]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:59:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_y8vf03yndevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:34 devstack sudo[102433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_y8vf03yndevstack@QuobyteHD Sep 28 11:59:34 devstack sudo[102433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bd9a9864-e0e6-4d41-a9bb-929e6fafcd47 tempest-VolumesSnapshotTestJSON-234340527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:59:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bd9a9864-e0e6-4d41-a9bb-929e6fafcd47 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:59:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-bd9a9864-e0e6-4d41-a9bb-929e6fafcd47 tempest-VolumesSnapshotTestJSON-234340527 None] Creating offline snapshot e62a97c1-0f0e-4426-a34c-14ea34101f6d of volume af0a1c30-4cdf-420e-a887-caec4321e33f {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 11:59:34 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b6eca7-a87e-40fd-94c1-53da231207c6]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:59:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bd9a9864-e0e6-4d41-a9bb-929e6fafcd47 tempest-VolumesSnapshotTestJSON-234340527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af0a1c30-4cdf-420e-a887-caec4321e33f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:34 devstack sudo[102435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af0a1c30-4cdf-420e-a887-caec4321e33f Sep 28 11:59:34 devstack sudo[102435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:34 devstack sudo[102433]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_y8vf03yndevstack@QuobyteHD" returned: 0 in 0.461s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:34 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] Temporary image 5400a738-7bf7-408f-b314-8b5954ac2b81 is fetched for user 8751ab72ad7d4280be13b704f8c0c72b. {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 11:59:34 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2d371b-cac1-4d5c-8dc6-fb48cc3f91a1]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:59:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_y8vf03yndevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:35 devstack sudo[102441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_y8vf03yndevstack@QuobyteHD Sep 28 11:59:35 devstack sudo[102441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:35 devstack sudo[102435]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bd9a9864-e0e6-4d41-a9bb-929e6fafcd47 tempest-VolumesSnapshotTestJSON-234340527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af0a1c30-4cdf-420e-a887-caec4321e33f" returned: 0 in 0.411s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bd9a9864-e0e6-4d41-a9bb-929e6fafcd47 tempest-VolumesSnapshotTestJSON-234340527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af0a1c30-4cdf-420e-a887-caec4321e33f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af0a1c30-4cdf-420e-a887-caec4321e33f.e62a97c1-0f0e-4426-a34c-14ea34101f6d 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:35 devstack sudo[102446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af0a1c30-4cdf-420e-a887-caec4321e33f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af0a1c30-4cdf-420e-a887-caec4321e33f.e62a97c1-0f0e-4426-a34c-14ea34101f6d 1G Sep 28 11:59:35 devstack sudo[102446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:35 devstack sudo[102441]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_y8vf03yndevstack@QuobyteHD" returned: 0 in 0.381s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:59:35 devstack sudo[102446]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bd9a9864-e0e6-4d41-a9bb-929e6fafcd47 tempest-VolumesSnapshotTestJSON-234340527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af0a1c30-4cdf-420e-a887-caec4321e33f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af0a1c30-4cdf-420e-a887-caec4321e33f.e62a97c1-0f0e-4426-a34c-14ea34101f6d 1G" returned: 0 in 0.435s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bd9a9864-e0e6-4d41-a9bb-929e6fafcd47 tempest-VolumesSnapshotTestJSON-234340527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af0a1c30-4cdf-420e-a887-caec4321e33f -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af0a1c30-4cdf-420e-a887-caec4321e33f.e62a97c1-0f0e-4426-a34c-14ea34101f6d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:35 devstack sudo[102455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af0a1c30-4cdf-420e-a887-caec4321e33f -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af0a1c30-4cdf-420e-a887-caec4321e33f.e62a97c1-0f0e-4426-a34c-14ea34101f6d Sep 28 11:59:35 devstack sudo[102455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:35 devstack sudo[102455]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bd9a9864-e0e6-4d41-a9bb-929e6fafcd47 tempest-VolumesSnapshotTestJSON-234340527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af0a1c30-4cdf-420e-a887-caec4321e33f -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af0a1c30-4cdf-420e-a887-caec4321e33f.e62a97c1-0f0e-4426-a34c-14ea34101f6d" returned: 0 in 0.332s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:35 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-bd9a9864-e0e6-4d41-a9bb-929e6fafcd47 tempest-VolumesSnapshotTestJSON-234340527 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af0a1c30-4cdf-420e-a887-caec4321e33f.e62a97c1-0f0e-4426-a34c-14ea34101f6d is being set with open permissions: ugo+rw Sep 28 11:59:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bd9a9864-e0e6-4d41-a9bb-929e6fafcd47 tempest-VolumesSnapshotTestJSON-234340527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af0a1c30-4cdf-420e-a887-caec4321e33f.e62a97c1-0f0e-4426-a34c-14ea34101f6d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:35 devstack sudo[102461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af0a1c30-4cdf-420e-a887-caec4321e33f.e62a97c1-0f0e-4426-a34c-14ea34101f6d Sep 28 11:59:35 devstack sudo[102461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:36 devstack sudo[102461]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bd9a9864-e0e6-4d41-a9bb-929e6fafcd47 tempest-VolumesSnapshotTestJSON-234340527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af0a1c30-4cdf-420e-a887-caec4321e33f.e62a97c1-0f0e-4426-a34c-14ea34101f6d" returned: 0 in 0.282s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bd9a9864-e0e6-4d41-a9bb-929e6fafcd47 tempest-VolumesSnapshotTestJSON-234340527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af0a1c30-4cdf-420e-a887-caec4321e33f.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:36 devstack sudo[102466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af0a1c30-4cdf-420e-a887-caec4321e33f.info Sep 28 11:59:36 devstack sudo[102466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:36 devstack sudo[102466]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bd9a9864-e0e6-4d41-a9bb-929e6fafcd47 tempest-VolumesSnapshotTestJSON-234340527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af0a1c30-4cdf-420e-a887-caec4321e33f.info" returned: 0 in 0.247s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:36 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-bd9a9864-e0e6-4d41-a9bb-929e6fafcd47 tempest-VolumesSnapshotTestJSON-234340527 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af0a1c30-4cdf-420e-a887-caec4321e33f.info is being set with open permissions: ugo+rw Sep 28 11:59:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bd9a9864-e0e6-4d41-a9bb-929e6fafcd47 tempest-VolumesSnapshotTestJSON-234340527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af0a1c30-4cdf-420e-a887-caec4321e33f.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:36 devstack sudo[102469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af0a1c30-4cdf-420e-a887-caec4321e33f.info Sep 28 11:59:36 devstack sudo[102469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:36 devstack sudo[102469]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bd9a9864-e0e6-4d41-a9bb-929e6fafcd47 tempest-VolumesSnapshotTestJSON-234340527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af0a1c30-4cdf-420e-a887-caec4321e33f.info" returned: 0 in 0.255s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bd9a9864-e0e6-4d41-a9bb-929e6fafcd47 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.061s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:59:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.381s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:59:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:59:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-987720030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3abe0bd6-edc9-4431-851c-171bed97922b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d7cf83e409c45b2b6e1a84205dabbaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:59:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:59:33Z,use_quota=True,user_id='8751ab72ad7d4280be13b704f8c0c72b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:59:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] Creating volume 3abe0bd6-edc9-4431-851c-171bed97922b {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:59:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:59:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:59:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:59:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:59:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:59:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:59:36 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:59:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3abe0bd6-edc9-4431-851c-171bed97922b 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:36 devstack sudo[102472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3abe0bd6-edc9-4431-851c-171bed97922b 1073741824 Sep 28 11:59:36 devstack sudo[102472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:36 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-bd9a9864-e0e6-4d41-a9bb-929e6fafcd47 tempest-VolumesSnapshotTestJSON-234340527 None] Create snapshot completed successfully Sep 28 11:59:37 devstack sudo[102472]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3abe0bd6-edc9-4431-851c-171bed97922b 1073741824" returned: 0 in 0.565s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3abe0bd6-edc9-4431-851c-171bed97922b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:37 devstack sudo[102478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3abe0bd6-edc9-4431-851c-171bed97922b Sep 28 11:59:37 devstack sudo[102478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:37 devstack sudo[102478]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3abe0bd6-edc9-4431-851c-171bed97922b" returned: 0 in 0.266s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:59:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:59:37 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] Attempting download of 5400a738-7bf7-408f-b314-8b5954ac2b81 ((None, [{'url': 'file:///opt/stack/data/glance/images/5400a738-7bf7-408f-b314-8b5954ac2b81', 'metadata': {}}])) to volume 3abe0bd6-edc9-4431-851c-171bed97922b. {{(pid=86916) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 11:59:37 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17d4fb1-8aa4-4bb7-a811-66ba7c545019]: (4, 'raw') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:59:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5400a738-7bf7-408f-b314-8b5954ac2b81_xkqj7gwk {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:37 devstack sudo[102482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5400a738-7bf7-408f-b314-8b5954ac2b81_xkqj7gwk Sep 28 11:59:37 devstack sudo[102482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:38 devstack sudo[102482]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5400a738-7bf7-408f-b314-8b5954ac2b81_xkqj7gwk" returned: 0 in 0.410s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5400a738-7bf7-408f-b314-8b5954ac2b81_xkqj7gwk {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:38 devstack sudo[102486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5400a738-7bf7-408f-b314-8b5954ac2b81_xkqj7gwk Sep 28 11:59:38 devstack sudo[102486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:38 devstack sudo[102486]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5400a738-7bf7-408f-b314-8b5954ac2b81_xkqj7gwk" returned: 1 in 0.408s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5400a738-7bf7-408f-b314-8b5954ac2b81_xkqj7gwk' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 11:59:38 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb551263-198e-4acd-99ba-7ee34b611874]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:59:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_y8vf03yndevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:38 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a5eb654-3d90-4902-8d70-0c74b9371c7b tempest-VolumesSnapshotTestJSON-234340527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:59:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6a5eb654-3d90-4902-8d70-0c74b9371c7b tempest-VolumesSnapshotTestJSON-234340527 None] Flow 'volume_create_manager' (a361b9d7-1f60-450e-8361-b577313d0d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:59:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6a5eb654-3d90-4902-8d70-0c74b9371c7b tempest-VolumesSnapshotTestJSON-234340527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2951dfeb-efe0-43b1-a20e-8356f903069f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6a5eb654-3d90-4902-8d70-0c74b9371c7b tempest-VolumesSnapshotTestJSON-234340527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2951dfeb-efe0-43b1-a20e-8356f903069f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:59:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1225025059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fc22f03-ab55-45d9-a194-ccf1df5ede80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb928adbcb8b424f94e03b26751e1eb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:59:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=e62a97c1-0f0e-4426-a34c-14ea34101f6d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:59:38Z,use_quota=True,user_id='1708eb324dc5445894a1a92f35e5d748',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6a5eb654-3d90-4902-8d70-0c74b9371c7b tempest-VolumesSnapshotTestJSON-234340527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcebd261-68f5-4f36-9ac0-9d6c9a359f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6a5eb654-3d90-4902-8d70-0c74b9371c7b tempest-VolumesSnapshotTestJSON-234340527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcebd261-68f5-4f36-9ac0-9d6c9a359f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6a5eb654-3d90-4902-8d70-0c74b9371c7b tempest-VolumesSnapshotTestJSON-234340527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef488d6e-e6bc-4965-b6d8-35a7d94362aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6a5eb654-3d90-4902-8d70-0c74b9371c7b tempest-VolumesSnapshotTestJSON-234340527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef488d6e-e6bc-4965-b6d8-35a7d94362aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5fc22f03-ab55-45d9-a194-ccf1df5ede80', 'volume_name': 'volume-5fc22f03-ab55-45d9-a194-ccf1df5ede80', 'volume_size': 2, 'snapshot_id': 'e62a97c1-0f0e-4426-a34c-14ea34101f6d'}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6a5eb654-3d90-4902-8d70-0c74b9371c7b tempest-VolumesSnapshotTestJSON-234340527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13c85b9e-fd43-4c34-ba82-299d62b25a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:38 devstack sudo[102490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_y8vf03yndevstack@QuobyteHD Sep 28 11:59:38 devstack sudo[102490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6a5eb654-3d90-4902-8d70-0c74b9371c7b tempest-VolumesSnapshotTestJSON-234340527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13c85b9e-fd43-4c34-ba82-299d62b25a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6a5eb654-3d90-4902-8d70-0c74b9371c7b tempest-VolumesSnapshotTestJSON-234340527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79c53727-8475-4306-b56f-c96ac013ec1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:38 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-6a5eb654-3d90-4902-8d70-0c74b9371c7b tempest-VolumesSnapshotTestJSON-234340527 None] Volume 5fc22f03-ab55-45d9-a194-ccf1df5ede80: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5fc22f03-ab55-45d9-a194-ccf1df5ede80', 'volume_size': 2, 'snapshot_id': 'e62a97c1-0f0e-4426-a34c-14ea34101f6d'} Sep 28 11:59:38 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 11:59:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:59:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:59:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:59:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:59:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:59:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6a5eb654-3d90-4902-8d70-0c74b9371c7b tempest-VolumesSnapshotTestJSON-234340527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:59:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6a5eb654-3d90-4902-8d70-0c74b9371c7b tempest-VolumesSnapshotTestJSON-234340527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:59:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6a5eb654-3d90-4902-8d70-0c74b9371c7b tempest-VolumesSnapshotTestJSON-234340527 None] Acquiring lock "cinder-quobyte-e62a97c1-0f0e-4426-a34c-14ea34101f6d-5fc22f03-ab55-45d9-a194-ccf1df5ede80" by "_create_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:59:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6a5eb654-3d90-4902-8d70-0c74b9371c7b tempest-VolumesSnapshotTestJSON-234340527 None] Lock "cinder-quobyte-e62a97c1-0f0e-4426-a34c-14ea34101f6d-5fc22f03-ab55-45d9-a194-ccf1df5ede80" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:59:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6a5eb654-3d90-4902-8d70-0c74b9371c7b tempest-VolumesSnapshotTestJSON-234340527 None] Creating volume 5fc22f03-ab55-45d9-a194-ccf1df5ede80 from snapshot e62a97c1-0f0e-4426-a34c-14ea34101f6d {{(pid=86916) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 11:59:38 devstack sudo[102492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:59:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6a5eb654-3d90-4902-8d70-0c74b9371c7b tempest-VolumesSnapshotTestJSON-234340527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:59:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6a5eb654-3d90-4902-8d70-0c74b9371c7b tempest-VolumesSnapshotTestJSON-234340527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:59:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6a5eb654-3d90-4902-8d70-0c74b9371c7b tempest-VolumesSnapshotTestJSON-234340527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:59:38 devstack sudo[102492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6a5eb654-3d90-4902-8d70-0c74b9371c7b tempest-VolumesSnapshotTestJSON-234340527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:59:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6a5eb654-3d90-4902-8d70-0c74b9371c7b tempest-VolumesSnapshotTestJSON-234340527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:59:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6a5eb654-3d90-4902-8d70-0c74b9371c7b tempest-VolumesSnapshotTestJSON-234340527 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:59:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6a5eb654-3d90-4902-8d70-0c74b9371c7b tempest-VolumesSnapshotTestJSON-234340527 None] Acquiring lock "cinder-quobyte-5fc22f03-ab55-45d9-a194-ccf1df5ede80" by "_copy_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:59:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6a5eb654-3d90-4902-8d70-0c74b9371c7b tempest-VolumesSnapshotTestJSON-234340527 None] Lock "cinder-quobyte-5fc22f03-ab55-45d9-a194-ccf1df5ede80" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:59:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6a5eb654-3d90-4902-8d70-0c74b9371c7b tempest-VolumesSnapshotTestJSON-234340527 None] snapshot: e62a97c1-0f0e-4426-a34c-14ea34101f6d, volume: 5fc22f03-ab55-45d9-a194-ccf1df5ede80, {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 11:59:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6a5eb654-3d90-4902-8d70-0c74b9371c7b tempest-VolumesSnapshotTestJSON-234340527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:59:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6a5eb654-3d90-4902-8d70-0c74b9371c7b tempest-VolumesSnapshotTestJSON-234340527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:59:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6a5eb654-3d90-4902-8d70-0c74b9371c7b tempest-VolumesSnapshotTestJSON-234340527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:59:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6a5eb654-3d90-4902-8d70-0c74b9371c7b tempest-VolumesSnapshotTestJSON-234340527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:59:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6a5eb654-3d90-4902-8d70-0c74b9371c7b tempest-VolumesSnapshotTestJSON-234340527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:59:38 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[adbf0c13-fa65-4b8e-a60a-438a563ee198]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:59:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6a5eb654-3d90-4902-8d70-0c74b9371c7b tempest-VolumesSnapshotTestJSON-234340527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af0a1c30-4cdf-420e-a887-caec4321e33f.e62a97c1-0f0e-4426-a34c-14ea34101f6d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:38 devstack sudo[102490]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_y8vf03yndevstack@QuobyteHD" returned: 0 in 0.416s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:38 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] 5400a738-7bf7-408f-b314-8b5954ac2b81 was qcow2, converting to qcow2 {{(pid=86916) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 11:59:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_y8vf03yndevstack@QuobyteHD /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3abe0bd6-edc9-4431-851c-171bed97922b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:38 devstack sudo[102499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_y8vf03yndevstack@QuobyteHD /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3abe0bd6-edc9-4431-851c-171bed97922b Sep 28 11:59:38 devstack sudo[102499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:38 devstack sudo[102494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af0a1c30-4cdf-420e-a887-caec4321e33f.e62a97c1-0f0e-4426-a34c-14ea34101f6d Sep 28 11:59:38 devstack sudo[102494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:39 devstack sudo[102492]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.388s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:39 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:59:39 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 11:59:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] thread count: 28 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 11:59:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] thread info: [<_MainThread(MainThread, started 135408582168704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 11:59:39 devstack sudo[102494]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6a5eb654-3d90-4902-8d70-0c74b9371c7b tempest-VolumesSnapshotTestJSON-234340527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af0a1c30-4cdf-420e-a887-caec4321e33f.e62a97c1-0f0e-4426-a34c-14ea34101f6d" returned: 0 in 0.440s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-6a5eb654-3d90-4902-8d70-0c74b9371c7b tempest-VolumesSnapshotTestJSON-234340527 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af0a1c30-4cdf-420e-a887-caec4321e33f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 11:59:39 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f30f4ad-b442-4478-a66f-144f031e2372]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:59:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6a5eb654-3d90-4902-8d70-0c74b9371c7b tempest-VolumesSnapshotTestJSON-234340527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af0a1c30-4cdf-420e-a887-caec4321e33f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:39 devstack sudo[102509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af0a1c30-4cdf-420e-a887-caec4321e33f Sep 28 11:59:39 devstack sudo[102509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:39 devstack sudo[102509]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6a5eb654-3d90-4902-8d70-0c74b9371c7b tempest-VolumesSnapshotTestJSON-234340527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af0a1c30-4cdf-420e-a887-caec4321e33f" returned: 0 in 0.418s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6a5eb654-3d90-4902-8d70-0c74b9371c7b tempest-VolumesSnapshotTestJSON-234340527 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af0a1c30-4cdf-420e-a887-caec4321e33f {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 11:59:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6a5eb654-3d90-4902-8d70-0c74b9371c7b tempest-VolumesSnapshotTestJSON-234340527 None] Creating direct copy from snapshot {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 11:59:39 devstack cinder-volume[86916]: DEBUG cinder.utils [None req-6a5eb654-3d90-4902-8d70-0c74b9371c7b tempest-VolumesSnapshotTestJSON-234340527 None] Path /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5fc22f03-ab55-45d9-a194-ccf1df5ede80 not found in is_blk_device check {{(pid=86916) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 11:59:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6a5eb654-3d90-4902-8d70-0c74b9371c7b tempest-VolumesSnapshotTestJSON-234340527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af0a1c30-4cdf-420e-a887-caec4321e33f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5fc22f03-ab55-45d9-a194-ccf1df5ede80 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:39 devstack sudo[102518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af0a1c30-4cdf-420e-a887-caec4321e33f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5fc22f03-ab55-45d9-a194-ccf1df5ede80 Sep 28 11:59:39 devstack sudo[102518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:42 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7abfece-c155-4657-aa41-4ebc03360df8 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:59:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e7abfece-c155-4657-aa41-4ebc03360df8 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Flow 'volume_create_manager' (f9406424-a07b-47e6-a406-9b73f0c38c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:59:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e7abfece-c155-4657-aa41-4ebc03360df8 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96d09cdc-fbb8-4adf-8b73-2f6360fdc9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:42 devstack sudo[102499]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_y8vf03yndevstack@QuobyteHD /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3abe0bd6-edc9-4431-851c-171bed97922b" returned: 0 in 3.531s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:42 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5400a738-7bf7-408f-b314-8b5954ac2b81_y8vf03yndevstack@QuobyteHD, size 112.00 MB, duration 3.53 sec, destination /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3abe0bd6-edc9-4431-851c-171bed97922b {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 11:59:42 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] Converted 112.00 MB image at 31.71 MB/s Sep 28 11:59:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3abe0bd6-edc9-4431-851c-171bed97922b 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e7abfece-c155-4657-aa41-4ebc03360df8 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96d09cdc-fbb8-4adf-8b73-2f6360fdc9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:59:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-290512117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=244241af-b2e2-43a3-ae30-48c5ddf2837f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b40a3c4dea64334951cf95b1908bd14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:59:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:59:42Z,use_quota=True,user_id='4516cc225e0e44f4af91976eee2754fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e7abfece-c155-4657-aa41-4ebc03360df8 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19dc3dcf-bb33-431d-9127-9c8cf19b7f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e7abfece-c155-4657-aa41-4ebc03360df8 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19dc3dcf-bb33-431d-9127-9c8cf19b7f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:42 devstack sudo[102533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3abe0bd6-edc9-4431-851c-171bed97922b 1G Sep 28 11:59:42 devstack sudo[102533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e7abfece-c155-4657-aa41-4ebc03360df8 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7528c7d-f444-410d-946a-e82e0c15e0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e7abfece-c155-4657-aa41-4ebc03360df8 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7528c7d-f444-410d-946a-e82e0c15e0cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '244241af-b2e2-43a3-ae30-48c5ddf2837f', 'volume_name': 'volume-244241af-b2e2-43a3-ae30-48c5ddf2837f', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e7abfece-c155-4657-aa41-4ebc03360df8 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf48c5ae-f569-40b3-91e9-c747edb7f745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e7abfece-c155-4657-aa41-4ebc03360df8 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf48c5ae-f569-40b3-91e9-c747edb7f745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e7abfece-c155-4657-aa41-4ebc03360df8 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fa75533-38d2-42a2-8cf0-46174d1ed1db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:42 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-e7abfece-c155-4657-aa41-4ebc03360df8 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Volume 244241af-b2e2-43a3-ae30-48c5ddf2837f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-244241af-b2e2-43a3-ae30-48c5ddf2837f', 'volume_size': 1} Sep 28 11:59:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e7abfece-c155-4657-aa41-4ebc03360df8 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:59:43 devstack sudo[102533]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3abe0bd6-edc9-4431-851c-171bed97922b 1G" returned: 0 in 0.605s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:43 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] Downloaded image 5400a738-7bf7-408f-b314-8b5954ac2b81 ((None, [{'url': 'file:///opt/stack/data/glance/images/5400a738-7bf7-408f-b314-8b5954ac2b81', 'metadata': {}}])) to volume 3abe0bd6-edc9-4431-851c-171bed97922b successfully. {{(pid=86916) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 11:59:43 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] Temporary image 5400a738-7bf7-408f-b314-8b5954ac2b81 for user 8751ab72ad7d4280be13b704f8c0c72b is deleted. {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 11:59:43 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] Marking volume 3abe0bd6-edc9-4431-851c-171bed97922b as bootable. {{(pid=86916) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 11:59:43 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] Copying metadata from image 5400a738-7bf7-408f-b314-8b5954ac2b81 to 3abe0bd6-edc9-4431-851c-171bed97922b. {{(pid=86916) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 11:59:43 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] Creating volume glance metadata for volume 3abe0bd6-edc9-4431-851c-171bed97922b backed by image 5400a738-7bf7-408f-b314-8b5954ac2b81 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5400a738-7bf7-408f-b314-8b5954ac2b81', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86916) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 11:59:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f68210e2-36f4-457c-88a1-f3ff7c10aafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3abe0bd6-edc9-4431-851c-171bed97922b', 'volume_size': 1, 'image_id': '5400a738-7bf7-408f-b314-8b5954ac2b81', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5400a738-7bf7-408f-b314-8b5954ac2b81', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0c8ef073bf9e4608b40db55c7aa6c23c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5400a738-7bf7-408f-b314-8b5954ac2b81', 'created_at': datetime.datetime(2026, 9, 28, 9, 39, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 9, 39, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5400a738-7bf7-408f-b314-8b5954ac2b81/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf013203-1353-49bc-b37d-b44c6ba4af7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:43 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] Volume volume-3abe0bd6-edc9-4431-851c-171bed97922b (3abe0bd6-edc9-4431-851c-171bed97922b): created successfully Sep 28 11:59:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf013203-1353-49bc-b37d-b44c6ba4af7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] Flow 'volume_create_manager' (81345fd4-63f7-4bea-8320-dfb8fd443fcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:59:43 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-c1e849b7-e166-4006-a1f6-fbce56f7f9cc tempest-TestShelveInstance-1719544345 None] Created volume successfully. Sep 28 11:59:46 devstack sudo[102518]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6a5eb654-3d90-4902-8d70-0c74b9371c7b tempest-VolumesSnapshotTestJSON-234340527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af0a1c30-4cdf-420e-a887-caec4321e33f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5fc22f03-ab55-45d9-a194-ccf1df5ede80" returned: 0 in 6.903s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:46 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-6a5eb654-3d90-4902-8d70-0c74b9371c7b tempest-VolumesSnapshotTestJSON-234340527 None] Image conversion details: src /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af0a1c30-4cdf-420e-a887-caec4321e33f, size 1024.00 MB, duration 6.90 sec, destination /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5fc22f03-ab55-45d9-a194-ccf1df5ede80 {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 11:59:46 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-6a5eb654-3d90-4902-8d70-0c74b9371c7b tempest-VolumesSnapshotTestJSON-234340527 None] Converted 1024.00 MB image at 148.32 MB/s Sep 28 11:59:46 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-6a5eb654-3d90-4902-8d70-0c74b9371c7b tempest-VolumesSnapshotTestJSON-234340527 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5fc22f03-ab55-45d9-a194-ccf1df5ede80 is being set with open permissions: ugo+rw Sep 28 11:59:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6a5eb654-3d90-4902-8d70-0c74b9371c7b tempest-VolumesSnapshotTestJSON-234340527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5fc22f03-ab55-45d9-a194-ccf1df5ede80 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:46 devstack sudo[102541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5fc22f03-ab55-45d9-a194-ccf1df5ede80 Sep 28 11:59:46 devstack sudo[102541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:46 devstack sudo[102541]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6a5eb654-3d90-4902-8d70-0c74b9371c7b tempest-VolumesSnapshotTestJSON-234340527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5fc22f03-ab55-45d9-a194-ccf1df5ede80" returned: 0 in 0.263s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6a5eb654-3d90-4902-8d70-0c74b9371c7b tempest-VolumesSnapshotTestJSON-234340527 None] Lock "cinder-quobyte-5fc22f03-ab55-45d9-a194-ccf1df5ede80" released by "_copy_volume_from_snapshot" :: held 8.164s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:59:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6a5eb654-3d90-4902-8d70-0c74b9371c7b tempest-VolumesSnapshotTestJSON-234340527 None] Lock "cinder-quobyte-e62a97c1-0f0e-4426-a34c-14ea34101f6d-5fc22f03-ab55-45d9-a194-ccf1df5ede80" released by "_create_volume_from_snapshot" :: held 8.246s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:59:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6a5eb654-3d90-4902-8d70-0c74b9371c7b tempest-VolumesSnapshotTestJSON-234340527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.276s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:59:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e7abfece-c155-4657-aa41-4ebc03360df8 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.371s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:59:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e7abfece-c155-4657-aa41-4ebc03360df8 tempest-CreateVolumesFromSnapshotTest-1290784761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:59:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-290512117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=244241af-b2e2-43a3-ae30-48c5ddf2837f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b40a3c4dea64334951cf95b1908bd14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:59:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:59:42Z,use_quota=True,user_id='4516cc225e0e44f4af91976eee2754fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:59:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-e7abfece-c155-4657-aa41-4ebc03360df8 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Creating volume 244241af-b2e2-43a3-ae30-48c5ddf2837f {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:59:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e7abfece-c155-4657-aa41-4ebc03360df8 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:59:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e7abfece-c155-4657-aa41-4ebc03360df8 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:59:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e7abfece-c155-4657-aa41-4ebc03360df8 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:59:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e7abfece-c155-4657-aa41-4ebc03360df8 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:59:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e7abfece-c155-4657-aa41-4ebc03360df8 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:59:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e7abfece-c155-4657-aa41-4ebc03360df8 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:59:46 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-e7abfece-c155-4657-aa41-4ebc03360df8 tempest-CreateVolumesFromSnapshotTest-1290784761 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:59:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e7abfece-c155-4657-aa41-4ebc03360df8 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-244241af-b2e2-43a3-ae30-48c5ddf2837f 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:47 devstack sudo[102544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-244241af-b2e2-43a3-ae30-48c5ddf2837f 1073741824 Sep 28 11:59:47 devstack sudo[102544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6a5eb654-3d90-4902-8d70-0c74b9371c7b tempest-VolumesSnapshotTestJSON-234340527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79c53727-8475-4306-b56f-c96ac013ec1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fc22f03-ab55-45d9-a194-ccf1df5ede80', 'volume_size': 2, 'snapshot_id': 'e62a97c1-0f0e-4426-a34c-14ea34101f6d'}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6a5eb654-3d90-4902-8d70-0c74b9371c7b tempest-VolumesSnapshotTestJSON-234340527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c04577e-dbdf-4f8c-aa40-80af7c564599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:47 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-6a5eb654-3d90-4902-8d70-0c74b9371c7b tempest-VolumesSnapshotTestJSON-234340527 None] Volume volume-5fc22f03-ab55-45d9-a194-ccf1df5ede80 (5fc22f03-ab55-45d9-a194-ccf1df5ede80): created successfully Sep 28 11:59:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6a5eb654-3d90-4902-8d70-0c74b9371c7b tempest-VolumesSnapshotTestJSON-234340527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c04577e-dbdf-4f8c-aa40-80af7c564599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6a5eb654-3d90-4902-8d70-0c74b9371c7b tempest-VolumesSnapshotTestJSON-234340527 None] Flow 'volume_create_manager' (a361b9d7-1f60-450e-8361-b577313d0d88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:59:47 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-6a5eb654-3d90-4902-8d70-0c74b9371c7b tempest-VolumesSnapshotTestJSON-234340527 None] Created volume successfully. Sep 28 11:59:47 devstack sudo[102544]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e7abfece-c155-4657-aa41-4ebc03360df8 tempest-CreateVolumesFromSnapshotTest-1290784761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-244241af-b2e2-43a3-ae30-48c5ddf2837f 1073741824" returned: 0 in 0.462s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e7abfece-c155-4657-aa41-4ebc03360df8 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-244241af-b2e2-43a3-ae30-48c5ddf2837f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:47 devstack sudo[102550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-244241af-b2e2-43a3-ae30-48c5ddf2837f Sep 28 11:59:47 devstack sudo[102550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:47 devstack sudo[102550]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e7abfece-c155-4657-aa41-4ebc03360df8 tempest-CreateVolumesFromSnapshotTest-1290784761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-244241af-b2e2-43a3-ae30-48c5ddf2837f" returned: 0 in 0.271s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e7abfece-c155-4657-aa41-4ebc03360df8 tempest-CreateVolumesFromSnapshotTest-1290784761 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:59:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e7abfece-c155-4657-aa41-4ebc03360df8 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:59:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e7abfece-c155-4657-aa41-4ebc03360df8 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fa75533-38d2-42a2-8cf0-46174d1ed1db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-244241af-b2e2-43a3-ae30-48c5ddf2837f', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e7abfece-c155-4657-aa41-4ebc03360df8 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86c92197-0bc0-4f6b-a8fd-aee760d04c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:47 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-e7abfece-c155-4657-aa41-4ebc03360df8 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Volume volume-244241af-b2e2-43a3-ae30-48c5ddf2837f (244241af-b2e2-43a3-ae30-48c5ddf2837f): created successfully Sep 28 11:59:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e7abfece-c155-4657-aa41-4ebc03360df8 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86c92197-0bc0-4f6b-a8fd-aee760d04c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e7abfece-c155-4657-aa41-4ebc03360df8 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Flow 'volume_create_manager' (f9406424-a07b-47e6-a406-9b73f0c38c97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:59:47 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e7abfece-c155-4657-aa41-4ebc03360df8 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Created volume successfully. Sep 28 11:59:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-004bc0a4-54b8-4c54-9b68-017ee1eebae9 req-43ade7c4-258f-44db-b584-81ddf7f4c8a5 tempest-TestShelveInstance-1719544345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:59:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-004bc0a4-54b8-4c54-9b68-017ee1eebae9 req-43ade7c4-258f-44db-b584-81ddf7f4c8a5 tempest-TestShelveInstance-1719544345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:59:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-004bc0a4-54b8-4c54-9b68-017ee1eebae9 req-43ade7c4-258f-44db-b584-81ddf7f4c8a5 tempest-TestShelveInstance-1719544345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:59:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-004bc0a4-54b8-4c54-9b68-017ee1eebae9 req-43ade7c4-258f-44db-b584-81ddf7f4c8a5 tempest-TestShelveInstance-1719544345 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0', 'name': 'volume-3abe0bd6-edc9-4431-851c-171bed97922b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6c7b9418-12b9-4b40-8217-e3eff02adc2a', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 11:59:48 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-cac30b30-ac06-4ec7-8603-66466faa4ff0 tempest-VolumesSnapshotTestJSON-234340527 None] Acquiring lock "cinder-5fc22f03-ab55-45d9-a194-ccf1df5ede80-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:59:48 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-cac30b30-ac06-4ec7-8603-66466faa4ff0 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "cinder-5fc22f03-ab55-45d9-a194-ccf1df5ede80-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:59:48 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-cac30b30-ac06-4ec7-8603-66466faa4ff0 tempest-VolumesSnapshotTestJSON-234340527 None] Acquiring lock "cinder-quobyte-5fc22f03-ab55-45d9-a194-ccf1df5ede80" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:59:48 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-004bc0a4-54b8-4c54-9b68-017ee1eebae9 req-43ade7c4-258f-44db-b584-81ddf7f4c8a5 tempest-TestShelveInstance-1719544345 None] attachment_update completed successfully. Sep 28 11:59:48 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-cac30b30-ac06-4ec7-8603-66466faa4ff0 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "cinder-quobyte-5fc22f03-ab55-45d9-a194-ccf1df5ede80" acquired by "delete_volume" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:59:48 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[069f72a5-0000-4bcf-9cf2-d96eef289eb2]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:59:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cac30b30-ac06-4ec7-8603-66466faa4ff0 tempest-VolumesSnapshotTestJSON-234340527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5fc22f03-ab55-45d9-a194-ccf1df5ede80 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:48 devstack sudo[102561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5fc22f03-ab55-45d9-a194-ccf1df5ede80 Sep 28 11:59:48 devstack sudo[102561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4e2255bb-d65d-4346-a61f-0052eb2001db tempest-CreateVolumesFromSnapshotTest-1290784761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:59:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4e2255bb-d65d-4346-a61f-0052eb2001db tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:59:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-4e2255bb-d65d-4346-a61f-0052eb2001db tempest-CreateVolumesFromSnapshotTest-1290784761 None] Creating offline snapshot a159a1ad-49be-413e-ab6b-b22e4f61e6f8 of volume 244241af-b2e2-43a3-ae30-48c5ddf2837f {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 11:59:49 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[257a90b8-112a-414a-9725-5dff48356408]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:59:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4e2255bb-d65d-4346-a61f-0052eb2001db tempest-CreateVolumesFromSnapshotTest-1290784761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-244241af-b2e2-43a3-ae30-48c5ddf2837f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:49 devstack sudo[102561]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cac30b30-ac06-4ec7-8603-66466faa4ff0 tempest-VolumesSnapshotTestJSON-234340527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5fc22f03-ab55-45d9-a194-ccf1df5ede80" returned: 0 in 0.622s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cac30b30-ac06-4ec7-8603-66466faa4ff0 tempest-VolumesSnapshotTestJSON-234340527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5fc22f03-ab55-45d9-a194-ccf1df5ede80 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:49 devstack sudo[102567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5fc22f03-ab55-45d9-a194-ccf1df5ede80 Sep 28 11:59:49 devstack sudo[102567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:49 devstack sudo[102566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-244241af-b2e2-43a3-ae30-48c5ddf2837f Sep 28 11:59:49 devstack sudo[102566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:49 devstack sudo[102567]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cac30b30-ac06-4ec7-8603-66466faa4ff0 tempest-VolumesSnapshotTestJSON-234340527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5fc22f03-ab55-45d9-a194-ccf1df5ede80" returned: 0 in 0.305s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:49 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-cac30b30-ac06-4ec7-8603-66466faa4ff0 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "cinder-quobyte-5fc22f03-ab55-45d9-a194-ccf1df5ede80" released by "delete_volume" :: held 0.998s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:59:49 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-cac30b30-ac06-4ec7-8603-66466faa4ff0 tempest-VolumesSnapshotTestJSON-234340527 None] Created reservations ['be9c2755-cac0-43d6-b5e0-32416927c794', '9b62e6f7-7d30-4c19-a0c2-459a5719aec1', '3d610c23-0201-4ae6-95e4-ed36e62e02cb', 'd39eb6a8-72fb-4c62-805c-1cca8376c8a5'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:59:49 devstack sudo[102566]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4e2255bb-d65d-4346-a61f-0052eb2001db tempest-CreateVolumesFromSnapshotTest-1290784761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-244241af-b2e2-43a3-ae30-48c5ddf2837f" returned: 0 in 0.445s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4e2255bb-d65d-4346-a61f-0052eb2001db tempest-CreateVolumesFromSnapshotTest-1290784761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-244241af-b2e2-43a3-ae30-48c5ddf2837f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-244241af-b2e2-43a3-ae30-48c5ddf2837f.a159a1ad-49be-413e-ab6b-b22e4f61e6f8 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:49 devstack sudo[102574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-244241af-b2e2-43a3-ae30-48c5ddf2837f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-244241af-b2e2-43a3-ae30-48c5ddf2837f.a159a1ad-49be-413e-ab6b-b22e4f61e6f8 1G Sep 28 11:59:49 devstack sudo[102574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cac30b30-ac06-4ec7-8603-66466faa4ff0 tempest-VolumesSnapshotTestJSON-234340527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:59:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cac30b30-ac06-4ec7-8603-66466faa4ff0 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:59:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cac30b30-ac06-4ec7-8603-66466faa4ff0 tempest-VolumesSnapshotTestJSON-234340527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:59:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cac30b30-ac06-4ec7-8603-66466faa4ff0 tempest-VolumesSnapshotTestJSON-234340527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:59:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cac30b30-ac06-4ec7-8603-66466faa4ff0 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:59:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cac30b30-ac06-4ec7-8603-66466faa4ff0 tempest-VolumesSnapshotTestJSON-234340527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:49 devstack sudo[102576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:59:49 devstack sudo[102576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:50 devstack sudo[102576]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cac30b30-ac06-4ec7-8603-66466faa4ff0 tempest-VolumesSnapshotTestJSON-234340527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.297s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:50 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-cac30b30-ac06-4ec7-8603-66466faa4ff0 tempest-VolumesSnapshotTestJSON-234340527 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:59:50 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-cac30b30-ac06-4ec7-8603-66466faa4ff0 tempest-VolumesSnapshotTestJSON-234340527 None] Deleted volume successfully. Sep 28 11:59:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-cac30b30-ac06-4ec7-8603-66466faa4ff0 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "cinder-5fc22f03-ab55-45d9-a194-ccf1df5ede80-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:59:50 devstack sudo[102574]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4e2255bb-d65d-4346-a61f-0052eb2001db tempest-CreateVolumesFromSnapshotTest-1290784761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-244241af-b2e2-43a3-ae30-48c5ddf2837f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-244241af-b2e2-43a3-ae30-48c5ddf2837f.a159a1ad-49be-413e-ab6b-b22e4f61e6f8 1G" returned: 0 in 0.484s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4e2255bb-d65d-4346-a61f-0052eb2001db tempest-CreateVolumesFromSnapshotTest-1290784761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-244241af-b2e2-43a3-ae30-48c5ddf2837f -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-244241af-b2e2-43a3-ae30-48c5ddf2837f.a159a1ad-49be-413e-ab6b-b22e4f61e6f8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:50 devstack sudo[102584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-244241af-b2e2-43a3-ae30-48c5ddf2837f -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-244241af-b2e2-43a3-ae30-48c5ddf2837f.a159a1ad-49be-413e-ab6b-b22e4f61e6f8 Sep 28 11:59:50 devstack sudo[102584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:50 devstack sudo[102584]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4e2255bb-d65d-4346-a61f-0052eb2001db tempest-CreateVolumesFromSnapshotTest-1290784761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-244241af-b2e2-43a3-ae30-48c5ddf2837f -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-244241af-b2e2-43a3-ae30-48c5ddf2837f.a159a1ad-49be-413e-ab6b-b22e4f61e6f8" returned: 0 in 0.352s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:50 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-4e2255bb-d65d-4346-a61f-0052eb2001db tempest-CreateVolumesFromSnapshotTest-1290784761 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-244241af-b2e2-43a3-ae30-48c5ddf2837f.a159a1ad-49be-413e-ab6b-b22e4f61e6f8 is being set with open permissions: ugo+rw Sep 28 11:59:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4e2255bb-d65d-4346-a61f-0052eb2001db tempest-CreateVolumesFromSnapshotTest-1290784761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-244241af-b2e2-43a3-ae30-48c5ddf2837f.a159a1ad-49be-413e-ab6b-b22e4f61e6f8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:50 devstack sudo[102590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-244241af-b2e2-43a3-ae30-48c5ddf2837f.a159a1ad-49be-413e-ab6b-b22e4f61e6f8 Sep 28 11:59:50 devstack sudo[102590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-25fc9caa-fc6d-4cce-8841-1f3c9427cea6 tempest-VolumesSnapshotTestJSON-234340527 None] Acquiring lock "cinder-e62a97c1-0f0e-4426-a34c-14ea34101f6d-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:59:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-25fc9caa-fc6d-4cce-8841-1f3c9427cea6 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "cinder-e62a97c1-0f0e-4426-a34c-14ea34101f6d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:59:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-25fc9caa-fc6d-4cce-8841-1f3c9427cea6 tempest-VolumesSnapshotTestJSON-234340527 None] Acquiring lock "cinder-quobyte-af0a1c30-4cdf-420e-a887-caec4321e33f" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:59:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-25fc9caa-fc6d-4cce-8841-1f3c9427cea6 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "cinder-quobyte-af0a1c30-4cdf-420e-a887-caec4321e33f" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:59:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-25fc9caa-fc6d-4cce-8841-1f3c9427cea6 tempest-VolumesSnapshotTestJSON-234340527 None] Acquiring lock "cinder-quobyte-e62a97c1-0f0e-4426-a34c-14ea34101f6d" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:59:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-25fc9caa-fc6d-4cce-8841-1f3c9427cea6 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "cinder-quobyte-e62a97c1-0f0e-4426-a34c-14ea34101f6d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:59:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-25fc9caa-fc6d-4cce-8841-1f3c9427cea6 tempest-VolumesSnapshotTestJSON-234340527 None] Deleting offline snapshot e62a97c1-0f0e-4426-a34c-14ea34101f6d of volume af0a1c30-4cdf-420e-a887-caec4321e33f {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 11:59:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-25fc9caa-fc6d-4cce-8841-1f3c9427cea6 tempest-VolumesSnapshotTestJSON-234340527 None] snapshot_file for this snap is: volume-af0a1c30-4cdf-420e-a887-caec4321e33f.e62a97c1-0f0e-4426-a34c-14ea34101f6d {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 11:59:50 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe7cfce-a8bc-42d4-8c32-462e10248ad6]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:59:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-25fc9caa-fc6d-4cce-8841-1f3c9427cea6 tempest-VolumesSnapshotTestJSON-234340527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af0a1c30-4cdf-420e-a887-caec4321e33f.e62a97c1-0f0e-4426-a34c-14ea34101f6d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:50 devstack sudo[102590]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4e2255bb-d65d-4346-a61f-0052eb2001db tempest-CreateVolumesFromSnapshotTest-1290784761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-244241af-b2e2-43a3-ae30-48c5ddf2837f.a159a1ad-49be-413e-ab6b-b22e4f61e6f8" returned: 0 in 0.341s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4e2255bb-d65d-4346-a61f-0052eb2001db tempest-CreateVolumesFromSnapshotTest-1290784761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-244241af-b2e2-43a3-ae30-48c5ddf2837f.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:50 devstack sudo[102594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-244241af-b2e2-43a3-ae30-48c5ddf2837f.info Sep 28 11:59:50 devstack sudo[102594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:51 devstack sudo[102593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af0a1c30-4cdf-420e-a887-caec4321e33f.e62a97c1-0f0e-4426-a34c-14ea34101f6d Sep 28 11:59:51 devstack sudo[102593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:51 devstack sudo[102594]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4e2255bb-d65d-4346-a61f-0052eb2001db tempest-CreateVolumesFromSnapshotTest-1290784761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-244241af-b2e2-43a3-ae30-48c5ddf2837f.info" returned: 0 in 0.311s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:51 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-4e2255bb-d65d-4346-a61f-0052eb2001db tempest-CreateVolumesFromSnapshotTest-1290784761 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-244241af-b2e2-43a3-ae30-48c5ddf2837f.info is being set with open permissions: ugo+rw Sep 28 11:59:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4e2255bb-d65d-4346-a61f-0052eb2001db tempest-CreateVolumesFromSnapshotTest-1290784761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-244241af-b2e2-43a3-ae30-48c5ddf2837f.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:51 devstack sudo[102674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-244241af-b2e2-43a3-ae30-48c5ddf2837f.info Sep 28 11:59:51 devstack sudo[102674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-25fc9caa-fc6d-4cce-8841-1f3c9427cea6 tempest-VolumesSnapshotTestJSON-234340527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af0a1c30-4cdf-420e-a887-caec4321e33f.e62a97c1-0f0e-4426-a34c-14ea34101f6d" returned: 0 in 0.539s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-25fc9caa-fc6d-4cce-8841-1f3c9427cea6 tempest-VolumesSnapshotTestJSON-234340527 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af0a1c30-4cdf-420e-a887-caec4321e33f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 11:59:51 devstack sudo[102593]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:51 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da447fb-e588-4199-9ae1-2a81fe86a614]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:59:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-25fc9caa-fc6d-4cce-8841-1f3c9427cea6 tempest-VolumesSnapshotTestJSON-234340527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af0a1c30-4cdf-420e-a887-caec4321e33f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:51 devstack sudo[102674]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4e2255bb-d65d-4346-a61f-0052eb2001db tempest-CreateVolumesFromSnapshotTest-1290784761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-244241af-b2e2-43a3-ae30-48c5ddf2837f.info" returned: 0 in 0.440s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4e2255bb-d65d-4346-a61f-0052eb2001db tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.538s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:59:51 devstack sudo[102704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af0a1c30-4cdf-420e-a887-caec4321e33f Sep 28 11:59:51 devstack sudo[102704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:51 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-4e2255bb-d65d-4346-a61f-0052eb2001db tempest-CreateVolumesFromSnapshotTest-1290784761 None] Create snapshot completed successfully Sep 28 11:59:52 devstack sudo[102704]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-25fc9caa-fc6d-4cce-8841-1f3c9427cea6 tempest-VolumesSnapshotTestJSON-234340527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af0a1c30-4cdf-420e-a887-caec4321e33f" returned: 0 in 0.944s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-25fc9caa-fc6d-4cce-8841-1f3c9427cea6 tempest-VolumesSnapshotTestJSON-234340527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af0a1c30-4cdf-420e-a887-caec4321e33f.e62a97c1-0f0e-4426-a34c-14ea34101f6d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:52 devstack sudo[103073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af0a1c30-4cdf-420e-a887-caec4321e33f.e62a97c1-0f0e-4426-a34c-14ea34101f6d Sep 28 11:59:52 devstack sudo[103073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:52 devstack sudo[103073]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-25fc9caa-fc6d-4cce-8841-1f3c9427cea6 tempest-VolumesSnapshotTestJSON-234340527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af0a1c30-4cdf-420e-a887-caec4321e33f.e62a97c1-0f0e-4426-a34c-14ea34101f6d" returned: 0 in 0.485s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-25fc9caa-fc6d-4cce-8841-1f3c9427cea6 tempest-VolumesSnapshotTestJSON-234340527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af0a1c30-4cdf-420e-a887-caec4321e33f.e62a97c1-0f0e-4426-a34c-14ea34101f6d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:52 devstack sudo[103092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af0a1c30-4cdf-420e-a887-caec4321e33f.e62a97c1-0f0e-4426-a34c-14ea34101f6d Sep 28 11:59:52 devstack sudo[103092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:53 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f07e34a-d74f-44f0-a2a6-40135882a1b3 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:59:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5f07e34a-d74f-44f0-a2a6-40135882a1b3 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Flow 'volume_create_manager' (9134c45c-8e2a-4936-96b8-ed1b2877a1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:59:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5f07e34a-d74f-44f0-a2a6-40135882a1b3 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccb9e062-9258-4127-a7b5-a7d7225d3e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5f07e34a-d74f-44f0-a2a6-40135882a1b3 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccb9e062-9258-4127-a7b5-a7d7225d3e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:59:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1747689393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c115c79-3355-44b4-9c5e-de12512b42a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b40a3c4dea64334951cf95b1908bd14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:59:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:59:53Z,use_quota=True,user_id='4516cc225e0e44f4af91976eee2754fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5f07e34a-d74f-44f0-a2a6-40135882a1b3 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f117276-442d-4db9-9888-0687f5c9ad1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5f07e34a-d74f-44f0-a2a6-40135882a1b3 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f117276-442d-4db9-9888-0687f5c9ad1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5f07e34a-d74f-44f0-a2a6-40135882a1b3 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb8d1f43-1794-4329-93ba-fa1d868931a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5f07e34a-d74f-44f0-a2a6-40135882a1b3 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb8d1f43-1794-4329-93ba-fa1d868931a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c115c79-3355-44b4-9c5e-de12512b42a9', 'volume_name': 'volume-3c115c79-3355-44b4-9c5e-de12512b42a9', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5f07e34a-d74f-44f0-a2a6-40135882a1b3 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fcf3a47-3d4d-4e7e-9513-5343bb8dd181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5f07e34a-d74f-44f0-a2a6-40135882a1b3 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fcf3a47-3d4d-4e7e-9513-5343bb8dd181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5f07e34a-d74f-44f0-a2a6-40135882a1b3 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e3776df-6716-433e-9fbf-11ae5291a230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:53 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-5f07e34a-d74f-44f0-a2a6-40135882a1b3 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Volume 3c115c79-3355-44b4-9c5e-de12512b42a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c115c79-3355-44b4-9c5e-de12512b42a9', 'volume_size': 1} Sep 28 11:59:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5f07e34a-d74f-44f0-a2a6-40135882a1b3 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:59:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5f07e34a-d74f-44f0-a2a6-40135882a1b3 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:59:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5f07e34a-d74f-44f0-a2a6-40135882a1b3 tempest-CreateVolumesFromSnapshotTest-1290784761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:59:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1747689393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c115c79-3355-44b4-9c5e-de12512b42a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b40a3c4dea64334951cf95b1908bd14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:59:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:59:53Z,use_quota=True,user_id='4516cc225e0e44f4af91976eee2754fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:59:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-5f07e34a-d74f-44f0-a2a6-40135882a1b3 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Creating volume 3c115c79-3355-44b4-9c5e-de12512b42a9 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:59:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5f07e34a-d74f-44f0-a2a6-40135882a1b3 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:59:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5f07e34a-d74f-44f0-a2a6-40135882a1b3 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:59:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5f07e34a-d74f-44f0-a2a6-40135882a1b3 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:59:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5f07e34a-d74f-44f0-a2a6-40135882a1b3 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:59:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5f07e34a-d74f-44f0-a2a6-40135882a1b3 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:59:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5f07e34a-d74f-44f0-a2a6-40135882a1b3 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:59:53 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-5f07e34a-d74f-44f0-a2a6-40135882a1b3 tempest-CreateVolumesFromSnapshotTest-1290784761 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:59:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5f07e34a-d74f-44f0-a2a6-40135882a1b3 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3c115c79-3355-44b4-9c5e-de12512b42a9 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:53 devstack sudo[103098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3c115c79-3355-44b4-9c5e-de12512b42a9 1073741824 Sep 28 11:59:53 devstack sudo[103098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:53 devstack sudo[103092]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-25fc9caa-fc6d-4cce-8841-1f3c9427cea6 tempest-VolumesSnapshotTestJSON-234340527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af0a1c30-4cdf-420e-a887-caec4321e33f.e62a97c1-0f0e-4426-a34c-14ea34101f6d" returned: 0 in 0.442s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-25fc9caa-fc6d-4cce-8841-1f3c9427cea6 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "cinder-quobyte-e62a97c1-0f0e-4426-a34c-14ea34101f6d" released by "_delete_snapshot" :: held 2.618s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:59:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-25fc9caa-fc6d-4cce-8841-1f3c9427cea6 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "cinder-quobyte-af0a1c30-4cdf-420e-a887-caec4321e33f" released by "delete_snapshot" :: held 2.649s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:59:53 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-25fc9caa-fc6d-4cce-8841-1f3c9427cea6 tempest-VolumesSnapshotTestJSON-234340527 None] Created reservations ['1a664b35-d9e8-4951-9c08-88483393338b', 'a4b81284-aa65-4c89-ad93-452697a88f33', '42fd3522-3e36-42bf-ac37-603bf3eae6ad', '290f4a3f-c0ab-4d85-abc3-76cf9ee95251'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:59:53 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-25fc9caa-fc6d-4cce-8841-1f3c9427cea6 tempest-VolumesSnapshotTestJSON-234340527 None] Delete snapshot completed successfully. Sep 28 11:59:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-25fc9caa-fc6d-4cce-8841-1f3c9427cea6 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "cinder-e62a97c1-0f0e-4426-a34c-14ea34101f6d-delete_snapshot" released by "delete_snapshot" :: held 2.942s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:59:53 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce85a63d-fef4-4615-a2cb-19c248984830 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:59:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ce85a63d-fef4-4615-a2cb-19c248984830 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Flow 'volume_create_manager' (77c70a77-0c69-404f-a4ac-96d5fc3aab91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:59:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ce85a63d-fef4-4615-a2cb-19c248984830 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7f34c4e-c14c-4b81-ac59-8b6d966e531e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ce85a63d-fef4-4615-a2cb-19c248984830 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7f34c4e-c14c-4b81-ac59-8b6d966e531e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:59:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1918522862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e24fb9c-b44b-4311-9496-37be107d0da4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b40a3c4dea64334951cf95b1908bd14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:59:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:59:54Z,use_quota=True,user_id='4516cc225e0e44f4af91976eee2754fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ce85a63d-fef4-4615-a2cb-19c248984830 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fb81112-72a8-4458-828d-09b0558c8a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ce85a63d-fef4-4615-a2cb-19c248984830 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fb81112-72a8-4458-828d-09b0558c8a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ce85a63d-fef4-4615-a2cb-19c248984830 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (632d0d7c-b505-471b-9475-deefce137571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ce85a63d-fef4-4615-a2cb-19c248984830 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (632d0d7c-b505-471b-9475-deefce137571) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e24fb9c-b44b-4311-9496-37be107d0da4', 'volume_name': 'volume-6e24fb9c-b44b-4311-9496-37be107d0da4', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ce85a63d-fef4-4615-a2cb-19c248984830 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f50e83ba-2557-4a5d-8e56-88513143812d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ce85a63d-fef4-4615-a2cb-19c248984830 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f50e83ba-2557-4a5d-8e56-88513143812d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ce85a63d-fef4-4615-a2cb-19c248984830 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c01c32e4-e50b-4c77-87a3-4fdc9f651fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:53 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-ce85a63d-fef4-4615-a2cb-19c248984830 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Volume 6e24fb9c-b44b-4311-9496-37be107d0da4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e24fb9c-b44b-4311-9496-37be107d0da4', 'volume_size': 1} Sep 28 11:59:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ce85a63d-fef4-4615-a2cb-19c248984830 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:59:53 devstack sudo[103098]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5f07e34a-d74f-44f0-a2a6-40135882a1b3 tempest-CreateVolumesFromSnapshotTest-1290784761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3c115c79-3355-44b4-9c5e-de12512b42a9 1073741824" returned: 0 in 0.751s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5f07e34a-d74f-44f0-a2a6-40135882a1b3 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3c115c79-3355-44b4-9c5e-de12512b42a9 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:53 devstack sudo[103116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3c115c79-3355-44b4-9c5e-de12512b42a9 Sep 28 11:59:53 devstack sudo[103116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6dc69668-324b-4400-adf8-45717227ad26 tempest-VolumesSnapshotTestJSON-234340527 None] Acquiring lock "cinder-af0a1c30-4cdf-420e-a887-caec4321e33f-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:59:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6dc69668-324b-4400-adf8-45717227ad26 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "cinder-af0a1c30-4cdf-420e-a887-caec4321e33f-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:59:54 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-82aedff7-8777-45d5-83ff-973ea784cc7c tempest-CreateVolumesFromSnapshotTest-1290784761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:59:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-82aedff7-8777-45d5-83ff-973ea784cc7c tempest-CreateVolumesFromSnapshotTest-1290784761 None] Flow 'volume_create_manager' (6623dd15-e0c1-4a85-9796-4611ea03608a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:59:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-82aedff7-8777-45d5-83ff-973ea784cc7c tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0169620b-1c4c-4fe6-996b-87279debf098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-82aedff7-8777-45d5-83ff-973ea784cc7c tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0169620b-1c4c-4fe6-996b-87279debf098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:59:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-973367966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=731fc632-47cc-4cdd-8f9f-62039a5cff71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b40a3c4dea64334951cf95b1908bd14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:59:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:59:54Z,use_quota=True,user_id='4516cc225e0e44f4af91976eee2754fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-82aedff7-8777-45d5-83ff-973ea784cc7c tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33f86f88-0923-4371-b622-90337d38b2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-82aedff7-8777-45d5-83ff-973ea784cc7c tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33f86f88-0923-4371-b622-90337d38b2e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-82aedff7-8777-45d5-83ff-973ea784cc7c tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50a4863a-b495-428a-8b0f-3108fe42af15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-82aedff7-8777-45d5-83ff-973ea784cc7c tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50a4863a-b495-428a-8b0f-3108fe42af15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '731fc632-47cc-4cdd-8f9f-62039a5cff71', 'volume_name': 'volume-731fc632-47cc-4cdd-8f9f-62039a5cff71', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:54 devstack sudo[103116]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-82aedff7-8777-45d5-83ff-973ea784cc7c tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c685882-7f2b-4546-9f14-2d6c1b35add6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-82aedff7-8777-45d5-83ff-973ea784cc7c tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c685882-7f2b-4546-9f14-2d6c1b35add6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-82aedff7-8777-45d5-83ff-973ea784cc7c tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faec3411-5d2c-4b19-bb20-755451311f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:54 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-82aedff7-8777-45d5-83ff-973ea784cc7c tempest-CreateVolumesFromSnapshotTest-1290784761 None] Volume 731fc632-47cc-4cdd-8f9f-62039a5cff71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-731fc632-47cc-4cdd-8f9f-62039a5cff71', 'volume_size': 1} Sep 28 11:59:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-82aedff7-8777-45d5-83ff-973ea784cc7c tempest-CreateVolumesFromSnapshotTest-1290784761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:59:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5f07e34a-d74f-44f0-a2a6-40135882a1b3 tempest-CreateVolumesFromSnapshotTest-1290784761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3c115c79-3355-44b4-9c5e-de12512b42a9" returned: 0 in 0.489s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5f07e34a-d74f-44f0-a2a6-40135882a1b3 tempest-CreateVolumesFromSnapshotTest-1290784761 None] <== create_volume: return (1308ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:59:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5f07e34a-d74f-44f0-a2a6-40135882a1b3 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.311s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:59:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ce85a63d-fef4-4615-a2cb-19c248984830 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.591s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:59:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ce85a63d-fef4-4615-a2cb-19c248984830 tempest-CreateVolumesFromSnapshotTest-1290784761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:59:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1918522862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e24fb9c-b44b-4311-9496-37be107d0da4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b40a3c4dea64334951cf95b1908bd14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:59:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:59:54Z,use_quota=True,user_id='4516cc225e0e44f4af91976eee2754fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:59:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-ce85a63d-fef4-4615-a2cb-19c248984830 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Creating volume 6e24fb9c-b44b-4311-9496-37be107d0da4 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:59:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ce85a63d-fef4-4615-a2cb-19c248984830 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:59:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ce85a63d-fef4-4615-a2cb-19c248984830 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:59:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ce85a63d-fef4-4615-a2cb-19c248984830 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:59:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ce85a63d-fef4-4615-a2cb-19c248984830 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:59:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ce85a63d-fef4-4615-a2cb-19c248984830 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:59:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ce85a63d-fef4-4615-a2cb-19c248984830 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:59:54 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-ce85a63d-fef4-4615-a2cb-19c248984830 tempest-CreateVolumesFromSnapshotTest-1290784761 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:59:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ce85a63d-fef4-4615-a2cb-19c248984830 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-6e24fb9c-b44b-4311-9496-37be107d0da4 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:54 devstack sudo[103119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-6e24fb9c-b44b-4311-9496-37be107d0da4 1073741824 Sep 28 11:59:54 devstack sudo[103119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6dc69668-324b-4400-adf8-45717227ad26 tempest-VolumesSnapshotTestJSON-234340527 None] Acquiring lock "cinder-quobyte-af0a1c30-4cdf-420e-a887-caec4321e33f" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:59:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5f07e34a-d74f-44f0-a2a6-40135882a1b3 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e3776df-6716-433e-9fbf-11ae5291a230) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c115c79-3355-44b4-9c5e-de12512b42a9', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5f07e34a-d74f-44f0-a2a6-40135882a1b3 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8c512ab-ab75-42cc-b555-eed3f40e62fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6dc69668-324b-4400-adf8-45717227ad26 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "cinder-quobyte-af0a1c30-4cdf-420e-a887-caec4321e33f" acquired by "delete_volume" :: waited 0.088s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:59:54 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-5f07e34a-d74f-44f0-a2a6-40135882a1b3 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Volume volume-3c115c79-3355-44b4-9c5e-de12512b42a9 (3c115c79-3355-44b4-9c5e-de12512b42a9): created successfully Sep 28 11:59:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5f07e34a-d74f-44f0-a2a6-40135882a1b3 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8c512ab-ab75-42cc-b555-eed3f40e62fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5f07e34a-d74f-44f0-a2a6-40135882a1b3 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Flow 'volume_create_manager' (9134c45c-8e2a-4936-96b8-ed1b2877a1be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:59:54 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ecd934c-65f9-40f9-b851-9458548e2251]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:59:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6dc69668-324b-4400-adf8-45717227ad26 tempest-VolumesSnapshotTestJSON-234340527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af0a1c30-4cdf-420e-a887-caec4321e33f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:54 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-5f07e34a-d74f-44f0-a2a6-40135882a1b3 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Created volume successfully. Sep 28 11:59:55 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-6af51dcc-95ac-43ef-a9cc-7b49908d03fd tempest-CreateVolumesFromSnapshotTest-1290784761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:59:55 devstack sudo[103123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af0a1c30-4cdf-420e-a887-caec4321e33f Sep 28 11:59:55 devstack sudo[103123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6af51dcc-95ac-43ef-a9cc-7b49908d03fd tempest-CreateVolumesFromSnapshotTest-1290784761 None] Flow 'volume_create_manager' (4c292b66-fc6a-46e7-925e-fc27d5d8a9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:59:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6af51dcc-95ac-43ef-a9cc-7b49908d03fd tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8985ef4c-938a-43d5-bdc8-d23eaff8f29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6af51dcc-95ac-43ef-a9cc-7b49908d03fd tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8985ef4c-938a-43d5-bdc8-d23eaff8f29a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:59:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1261009097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f8e7b14-4da4-44e7-a8c9-1ee2d7b3a9ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b40a3c4dea64334951cf95b1908bd14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:59:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:59:55Z,use_quota=True,user_id='4516cc225e0e44f4af91976eee2754fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6af51dcc-95ac-43ef-a9cc-7b49908d03fd tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e755cf2-b911-4364-bcea-e094c9f811ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6af51dcc-95ac-43ef-a9cc-7b49908d03fd tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e755cf2-b911-4364-bcea-e094c9f811ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6af51dcc-95ac-43ef-a9cc-7b49908d03fd tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e5a6e0b-c497-47d0-8817-fd84fe6be643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6af51dcc-95ac-43ef-a9cc-7b49908d03fd tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e5a6e0b-c497-47d0-8817-fd84fe6be643) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f8e7b14-4da4-44e7-a8c9-1ee2d7b3a9ee', 'volume_name': 'volume-5f8e7b14-4da4-44e7-a8c9-1ee2d7b3a9ee', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6af51dcc-95ac-43ef-a9cc-7b49908d03fd tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81c71429-478b-4ae0-9206-1ed695f52b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6af51dcc-95ac-43ef-a9cc-7b49908d03fd tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81c71429-478b-4ae0-9206-1ed695f52b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6af51dcc-95ac-43ef-a9cc-7b49908d03fd tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c16f9a67-1edc-460a-9003-7a5d493668a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:55 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-6af51dcc-95ac-43ef-a9cc-7b49908d03fd tempest-CreateVolumesFromSnapshotTest-1290784761 None] Volume 5f8e7b14-4da4-44e7-a8c9-1ee2d7b3a9ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f8e7b14-4da4-44e7-a8c9-1ee2d7b3a9ee', 'volume_size': 1} Sep 28 11:59:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6af51dcc-95ac-43ef-a9cc-7b49908d03fd tempest-CreateVolumesFromSnapshotTest-1290784761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:59:55 devstack sudo[103119]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ce85a63d-fef4-4615-a2cb-19c248984830 tempest-CreateVolumesFromSnapshotTest-1290784761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-6e24fb9c-b44b-4311-9496-37be107d0da4 1073741824" returned: 0 in 0.923s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ce85a63d-fef4-4615-a2cb-19c248984830 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-6e24fb9c-b44b-4311-9496-37be107d0da4 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:55 devstack sudo[103128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-6e24fb9c-b44b-4311-9496-37be107d0da4 Sep 28 11:59:55 devstack sudo[103128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:55 devstack sudo[103123]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6dc69668-324b-4400-adf8-45717227ad26 tempest-VolumesSnapshotTestJSON-234340527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af0a1c30-4cdf-420e-a887-caec4321e33f" returned: 0 in 0.998s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6dc69668-324b-4400-adf8-45717227ad26 tempest-VolumesSnapshotTestJSON-234340527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af0a1c30-4cdf-420e-a887-caec4321e33f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:55 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-457869c0-1a15-4b85-89e0-904183f3f961 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:59:55 devstack sudo[103134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af0a1c30-4cdf-420e-a887-caec4321e33f Sep 28 11:59:55 devstack sudo[103134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-457869c0-1a15-4b85-89e0-904183f3f961 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Flow 'volume_create_manager' (97af2af4-c736-4ae6-a9eb-29af9ae5e95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:59:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-457869c0-1a15-4b85-89e0-904183f3f961 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe1e0427-f893-4990-9536-0cd4b37e0b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:55 devstack sudo[103128]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ce85a63d-fef4-4615-a2cb-19c248984830 tempest-CreateVolumesFromSnapshotTest-1290784761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-6e24fb9c-b44b-4311-9496-37be107d0da4" returned: 0 in 0.366s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ce85a63d-fef4-4615-a2cb-19c248984830 tempest-CreateVolumesFromSnapshotTest-1290784761 None] <== create_volume: return (1359ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:59:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ce85a63d-fef4-4615-a2cb-19c248984830 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.363s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:59:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-82aedff7-8777-45d5-83ff-973ea784cc7c tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.387s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:59:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-82aedff7-8777-45d5-83ff-973ea784cc7c tempest-CreateVolumesFromSnapshotTest-1290784761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:59:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-973367966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=731fc632-47cc-4cdd-8f9f-62039a5cff71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b40a3c4dea64334951cf95b1908bd14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:59:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:59:54Z,use_quota=True,user_id='4516cc225e0e44f4af91976eee2754fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:59:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-82aedff7-8777-45d5-83ff-973ea784cc7c tempest-CreateVolumesFromSnapshotTest-1290784761 None] Creating volume 731fc632-47cc-4cdd-8f9f-62039a5cff71 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:59:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-82aedff7-8777-45d5-83ff-973ea784cc7c tempest-CreateVolumesFromSnapshotTest-1290784761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:59:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-82aedff7-8777-45d5-83ff-973ea784cc7c tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:59:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-82aedff7-8777-45d5-83ff-973ea784cc7c tempest-CreateVolumesFromSnapshotTest-1290784761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:59:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-82aedff7-8777-45d5-83ff-973ea784cc7c tempest-CreateVolumesFromSnapshotTest-1290784761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:59:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-82aedff7-8777-45d5-83ff-973ea784cc7c tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:59:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-82aedff7-8777-45d5-83ff-973ea784cc7c tempest-CreateVolumesFromSnapshotTest-1290784761 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:59:55 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-82aedff7-8777-45d5-83ff-973ea784cc7c tempest-CreateVolumesFromSnapshotTest-1290784761 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:59:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-82aedff7-8777-45d5-83ff-973ea784cc7c tempest-CreateVolumesFromSnapshotTest-1290784761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-731fc632-47cc-4cdd-8f9f-62039a5cff71 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-457869c0-1a15-4b85-89e0-904183f3f961 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe1e0427-f893-4990-9536-0cd4b37e0b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:59:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-314254235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5aca3f2b-5efe-414a-a77c-3ff3555f8ea5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b40a3c4dea64334951cf95b1908bd14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:59:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:59:56Z,use_quota=True,user_id='4516cc225e0e44f4af91976eee2754fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-457869c0-1a15-4b85-89e0-904183f3f961 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79cf5170-2988-4720-91c1-a7b788162fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-457869c0-1a15-4b85-89e0-904183f3f961 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79cf5170-2988-4720-91c1-a7b788162fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:55 devstack sudo[103136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-731fc632-47cc-4cdd-8f9f-62039a5cff71 1073741824 Sep 28 11:59:55 devstack sudo[103136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-457869c0-1a15-4b85-89e0-904183f3f961 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d18e1b0b-2532-43d3-9361-46c0044ba179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-457869c0-1a15-4b85-89e0-904183f3f961 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d18e1b0b-2532-43d3-9361-46c0044ba179) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5aca3f2b-5efe-414a-a77c-3ff3555f8ea5', 'volume_name': 'volume-5aca3f2b-5efe-414a-a77c-3ff3555f8ea5', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-457869c0-1a15-4b85-89e0-904183f3f961 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a758fa1d-6121-454f-80ef-56ec45b8a3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-457869c0-1a15-4b85-89e0-904183f3f961 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a758fa1d-6121-454f-80ef-56ec45b8a3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-457869c0-1a15-4b85-89e0-904183f3f961 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c97cba08-83f2-4bfd-b8d3-9e6adee9ffbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:55 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-457869c0-1a15-4b85-89e0-904183f3f961 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Volume 5aca3f2b-5efe-414a-a77c-3ff3555f8ea5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5aca3f2b-5efe-414a-a77c-3ff3555f8ea5', 'volume_size': 1} Sep 28 11:59:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-457869c0-1a15-4b85-89e0-904183f3f961 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:59:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ce85a63d-fef4-4615-a2cb-19c248984830 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c01c32e4-e50b-4c77-87a3-4fdc9f651fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e24fb9c-b44b-4311-9496-37be107d0da4', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ce85a63d-fef4-4615-a2cb-19c248984830 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d58420a7-3b42-4db4-9e18-524a6855f06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:55 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-ce85a63d-fef4-4615-a2cb-19c248984830 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Volume volume-6e24fb9c-b44b-4311-9496-37be107d0da4 (6e24fb9c-b44b-4311-9496-37be107d0da4): created successfully Sep 28 11:59:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ce85a63d-fef4-4615-a2cb-19c248984830 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d58420a7-3b42-4db4-9e18-524a6855f06a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ce85a63d-fef4-4615-a2cb-19c248984830 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Flow 'volume_create_manager' (77c70a77-0c69-404f-a4ac-96d5fc3aab91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:59:55 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-ce85a63d-fef4-4615-a2cb-19c248984830 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Created volume successfully. Sep 28 11:59:56 devstack sudo[103134]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6dc69668-324b-4400-adf8-45717227ad26 tempest-VolumesSnapshotTestJSON-234340527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-af0a1c30-4cdf-420e-a887-caec4321e33f" returned: 0 in 0.339s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6dc69668-324b-4400-adf8-45717227ad26 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "cinder-quobyte-af0a1c30-4cdf-420e-a887-caec4321e33f" released by "delete_volume" :: held 1.497s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:59:56 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-6dc69668-324b-4400-adf8-45717227ad26 tempest-VolumesSnapshotTestJSON-234340527 None] Created reservations ['4e3864a9-bfb0-4e55-b3c5-34b301afecc5', 'fe228078-1ae8-45fc-8bd4-6c27b17f46cb', 'a2c460c7-06c1-4911-80d7-578b3be7fe51', '6a222416-77a1-4afc-8a2f-f69ba6979ba0'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 11:59:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6dc69668-324b-4400-adf8-45717227ad26 tempest-VolumesSnapshotTestJSON-234340527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:59:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6dc69668-324b-4400-adf8-45717227ad26 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:59:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6dc69668-324b-4400-adf8-45717227ad26 tempest-VolumesSnapshotTestJSON-234340527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:59:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6dc69668-324b-4400-adf8-45717227ad26 tempest-VolumesSnapshotTestJSON-234340527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:59:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6dc69668-324b-4400-adf8-45717227ad26 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:59:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6dc69668-324b-4400-adf8-45717227ad26 tempest-VolumesSnapshotTestJSON-234340527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:56 devstack sudo[103145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 11:59:56 devstack sudo[103145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:56 devstack sudo[103136]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-82aedff7-8777-45d5-83ff-973ea784cc7c tempest-CreateVolumesFromSnapshotTest-1290784761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-731fc632-47cc-4cdd-8f9f-62039a5cff71 1073741824" returned: 0 in 0.633s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-82aedff7-8777-45d5-83ff-973ea784cc7c tempest-CreateVolumesFromSnapshotTest-1290784761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-731fc632-47cc-4cdd-8f9f-62039a5cff71 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:56 devstack sudo[103147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-731fc632-47cc-4cdd-8f9f-62039a5cff71 Sep 28 11:59:56 devstack sudo[103147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:56 devstack sudo[103145]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6dc69668-324b-4400-adf8-45717227ad26 tempest-VolumesSnapshotTestJSON-234340527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.455s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:56 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-6dc69668-324b-4400-adf8-45717227ad26 tempest-VolumesSnapshotTestJSON-234340527 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 11:59:56 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-6dc69668-324b-4400-adf8-45717227ad26 tempest-VolumesSnapshotTestJSON-234340527 None] Deleted volume successfully. Sep 28 11:59:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6dc69668-324b-4400-adf8-45717227ad26 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "cinder-af0a1c30-4cdf-420e-a887-caec4321e33f-delete_volume" released by "delete_volume" :: held 2.587s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 11:59:57 devstack sudo[103147]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-82aedff7-8777-45d5-83ff-973ea784cc7c tempest-CreateVolumesFromSnapshotTest-1290784761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-731fc632-47cc-4cdd-8f9f-62039a5cff71" returned: 0 in 0.515s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-82aedff7-8777-45d5-83ff-973ea784cc7c tempest-CreateVolumesFromSnapshotTest-1290784761 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:59:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-82aedff7-8777-45d5-83ff-973ea784cc7c tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.208s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:59:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6af51dcc-95ac-43ef-a9cc-7b49908d03fd tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.812s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:59:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6af51dcc-95ac-43ef-a9cc-7b49908d03fd tempest-CreateVolumesFromSnapshotTest-1290784761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:59:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1261009097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f8e7b14-4da4-44e7-a8c9-1ee2d7b3a9ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b40a3c4dea64334951cf95b1908bd14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:59:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:59:55Z,use_quota=True,user_id='4516cc225e0e44f4af91976eee2754fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:59:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-6af51dcc-95ac-43ef-a9cc-7b49908d03fd tempest-CreateVolumesFromSnapshotTest-1290784761 None] Creating volume 5f8e7b14-4da4-44e7-a8c9-1ee2d7b3a9ee {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:59:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6af51dcc-95ac-43ef-a9cc-7b49908d03fd tempest-CreateVolumesFromSnapshotTest-1290784761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:59:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6af51dcc-95ac-43ef-a9cc-7b49908d03fd tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:59:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6af51dcc-95ac-43ef-a9cc-7b49908d03fd tempest-CreateVolumesFromSnapshotTest-1290784761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:59:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6af51dcc-95ac-43ef-a9cc-7b49908d03fd tempest-CreateVolumesFromSnapshotTest-1290784761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:59:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6af51dcc-95ac-43ef-a9cc-7b49908d03fd tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:59:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6af51dcc-95ac-43ef-a9cc-7b49908d03fd tempest-CreateVolumesFromSnapshotTest-1290784761 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:59:57 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-6af51dcc-95ac-43ef-a9cc-7b49908d03fd tempest-CreateVolumesFromSnapshotTest-1290784761 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:59:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6af51dcc-95ac-43ef-a9cc-7b49908d03fd tempest-CreateVolumesFromSnapshotTest-1290784761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5f8e7b14-4da4-44e7-a8c9-1ee2d7b3a9ee 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-82aedff7-8777-45d5-83ff-973ea784cc7c tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faec3411-5d2c-4b19-bb20-755451311f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-731fc632-47cc-4cdd-8f9f-62039a5cff71', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-82aedff7-8777-45d5-83ff-973ea784cc7c tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67b8d513-3a65-4ccd-b6c5-d1d9560a43c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:57 devstack sudo[103151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5f8e7b14-4da4-44e7-a8c9-1ee2d7b3a9ee 1073741824 Sep 28 11:59:57 devstack sudo[103151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:57 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-82aedff7-8777-45d5-83ff-973ea784cc7c tempest-CreateVolumesFromSnapshotTest-1290784761 None] Volume volume-731fc632-47cc-4cdd-8f9f-62039a5cff71 (731fc632-47cc-4cdd-8f9f-62039a5cff71): created successfully Sep 28 11:59:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-82aedff7-8777-45d5-83ff-973ea784cc7c tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67b8d513-3a65-4ccd-b6c5-d1d9560a43c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-82aedff7-8777-45d5-83ff-973ea784cc7c tempest-CreateVolumesFromSnapshotTest-1290784761 None] Flow 'volume_create_manager' (6623dd15-e0c1-4a85-9796-4611ea03608a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:59:57 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-82aedff7-8777-45d5-83ff-973ea784cc7c tempest-CreateVolumesFromSnapshotTest-1290784761 None] Created volume successfully. Sep 28 11:59:57 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ba8f6af-e06c-40e9-bfcc-4aa2e7af9d27 tempest-VolumesSnapshotTestJSON-234340527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 11:59:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1ba8f6af-e06c-40e9-bfcc-4aa2e7af9d27 tempest-VolumesSnapshotTestJSON-234340527 None] Flow 'volume_create_manager' (40843007-83c9-4a61-857e-ac3c4535f1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:59:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1ba8f6af-e06c-40e9-bfcc-4aa2e7af9d27 tempest-VolumesSnapshotTestJSON-234340527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d9014ae-025f-4011-b1be-b52e335a20aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1ba8f6af-e06c-40e9-bfcc-4aa2e7af9d27 tempest-VolumesSnapshotTestJSON-234340527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d9014ae-025f-4011-b1be-b52e335a20aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:59:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1045532102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb928adbcb8b424f94e03b26751e1eb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:59:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:59:58Z,use_quota=True,user_id='1708eb324dc5445894a1a92f35e5d748',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1ba8f6af-e06c-40e9-bfcc-4aa2e7af9d27 tempest-VolumesSnapshotTestJSON-234340527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (004dcbab-5baf-4cac-bcbf-2ff1f6646be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1ba8f6af-e06c-40e9-bfcc-4aa2e7af9d27 tempest-VolumesSnapshotTestJSON-234340527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (004dcbab-5baf-4cac-bcbf-2ff1f6646be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1ba8f6af-e06c-40e9-bfcc-4aa2e7af9d27 tempest-VolumesSnapshotTestJSON-234340527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (166a86a8-f314-4a20-9ca2-d289257712a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1ba8f6af-e06c-40e9-bfcc-4aa2e7af9d27 tempest-VolumesSnapshotTestJSON-234340527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (166a86a8-f314-4a20-9ca2-d289257712a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b', 'volume_name': 'volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1ba8f6af-e06c-40e9-bfcc-4aa2e7af9d27 tempest-VolumesSnapshotTestJSON-234340527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28109758-9574-4fa8-a516-e7d2107227f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1ba8f6af-e06c-40e9-bfcc-4aa2e7af9d27 tempest-VolumesSnapshotTestJSON-234340527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28109758-9574-4fa8-a516-e7d2107227f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:57 devstack sudo[103151]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1ba8f6af-e06c-40e9-bfcc-4aa2e7af9d27 tempest-VolumesSnapshotTestJSON-234340527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60f649cb-3aef-4501-97cd-6c5bf21c95da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:57 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-1ba8f6af-e06c-40e9-bfcc-4aa2e7af9d27 tempest-VolumesSnapshotTestJSON-234340527 None] Volume ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b', 'volume_size': 1} Sep 28 11:59:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1ba8f6af-e06c-40e9-bfcc-4aa2e7af9d27 tempest-VolumesSnapshotTestJSON-234340527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:59:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6af51dcc-95ac-43ef-a9cc-7b49908d03fd tempest-CreateVolumesFromSnapshotTest-1290784761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5f8e7b14-4da4-44e7-a8c9-1ee2d7b3a9ee 1073741824" returned: 0 in 0.679s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6af51dcc-95ac-43ef-a9cc-7b49908d03fd tempest-CreateVolumesFromSnapshotTest-1290784761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5f8e7b14-4da4-44e7-a8c9-1ee2d7b3a9ee {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:57 devstack sudo[103157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5f8e7b14-4da4-44e7-a8c9-1ee2d7b3a9ee Sep 28 11:59:57 devstack sudo[103157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:58 devstack sudo[103157]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6af51dcc-95ac-43ef-a9cc-7b49908d03fd tempest-CreateVolumesFromSnapshotTest-1290784761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5f8e7b14-4da4-44e7-a8c9-1ee2d7b3a9ee" returned: 0 in 0.291s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6af51dcc-95ac-43ef-a9cc-7b49908d03fd tempest-CreateVolumesFromSnapshotTest-1290784761 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:59:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6af51dcc-95ac-43ef-a9cc-7b49908d03fd tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:59:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-457869c0-1a15-4b85-89e0-904183f3f961 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.163s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:59:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-457869c0-1a15-4b85-89e0-904183f3f961 tempest-CreateVolumesFromSnapshotTest-1290784761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:59:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-314254235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5aca3f2b-5efe-414a-a77c-3ff3555f8ea5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b40a3c4dea64334951cf95b1908bd14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:59:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:59:56Z,use_quota=True,user_id='4516cc225e0e44f4af91976eee2754fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:59:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-457869c0-1a15-4b85-89e0-904183f3f961 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Creating volume 5aca3f2b-5efe-414a-a77c-3ff3555f8ea5 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:59:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-457869c0-1a15-4b85-89e0-904183f3f961 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:59:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-457869c0-1a15-4b85-89e0-904183f3f961 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:59:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-457869c0-1a15-4b85-89e0-904183f3f961 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:59:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-457869c0-1a15-4b85-89e0-904183f3f961 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:59:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-457869c0-1a15-4b85-89e0-904183f3f961 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:59:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-457869c0-1a15-4b85-89e0-904183f3f961 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:59:58 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-457869c0-1a15-4b85-89e0-904183f3f961 tempest-CreateVolumesFromSnapshotTest-1290784761 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:59:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-457869c0-1a15-4b85-89e0-904183f3f961 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5aca3f2b-5efe-414a-a77c-3ff3555f8ea5 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6af51dcc-95ac-43ef-a9cc-7b49908d03fd tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c16f9a67-1edc-460a-9003-7a5d493668a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f8e7b14-4da4-44e7-a8c9-1ee2d7b3a9ee', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6af51dcc-95ac-43ef-a9cc-7b49908d03fd tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (593cd50c-fbd0-4976-b9c4-8e61839f51b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:58 devstack sudo[103160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5aca3f2b-5efe-414a-a77c-3ff3555f8ea5 1073741824 Sep 28 11:59:58 devstack sudo[103160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:58 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-6af51dcc-95ac-43ef-a9cc-7b49908d03fd tempest-CreateVolumesFromSnapshotTest-1290784761 None] Volume volume-5f8e7b14-4da4-44e7-a8c9-1ee2d7b3a9ee (5f8e7b14-4da4-44e7-a8c9-1ee2d7b3a9ee): created successfully Sep 28 11:59:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6af51dcc-95ac-43ef-a9cc-7b49908d03fd tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (593cd50c-fbd0-4976-b9c4-8e61839f51b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6af51dcc-95ac-43ef-a9cc-7b49908d03fd tempest-CreateVolumesFromSnapshotTest-1290784761 None] Flow 'volume_create_manager' (4c292b66-fc6a-46e7-925e-fc27d5d8a9ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:59:58 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-6af51dcc-95ac-43ef-a9cc-7b49908d03fd tempest-CreateVolumesFromSnapshotTest-1290784761 None] Created volume successfully. Sep 28 11:59:58 devstack sudo[103160]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-457869c0-1a15-4b85-89e0-904183f3f961 tempest-CreateVolumesFromSnapshotTest-1290784761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5aca3f2b-5efe-414a-a77c-3ff3555f8ea5 1073741824" returned: 0 in 0.569s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-457869c0-1a15-4b85-89e0-904183f3f961 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5aca3f2b-5efe-414a-a77c-3ff3555f8ea5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:58 devstack sudo[103167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5aca3f2b-5efe-414a-a77c-3ff3555f8ea5 Sep 28 11:59:58 devstack sudo[103167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:58 devstack sudo[103167]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-457869c0-1a15-4b85-89e0-904183f3f961 tempest-CreateVolumesFromSnapshotTest-1290784761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5aca3f2b-5efe-414a-a77c-3ff3555f8ea5" returned: 0 in 0.285s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-457869c0-1a15-4b85-89e0-904183f3f961 tempest-CreateVolumesFromSnapshotTest-1290784761 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 11:59:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-457869c0-1a15-4b85-89e0-904183f3f961 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:59:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1ba8f6af-e06c-40e9-bfcc-4aa2e7af9d27 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.268s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:59:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1ba8f6af-e06c-40e9-bfcc-4aa2e7af9d27 tempest-VolumesSnapshotTestJSON-234340527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T09:59:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1045532102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb928adbcb8b424f94e03b26751e1eb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T09:59:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T09:59:58Z,use_quota=True,user_id='1708eb324dc5445894a1a92f35e5d748',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 11:59:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-1ba8f6af-e06c-40e9-bfcc-4aa2e7af9d27 tempest-VolumesSnapshotTestJSON-234340527 None] Creating volume ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 11:59:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1ba8f6af-e06c-40e9-bfcc-4aa2e7af9d27 tempest-VolumesSnapshotTestJSON-234340527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 11:59:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1ba8f6af-e06c-40e9-bfcc-4aa2e7af9d27 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 11:59:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1ba8f6af-e06c-40e9-bfcc-4aa2e7af9d27 tempest-VolumesSnapshotTestJSON-234340527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 11:59:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1ba8f6af-e06c-40e9-bfcc-4aa2e7af9d27 tempest-VolumesSnapshotTestJSON-234340527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 11:59:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1ba8f6af-e06c-40e9-bfcc-4aa2e7af9d27 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 11:59:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1ba8f6af-e06c-40e9-bfcc-4aa2e7af9d27 tempest-VolumesSnapshotTestJSON-234340527 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 11:59:59 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-1ba8f6af-e06c-40e9-bfcc-4aa2e7af9d27 tempest-VolumesSnapshotTestJSON-234340527 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 11:59:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1ba8f6af-e06c-40e9-bfcc-4aa2e7af9d27 tempest-VolumesSnapshotTestJSON-234340527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:59 devstack sudo[103170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b 1073741824 Sep 28 11:59:59 devstack sudo[103170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-457869c0-1a15-4b85-89e0-904183f3f961 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c97cba08-83f2-4bfd-b8d3-9e6adee9ffbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5aca3f2b-5efe-414a-a77c-3ff3555f8ea5', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-457869c0-1a15-4b85-89e0-904183f3f961 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (767bcdc6-ae61-4dc2-a97a-a004a07d812f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 11:59:59 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-457869c0-1a15-4b85-89e0-904183f3f961 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Volume volume-5aca3f2b-5efe-414a-a77c-3ff3555f8ea5 (5aca3f2b-5efe-414a-a77c-3ff3555f8ea5): created successfully Sep 28 11:59:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-457869c0-1a15-4b85-89e0-904183f3f961 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (767bcdc6-ae61-4dc2-a97a-a004a07d812f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 11:59:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-457869c0-1a15-4b85-89e0-904183f3f961 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Flow 'volume_create_manager' (97af2af4-c736-4ae6-a9eb-29af9ae5e95c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 11:59:59 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-457869c0-1a15-4b85-89e0-904183f3f961 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Created volume successfully. Sep 28 11:59:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6df98d0b-37fb-419a-b2d5-101459f28f2b tempest-CreateVolumesFromSnapshotTest-1290784761 None] Acquiring lock "cinder-5aca3f2b-5efe-414a-a77c-3ff3555f8ea5-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:59:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6df98d0b-37fb-419a-b2d5-101459f28f2b tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "cinder-5aca3f2b-5efe-414a-a77c-3ff3555f8ea5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:59:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6df98d0b-37fb-419a-b2d5-101459f28f2b tempest-CreateVolumesFromSnapshotTest-1290784761 None] Acquiring lock "cinder-quobyte-5aca3f2b-5efe-414a-a77c-3ff3555f8ea5" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 11:59:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6df98d0b-37fb-419a-b2d5-101459f28f2b tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "cinder-quobyte-5aca3f2b-5efe-414a-a77c-3ff3555f8ea5" acquired by "delete_volume" :: waited 0.024s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 11:59:59 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e978f5-4b51-404b-8a21-b9372d681211]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 11:59:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6df98d0b-37fb-419a-b2d5-101459f28f2b tempest-CreateVolumesFromSnapshotTest-1290784761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5aca3f2b-5efe-414a-a77c-3ff3555f8ea5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:59 devstack sudo[103170]: pam_unix(sudo:session): session closed for user root Sep 28 11:59:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1ba8f6af-e06c-40e9-bfcc-4aa2e7af9d27 tempest-VolumesSnapshotTestJSON-234340527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b 1073741824" returned: 0 in 0.703s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 11:59:59 devstack sudo[103176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5aca3f2b-5efe-414a-a77c-3ff3555f8ea5 Sep 28 11:59:59 devstack sudo[103176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 11:59:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1ba8f6af-e06c-40e9-bfcc-4aa2e7af9d27 tempest-VolumesSnapshotTestJSON-234340527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 11:59:59 devstack sudo[103178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b Sep 28 11:59:59 devstack sudo[103178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:00 devstack sudo[103176]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6df98d0b-37fb-419a-b2d5-101459f28f2b tempest-CreateVolumesFromSnapshotTest-1290784761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5aca3f2b-5efe-414a-a77c-3ff3555f8ea5" returned: 0 in 0.566s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6df98d0b-37fb-419a-b2d5-101459f28f2b tempest-CreateVolumesFromSnapshotTest-1290784761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5aca3f2b-5efe-414a-a77c-3ff3555f8ea5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:00 devstack sudo[103178]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1ba8f6af-e06c-40e9-bfcc-4aa2e7af9d27 tempest-VolumesSnapshotTestJSON-234340527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b" returned: 0 in 0.385s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1ba8f6af-e06c-40e9-bfcc-4aa2e7af9d27 tempest-VolumesSnapshotTestJSON-234340527 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:00:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1ba8f6af-e06c-40e9-bfcc-4aa2e7af9d27 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:00:00 devstack sudo[103185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5aca3f2b-5efe-414a-a77c-3ff3555f8ea5 Sep 28 12:00:00 devstack sudo[103185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1ba8f6af-e06c-40e9-bfcc-4aa2e7af9d27 tempest-VolumesSnapshotTestJSON-234340527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60f649cb-3aef-4501-97cd-6c5bf21c95da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:00:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1ba8f6af-e06c-40e9-bfcc-4aa2e7af9d27 tempest-VolumesSnapshotTestJSON-234340527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe59f5d2-7f49-4598-be13-9f5bc07b3eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:00:00 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-1ba8f6af-e06c-40e9-bfcc-4aa2e7af9d27 tempest-VolumesSnapshotTestJSON-234340527 None] Volume volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b (ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b): created successfully Sep 28 12:00:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1ba8f6af-e06c-40e9-bfcc-4aa2e7af9d27 tempest-VolumesSnapshotTestJSON-234340527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe59f5d2-7f49-4598-be13-9f5bc07b3eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:00:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1ba8f6af-e06c-40e9-bfcc-4aa2e7af9d27 tempest-VolumesSnapshotTestJSON-234340527 None] Flow 'volume_create_manager' (40843007-83c9-4a61-857e-ac3c4535f1ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:00:00 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-1ba8f6af-e06c-40e9-bfcc-4aa2e7af9d27 tempest-VolumesSnapshotTestJSON-234340527 None] Created volume successfully. Sep 28 12:00:00 devstack sudo[103185]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6df98d0b-37fb-419a-b2d5-101459f28f2b tempest-CreateVolumesFromSnapshotTest-1290784761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5aca3f2b-5efe-414a-a77c-3ff3555f8ea5" returned: 0 in 0.346s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6df98d0b-37fb-419a-b2d5-101459f28f2b tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "cinder-quobyte-5aca3f2b-5efe-414a-a77c-3ff3555f8ea5" released by "delete_volume" :: held 0.982s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:00:00 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-6df98d0b-37fb-419a-b2d5-101459f28f2b tempest-CreateVolumesFromSnapshotTest-1290784761 None] Created reservations ['c0b4d51b-c8fd-4968-8796-48ba3322b349', '2721ba47-ceb4-4635-b8d5-e10b3c68736c', '19f5b123-a7e4-41ff-8a2a-ac80d3153014', '5c8fb18b-a04c-42ee-8962-9e3fd6fa5927'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:00:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6df98d0b-37fb-419a-b2d5-101459f28f2b tempest-CreateVolumesFromSnapshotTest-1290784761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:00:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6df98d0b-37fb-419a-b2d5-101459f28f2b tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:00:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6df98d0b-37fb-419a-b2d5-101459f28f2b tempest-CreateVolumesFromSnapshotTest-1290784761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:00:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6df98d0b-37fb-419a-b2d5-101459f28f2b tempest-CreateVolumesFromSnapshotTest-1290784761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:00:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6df98d0b-37fb-419a-b2d5-101459f28f2b tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:00:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6df98d0b-37fb-419a-b2d5-101459f28f2b tempest-CreateVolumesFromSnapshotTest-1290784761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:00 devstack sudo[103189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:00:00 devstack sudo[103189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fca09958-86dc-4c38-ac03-4e5036d96c1c tempest-CreateVolumesFromSnapshotTest-1290784761 None] Acquiring lock "cinder-5f8e7b14-4da4-44e7-a8c9-1ee2d7b3a9ee-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:00:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fca09958-86dc-4c38-ac03-4e5036d96c1c tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "cinder-5f8e7b14-4da4-44e7-a8c9-1ee2d7b3a9ee-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:00:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fca09958-86dc-4c38-ac03-4e5036d96c1c tempest-CreateVolumesFromSnapshotTest-1290784761 None] Acquiring lock "cinder-quobyte-5f8e7b14-4da4-44e7-a8c9-1ee2d7b3a9ee" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:00:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fca09958-86dc-4c38-ac03-4e5036d96c1c tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "cinder-quobyte-5f8e7b14-4da4-44e7-a8c9-1ee2d7b3a9ee" acquired by "delete_volume" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:00:01 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[599647ff-86bc-4dfc-b84c-04137488d623]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:00:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fca09958-86dc-4c38-ac03-4e5036d96c1c tempest-CreateVolumesFromSnapshotTest-1290784761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5f8e7b14-4da4-44e7-a8c9-1ee2d7b3a9ee {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:01 devstack sudo[103189]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6df98d0b-37fb-419a-b2d5-101459f28f2b tempest-CreateVolumesFromSnapshotTest-1290784761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.518s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:01 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-6df98d0b-37fb-419a-b2d5-101459f28f2b tempest-CreateVolumesFromSnapshotTest-1290784761 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:00:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5ba775d0-2a4a-4cc1-b203-24c183a94483 tempest-VolumesSnapshotTestJSON-234340527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:00:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5ba775d0-2a4a-4cc1-b203-24c183a94483 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:00:01 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-6df98d0b-37fb-419a-b2d5-101459f28f2b tempest-CreateVolumesFromSnapshotTest-1290784761 None] Deleted volume successfully. Sep 28 12:00:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-5ba775d0-2a4a-4cc1-b203-24c183a94483 tempest-VolumesSnapshotTestJSON-234340527 None] Creating offline snapshot 241c6fd8-c8ba-4038-a9e3-bab9d03f6053 of volume ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:00:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6df98d0b-37fb-419a-b2d5-101459f28f2b tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "cinder-5aca3f2b-5efe-414a-a77c-3ff3555f8ea5-delete_volume" released by "delete_volume" :: held 1.828s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:00:01 devstack sudo[103191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5f8e7b14-4da4-44e7-a8c9-1ee2d7b3a9ee Sep 28 12:00:01 devstack sudo[103191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:01 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[7feaca83-bb93-47df-a005-179340c70716]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:00:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5ba775d0-2a4a-4cc1-b203-24c183a94483 tempest-VolumesSnapshotTestJSON-234340527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:01 devstack sudo[103195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b Sep 28 12:00:01 devstack sudo[103195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:01 devstack sudo[103191]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fca09958-86dc-4c38-ac03-4e5036d96c1c tempest-CreateVolumesFromSnapshotTest-1290784761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5f8e7b14-4da4-44e7-a8c9-1ee2d7b3a9ee" returned: 0 in 0.571s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fca09958-86dc-4c38-ac03-4e5036d96c1c tempest-CreateVolumesFromSnapshotTest-1290784761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5f8e7b14-4da4-44e7-a8c9-1ee2d7b3a9ee {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:01 devstack sudo[103200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5f8e7b14-4da4-44e7-a8c9-1ee2d7b3a9ee Sep 28 12:00:01 devstack sudo[103200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:01 devstack sudo[103195]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5ba775d0-2a4a-4cc1-b203-24c183a94483 tempest-VolumesSnapshotTestJSON-234340527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b" returned: 0 in 0.562s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5ba775d0-2a4a-4cc1-b203-24c183a94483 tempest-VolumesSnapshotTestJSON-234340527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b.241c6fd8-c8ba-4038-a9e3-bab9d03f6053 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:01 devstack sudo[103205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b.241c6fd8-c8ba-4038-a9e3-bab9d03f6053 1G Sep 28 12:00:01 devstack sudo[103205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:01 devstack sudo[103200]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fca09958-86dc-4c38-ac03-4e5036d96c1c tempest-CreateVolumesFromSnapshotTest-1290784761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5f8e7b14-4da4-44e7-a8c9-1ee2d7b3a9ee" returned: 0 in 0.392s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fca09958-86dc-4c38-ac03-4e5036d96c1c tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "cinder-quobyte-5f8e7b14-4da4-44e7-a8c9-1ee2d7b3a9ee" released by "delete_volume" :: held 1.030s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:00:02 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-fca09958-86dc-4c38-ac03-4e5036d96c1c tempest-CreateVolumesFromSnapshotTest-1290784761 None] Created reservations ['6ba1242f-9fd3-4821-b555-a899f2f9962a', '40d5c03c-c5a2-488a-a62d-c5ee8263e976', 'f2a01556-be67-44c7-b23f-b11a53d29f92', '3f619ecc-3c3b-4e5d-9868-baf83210c3cd'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:00:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fca09958-86dc-4c38-ac03-4e5036d96c1c tempest-CreateVolumesFromSnapshotTest-1290784761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:00:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fca09958-86dc-4c38-ac03-4e5036d96c1c tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:00:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-fca09958-86dc-4c38-ac03-4e5036d96c1c tempest-CreateVolumesFromSnapshotTest-1290784761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:00:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-fca09958-86dc-4c38-ac03-4e5036d96c1c tempest-CreateVolumesFromSnapshotTest-1290784761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:00:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fca09958-86dc-4c38-ac03-4e5036d96c1c tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:00:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fca09958-86dc-4c38-ac03-4e5036d96c1c tempest-CreateVolumesFromSnapshotTest-1290784761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:02 devstack sudo[103211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:00:02 devstack sudo[103211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:02 devstack sudo[103205]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5ba775d0-2a4a-4cc1-b203-24c183a94483 tempest-VolumesSnapshotTestJSON-234340527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b.241c6fd8-c8ba-4038-a9e3-bab9d03f6053 1G" returned: 0 in 0.508s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5ba775d0-2a4a-4cc1-b203-24c183a94483 tempest-VolumesSnapshotTestJSON-234340527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b.241c6fd8-c8ba-4038-a9e3-bab9d03f6053 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:02 devstack sudo[103214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b.241c6fd8-c8ba-4038-a9e3-bab9d03f6053 Sep 28 12:00:02 devstack sudo[103214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:02 devstack sudo[103211]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fca09958-86dc-4c38-ac03-4e5036d96c1c tempest-CreateVolumesFromSnapshotTest-1290784761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.281s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:02 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-fca09958-86dc-4c38-ac03-4e5036d96c1c tempest-CreateVolumesFromSnapshotTest-1290784761 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:00:02 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-fca09958-86dc-4c38-ac03-4e5036d96c1c tempest-CreateVolumesFromSnapshotTest-1290784761 None] Deleted volume successfully. Sep 28 12:00:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fca09958-86dc-4c38-ac03-4e5036d96c1c tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "cinder-5f8e7b14-4da4-44e7-a8c9-1ee2d7b3a9ee-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:00:02 devstack sudo[103214]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5ba775d0-2a4a-4cc1-b203-24c183a94483 tempest-VolumesSnapshotTestJSON-234340527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b.241c6fd8-c8ba-4038-a9e3-bab9d03f6053" returned: 0 in 0.298s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:02 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-5ba775d0-2a4a-4cc1-b203-24c183a94483 tempest-VolumesSnapshotTestJSON-234340527 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b.241c6fd8-c8ba-4038-a9e3-bab9d03f6053 is being set with open permissions: ugo+rw Sep 28 12:00:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5ba775d0-2a4a-4cc1-b203-24c183a94483 tempest-VolumesSnapshotTestJSON-234340527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b.241c6fd8-c8ba-4038-a9e3-bab9d03f6053 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:02 devstack sudo[103221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b.241c6fd8-c8ba-4038-a9e3-bab9d03f6053 Sep 28 12:00:02 devstack sudo[103221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:02 devstack sudo[103221]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5ba775d0-2a4a-4cc1-b203-24c183a94483 tempest-VolumesSnapshotTestJSON-234340527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b.241c6fd8-c8ba-4038-a9e3-bab9d03f6053" returned: 0 in 0.246s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5ba775d0-2a4a-4cc1-b203-24c183a94483 tempest-VolumesSnapshotTestJSON-234340527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:02 devstack sudo[103224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b.info Sep 28 12:00:02 devstack sudo[103224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0d5b9903-8af1-4da1-a705-bf04de176a7d tempest-CreateVolumesFromSnapshotTest-1290784761 None] Acquiring lock "cinder-731fc632-47cc-4cdd-8f9f-62039a5cff71-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:00:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0d5b9903-8af1-4da1-a705-bf04de176a7d tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "cinder-731fc632-47cc-4cdd-8f9f-62039a5cff71-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:00:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0d5b9903-8af1-4da1-a705-bf04de176a7d tempest-CreateVolumesFromSnapshotTest-1290784761 None] Acquiring lock "cinder-quobyte-731fc632-47cc-4cdd-8f9f-62039a5cff71" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:00:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0d5b9903-8af1-4da1-a705-bf04de176a7d tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "cinder-quobyte-731fc632-47cc-4cdd-8f9f-62039a5cff71" acquired by "delete_volume" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:00:03 devstack sudo[103224]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5ba775d0-2a4a-4cc1-b203-24c183a94483 tempest-VolumesSnapshotTestJSON-234340527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b.info" returned: 0 in 0.301s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:03 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-5ba775d0-2a4a-4cc1-b203-24c183a94483 tempest-VolumesSnapshotTestJSON-234340527 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b.info is being set with open permissions: ugo+rw Sep 28 12:00:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5ba775d0-2a4a-4cc1-b203-24c183a94483 tempest-VolumesSnapshotTestJSON-234340527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:03 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[b495552f-dcde-4e6b-ab52-a695ffaed8fa]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:00:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0d5b9903-8af1-4da1-a705-bf04de176a7d tempest-CreateVolumesFromSnapshotTest-1290784761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-731fc632-47cc-4cdd-8f9f-62039a5cff71 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:03 devstack sudo[103227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b.info Sep 28 12:00:03 devstack sudo[103227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:03 devstack sudo[103228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-731fc632-47cc-4cdd-8f9f-62039a5cff71 Sep 28 12:00:03 devstack sudo[103228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:03 devstack sudo[103227]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5ba775d0-2a4a-4cc1-b203-24c183a94483 tempest-VolumesSnapshotTestJSON-234340527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b.info" returned: 0 in 0.265s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5ba775d0-2a4a-4cc1-b203-24c183a94483 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.311s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:00:03 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-5ba775d0-2a4a-4cc1-b203-24c183a94483 tempest-VolumesSnapshotTestJSON-234340527 None] Create snapshot completed successfully Sep 28 12:00:03 devstack sudo[103228]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0d5b9903-8af1-4da1-a705-bf04de176a7d tempest-CreateVolumesFromSnapshotTest-1290784761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-731fc632-47cc-4cdd-8f9f-62039a5cff71" returned: 0 in 0.426s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0d5b9903-8af1-4da1-a705-bf04de176a7d tempest-CreateVolumesFromSnapshotTest-1290784761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-731fc632-47cc-4cdd-8f9f-62039a5cff71 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:03 devstack sudo[103236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-731fc632-47cc-4cdd-8f9f-62039a5cff71 Sep 28 12:00:03 devstack sudo[103236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:03 devstack sudo[103236]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0d5b9903-8af1-4da1-a705-bf04de176a7d tempest-CreateVolumesFromSnapshotTest-1290784761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-731fc632-47cc-4cdd-8f9f-62039a5cff71" returned: 0 in 0.252s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0d5b9903-8af1-4da1-a705-bf04de176a7d tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "cinder-quobyte-731fc632-47cc-4cdd-8f9f-62039a5cff71" released by "delete_volume" :: held 0.746s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:00:04 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-0d5b9903-8af1-4da1-a705-bf04de176a7d tempest-CreateVolumesFromSnapshotTest-1290784761 None] Created reservations ['562abc71-70b6-43ae-93e0-be6d1b85f16e', '16845c85-7d99-442e-b949-38032225fc9e', 'b53e8f61-d1f0-4da8-9d18-4468026c7d24', 'fadf10e5-5cb9-43e4-9de1-e948e491691f'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:00:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0d5b9903-8af1-4da1-a705-bf04de176a7d tempest-CreateVolumesFromSnapshotTest-1290784761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:00:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0d5b9903-8af1-4da1-a705-bf04de176a7d tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:00:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0d5b9903-8af1-4da1-a705-bf04de176a7d tempest-CreateVolumesFromSnapshotTest-1290784761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:00:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0d5b9903-8af1-4da1-a705-bf04de176a7d tempest-CreateVolumesFromSnapshotTest-1290784761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:00:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0d5b9903-8af1-4da1-a705-bf04de176a7d tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:00:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0d5b9903-8af1-4da1-a705-bf04de176a7d tempest-CreateVolumesFromSnapshotTest-1290784761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:04 devstack sudo[103240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:00:04 devstack sudo[103240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:04 devstack sudo[103240]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:04 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-217979ac-7af6-4d19-a2c8-c606653f9159 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Acquiring lock "cinder-6e24fb9c-b44b-4311-9496-37be107d0da4-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:00:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0d5b9903-8af1-4da1-a705-bf04de176a7d tempest-CreateVolumesFromSnapshotTest-1290784761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.302s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:04 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-0d5b9903-8af1-4da1-a705-bf04de176a7d tempest-CreateVolumesFromSnapshotTest-1290784761 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:00:04 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-0d5b9903-8af1-4da1-a705-bf04de176a7d tempest-CreateVolumesFromSnapshotTest-1290784761 None] Deleted volume successfully. Sep 28 12:00:04 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-217979ac-7af6-4d19-a2c8-c606653f9159 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "cinder-6e24fb9c-b44b-4311-9496-37be107d0da4-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:00:04 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0d5b9903-8af1-4da1-a705-bf04de176a7d tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "cinder-731fc632-47cc-4cdd-8f9f-62039a5cff71-delete_volume" released by "delete_volume" :: held 1.341s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:00:04 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-217979ac-7af6-4d19-a2c8-c606653f9159 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Acquiring lock "cinder-quobyte-6e24fb9c-b44b-4311-9496-37be107d0da4" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:00:04 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-217979ac-7af6-4d19-a2c8-c606653f9159 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "cinder-quobyte-6e24fb9c-b44b-4311-9496-37be107d0da4" acquired by "delete_volume" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:00:04 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeae17f7-bda2-48c7-96f0-13c0ff05e074]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:00:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-217979ac-7af6-4d19-a2c8-c606653f9159 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-6e24fb9c-b44b-4311-9496-37be107d0da4 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:04 devstack sudo[103243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-6e24fb9c-b44b-4311-9496-37be107d0da4 Sep 28 12:00:04 devstack sudo[103243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:05 devstack sudo[103243]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-217979ac-7af6-4d19-a2c8-c606653f9159 tempest-CreateVolumesFromSnapshotTest-1290784761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-6e24fb9c-b44b-4311-9496-37be107d0da4" returned: 0 in 0.484s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-217979ac-7af6-4d19-a2c8-c606653f9159 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-6e24fb9c-b44b-4311-9496-37be107d0da4 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:05 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-a34284be-2817-4657-a667-f2b5e9db8a1a tempest-VolumesSnapshotTestJSON-234340527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:00:05 devstack sudo[103249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-6e24fb9c-b44b-4311-9496-37be107d0da4 Sep 28 12:00:05 devstack sudo[103249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a34284be-2817-4657-a667-f2b5e9db8a1a tempest-VolumesSnapshotTestJSON-234340527 None] Flow 'volume_create_manager' (b699adda-d3a9-43bf-aef8-60b660df9d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:00:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a34284be-2817-4657-a667-f2b5e9db8a1a tempest-VolumesSnapshotTestJSON-234340527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ab994e4-48c9-41b9-900d-ad8c1f5a0e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:00:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a34284be-2817-4657-a667-f2b5e9db8a1a tempest-VolumesSnapshotTestJSON-234340527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ab994e4-48c9-41b9-900d-ad8c1f5a0e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:00:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-969792844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e1a92b3-0b3a-462c-b421-9f92de2669e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb928adbcb8b424f94e03b26751e1eb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:00:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=241c6fd8-c8ba-4038-a9e3-bab9d03f6053,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:00:05Z,use_quota=True,user_id='1708eb324dc5445894a1a92f35e5d748',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:00:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a34284be-2817-4657-a667-f2b5e9db8a1a tempest-VolumesSnapshotTestJSON-234340527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24dda8e5-750d-4555-8315-4977974a1739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:00:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a34284be-2817-4657-a667-f2b5e9db8a1a tempest-VolumesSnapshotTestJSON-234340527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24dda8e5-750d-4555-8315-4977974a1739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:00:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a34284be-2817-4657-a667-f2b5e9db8a1a tempest-VolumesSnapshotTestJSON-234340527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11e492f8-71aa-41d1-a58e-8f6b30c9eea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:00:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a34284be-2817-4657-a667-f2b5e9db8a1a tempest-VolumesSnapshotTestJSON-234340527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11e492f8-71aa-41d1-a58e-8f6b30c9eea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3e1a92b3-0b3a-462c-b421-9f92de2669e2', 'volume_name': 'volume-3e1a92b3-0b3a-462c-b421-9f92de2669e2', 'volume_size': 1, 'snapshot_id': '241c6fd8-c8ba-4038-a9e3-bab9d03f6053'}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:00:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a34284be-2817-4657-a667-f2b5e9db8a1a tempest-VolumesSnapshotTestJSON-234340527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97adb02f-8a2a-41cd-8103-66652e5487d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:00:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a34284be-2817-4657-a667-f2b5e9db8a1a tempest-VolumesSnapshotTestJSON-234340527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97adb02f-8a2a-41cd-8103-66652e5487d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:00:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a34284be-2817-4657-a667-f2b5e9db8a1a tempest-VolumesSnapshotTestJSON-234340527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c962306d-232d-4e3d-aca4-13a23cdaf7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:00:05 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-a34284be-2817-4657-a667-f2b5e9db8a1a tempest-VolumesSnapshotTestJSON-234340527 None] Volume 3e1a92b3-0b3a-462c-b421-9f92de2669e2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3e1a92b3-0b3a-462c-b421-9f92de2669e2', 'volume_size': 1, 'snapshot_id': '241c6fd8-c8ba-4038-a9e3-bab9d03f6053'} Sep 28 12:00:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a34284be-2817-4657-a667-f2b5e9db8a1a tempest-VolumesSnapshotTestJSON-234340527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:00:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a34284be-2817-4657-a667-f2b5e9db8a1a tempest-VolumesSnapshotTestJSON-234340527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:00:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a34284be-2817-4657-a667-f2b5e9db8a1a tempest-VolumesSnapshotTestJSON-234340527 None] Acquiring lock "cinder-quobyte-241c6fd8-c8ba-4038-a9e3-bab9d03f6053-3e1a92b3-0b3a-462c-b421-9f92de2669e2" by "_create_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:00:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a34284be-2817-4657-a667-f2b5e9db8a1a tempest-VolumesSnapshotTestJSON-234340527 None] Lock "cinder-quobyte-241c6fd8-c8ba-4038-a9e3-bab9d03f6053-3e1a92b3-0b3a-462c-b421-9f92de2669e2" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:00:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a34284be-2817-4657-a667-f2b5e9db8a1a tempest-VolumesSnapshotTestJSON-234340527 None] Creating volume 3e1a92b3-0b3a-462c-b421-9f92de2669e2 from snapshot 241c6fd8-c8ba-4038-a9e3-bab9d03f6053 {{(pid=86916) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 12:00:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a34284be-2817-4657-a667-f2b5e9db8a1a tempest-VolumesSnapshotTestJSON-234340527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:00:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a34284be-2817-4657-a667-f2b5e9db8a1a tempest-VolumesSnapshotTestJSON-234340527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:00:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a34284be-2817-4657-a667-f2b5e9db8a1a tempest-VolumesSnapshotTestJSON-234340527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:00:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a34284be-2817-4657-a667-f2b5e9db8a1a tempest-VolumesSnapshotTestJSON-234340527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:00:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a34284be-2817-4657-a667-f2b5e9db8a1a tempest-VolumesSnapshotTestJSON-234340527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:00:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a34284be-2817-4657-a667-f2b5e9db8a1a tempest-VolumesSnapshotTestJSON-234340527 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:00:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a34284be-2817-4657-a667-f2b5e9db8a1a tempest-VolumesSnapshotTestJSON-234340527 None] Acquiring lock "cinder-quobyte-3e1a92b3-0b3a-462c-b421-9f92de2669e2" by "_copy_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:00:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a34284be-2817-4657-a667-f2b5e9db8a1a tempest-VolumesSnapshotTestJSON-234340527 None] Lock "cinder-quobyte-3e1a92b3-0b3a-462c-b421-9f92de2669e2" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:00:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a34284be-2817-4657-a667-f2b5e9db8a1a tempest-VolumesSnapshotTestJSON-234340527 None] snapshot: 241c6fd8-c8ba-4038-a9e3-bab9d03f6053, volume: 3e1a92b3-0b3a-462c-b421-9f92de2669e2, {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 12:00:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a34284be-2817-4657-a667-f2b5e9db8a1a tempest-VolumesSnapshotTestJSON-234340527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:00:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a34284be-2817-4657-a667-f2b5e9db8a1a tempest-VolumesSnapshotTestJSON-234340527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:00:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a34284be-2817-4657-a667-f2b5e9db8a1a tempest-VolumesSnapshotTestJSON-234340527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:00:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a34284be-2817-4657-a667-f2b5e9db8a1a tempest-VolumesSnapshotTestJSON-234340527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:00:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a34284be-2817-4657-a667-f2b5e9db8a1a tempest-VolumesSnapshotTestJSON-234340527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:00:05 devstack sudo[103249]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:05 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3244bae-ba58-460b-880b-d0a34821bb01]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:00:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a34284be-2817-4657-a667-f2b5e9db8a1a tempest-VolumesSnapshotTestJSON-234340527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b.241c6fd8-c8ba-4038-a9e3-bab9d03f6053 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-217979ac-7af6-4d19-a2c8-c606653f9159 tempest-CreateVolumesFromSnapshotTest-1290784761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-6e24fb9c-b44b-4311-9496-37be107d0da4" returned: 0 in 0.307s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-217979ac-7af6-4d19-a2c8-c606653f9159 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "cinder-quobyte-6e24fb9c-b44b-4311-9496-37be107d0da4" released by "delete_volume" :: held 0.835s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:00:05 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-217979ac-7af6-4d19-a2c8-c606653f9159 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Created reservations ['872ed4cf-0d45-4ce8-8c9f-a8b3a8863290', '00f63760-f544-43c4-918b-b56ae84e4d8c', 'cda9bc60-0538-472a-9bba-490cca3e643d', '0487e158-9675-4aed-a837-c08569c78f8d'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:00:05 devstack sudo[103252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b.241c6fd8-c8ba-4038-a9e3-bab9d03f6053 Sep 28 12:00:05 devstack sudo[103252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-217979ac-7af6-4d19-a2c8-c606653f9159 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:00:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-217979ac-7af6-4d19-a2c8-c606653f9159 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:00:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-217979ac-7af6-4d19-a2c8-c606653f9159 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:00:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-217979ac-7af6-4d19-a2c8-c606653f9159 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:00:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-217979ac-7af6-4d19-a2c8-c606653f9159 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:00:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-217979ac-7af6-4d19-a2c8-c606653f9159 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:05 devstack sudo[103254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:00:05 devstack sudo[103254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d3449b40-69c2-4ffd-a21b-576af1e24d84 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Acquiring lock "cinder-3c115c79-3355-44b4-9c5e-de12512b42a9-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:00:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d3449b40-69c2-4ffd-a21b-576af1e24d84 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "cinder-3c115c79-3355-44b4-9c5e-de12512b42a9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:00:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d3449b40-69c2-4ffd-a21b-576af1e24d84 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Acquiring lock "cinder-quobyte-3c115c79-3355-44b4-9c5e-de12512b42a9" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:00:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d3449b40-69c2-4ffd-a21b-576af1e24d84 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "cinder-quobyte-3c115c79-3355-44b4-9c5e-de12512b42a9" acquired by "delete_volume" :: waited 0.024s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:00:05 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[408be1e7-c36c-4923-a35a-9402e293743f]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:00:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d3449b40-69c2-4ffd-a21b-576af1e24d84 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3c115c79-3355-44b4-9c5e-de12512b42a9 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:05 devstack sudo[103252]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a34284be-2817-4657-a667-f2b5e9db8a1a tempest-VolumesSnapshotTestJSON-234340527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b.241c6fd8-c8ba-4038-a9e3-bab9d03f6053" returned: 0 in 0.495s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-a34284be-2817-4657-a667-f2b5e9db8a1a tempest-VolumesSnapshotTestJSON-234340527 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:00:05 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5845147-a7ab-4de9-94d0-fbcfaf4fa57c]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:00:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a34284be-2817-4657-a667-f2b5e9db8a1a tempest-VolumesSnapshotTestJSON-234340527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:05 devstack sudo[103254]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-217979ac-7af6-4d19-a2c8-c606653f9159 tempest-CreateVolumesFromSnapshotTest-1290784761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.350s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:05 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-217979ac-7af6-4d19-a2c8-c606653f9159 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:00:05 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-217979ac-7af6-4d19-a2c8-c606653f9159 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Deleted volume successfully. Sep 28 12:00:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-217979ac-7af6-4d19-a2c8-c606653f9159 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "cinder-6e24fb9c-b44b-4311-9496-37be107d0da4-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:00:05 devstack sudo[103259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3c115c79-3355-44b4-9c5e-de12512b42a9 Sep 28 12:00:05 devstack sudo[103259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:05 devstack sudo[103260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b Sep 28 12:00:05 devstack sudo[103260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:06 devstack sudo[103259]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d3449b40-69c2-4ffd-a21b-576af1e24d84 tempest-CreateVolumesFromSnapshotTest-1290784761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3c115c79-3355-44b4-9c5e-de12512b42a9" returned: 0 in 0.479s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d3449b40-69c2-4ffd-a21b-576af1e24d84 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3c115c79-3355-44b4-9c5e-de12512b42a9 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:06 devstack sudo[103260]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a34284be-2817-4657-a667-f2b5e9db8a1a tempest-VolumesSnapshotTestJSON-234340527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b" returned: 0 in 0.452s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a34284be-2817-4657-a667-f2b5e9db8a1a tempest-VolumesSnapshotTestJSON-234340527 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 12:00:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a34284be-2817-4657-a667-f2b5e9db8a1a tempest-VolumesSnapshotTestJSON-234340527 None] Creating direct copy from snapshot {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 12:00:06 devstack cinder-volume[86916]: DEBUG cinder.utils [None req-a34284be-2817-4657-a667-f2b5e9db8a1a tempest-VolumesSnapshotTestJSON-234340527 None] Path /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3e1a92b3-0b3a-462c-b421-9f92de2669e2 not found in is_blk_device check {{(pid=86916) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 12:00:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a34284be-2817-4657-a667-f2b5e9db8a1a tempest-VolumesSnapshotTestJSON-234340527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3e1a92b3-0b3a-462c-b421-9f92de2669e2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:06 devstack sudo[103271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3c115c79-3355-44b4-9c5e-de12512b42a9 Sep 28 12:00:06 devstack sudo[103271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:06 devstack sudo[103273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3e1a92b3-0b3a-462c-b421-9f92de2669e2 Sep 28 12:00:06 devstack sudo[103273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:06 devstack sudo[103271]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d3449b40-69c2-4ffd-a21b-576af1e24d84 tempest-CreateVolumesFromSnapshotTest-1290784761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3c115c79-3355-44b4-9c5e-de12512b42a9" returned: 0 in 0.257s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d3449b40-69c2-4ffd-a21b-576af1e24d84 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "cinder-quobyte-3c115c79-3355-44b4-9c5e-de12512b42a9" released by "delete_volume" :: held 0.795s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:00:06 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-d3449b40-69c2-4ffd-a21b-576af1e24d84 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Created reservations ['c675f87e-1a2f-4a22-b49a-138401c5fd05', 'c7745ff8-2c98-4f39-b8dd-a611c971b4a6', '53372e1a-80b3-417d-ae3d-20ae17802139', '76e29ac5-41ac-42fd-b551-0f3e68064784'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:00:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d3449b40-69c2-4ffd-a21b-576af1e24d84 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:00:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d3449b40-69c2-4ffd-a21b-576af1e24d84 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:00:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d3449b40-69c2-4ffd-a21b-576af1e24d84 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:00:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d3449b40-69c2-4ffd-a21b-576af1e24d84 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:00:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d3449b40-69c2-4ffd-a21b-576af1e24d84 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:00:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d3449b40-69c2-4ffd-a21b-576af1e24d84 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:06 devstack sudo[103279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:00:06 devstack sudo[103279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-db0d3c59-33cd-4999-b210-7c7700f5460e tempest-CreateVolumesFromSnapshotTest-1290784761 None] Acquiring lock "cinder-a159a1ad-49be-413e-ab6b-b22e4f61e6f8-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:00:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-db0d3c59-33cd-4999-b210-7c7700f5460e tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "cinder-a159a1ad-49be-413e-ab6b-b22e4f61e6f8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:00:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-db0d3c59-33cd-4999-b210-7c7700f5460e tempest-CreateVolumesFromSnapshotTest-1290784761 None] Acquiring lock "cinder-quobyte-244241af-b2e2-43a3-ae30-48c5ddf2837f" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:00:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-db0d3c59-33cd-4999-b210-7c7700f5460e tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "cinder-quobyte-244241af-b2e2-43a3-ae30-48c5ddf2837f" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:00:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-db0d3c59-33cd-4999-b210-7c7700f5460e tempest-CreateVolumesFromSnapshotTest-1290784761 None] Acquiring lock "cinder-quobyte-a159a1ad-49be-413e-ab6b-b22e4f61e6f8" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:00:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-db0d3c59-33cd-4999-b210-7c7700f5460e tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "cinder-quobyte-a159a1ad-49be-413e-ab6b-b22e4f61e6f8" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:00:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-db0d3c59-33cd-4999-b210-7c7700f5460e tempest-CreateVolumesFromSnapshotTest-1290784761 None] Deleting offline snapshot a159a1ad-49be-413e-ab6b-b22e4f61e6f8 of volume 244241af-b2e2-43a3-ae30-48c5ddf2837f {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:00:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-db0d3c59-33cd-4999-b210-7c7700f5460e tempest-CreateVolumesFromSnapshotTest-1290784761 None] snapshot_file for this snap is: volume-244241af-b2e2-43a3-ae30-48c5ddf2837f.a159a1ad-49be-413e-ab6b-b22e4f61e6f8 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:00:07 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[93168403-2d2c-4c69-86f8-5a04e7a71443]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:00:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-db0d3c59-33cd-4999-b210-7c7700f5460e tempest-CreateVolumesFromSnapshotTest-1290784761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-244241af-b2e2-43a3-ae30-48c5ddf2837f.a159a1ad-49be-413e-ab6b-b22e4f61e6f8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:07 devstack sudo[103279]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d3449b40-69c2-4ffd-a21b-576af1e24d84 tempest-CreateVolumesFromSnapshotTest-1290784761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.430s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:07 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-d3449b40-69c2-4ffd-a21b-576af1e24d84 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:00:07 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-d3449b40-69c2-4ffd-a21b-576af1e24d84 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Deleted volume successfully. Sep 28 12:00:07 devstack sudo[103285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-244241af-b2e2-43a3-ae30-48c5ddf2837f.a159a1ad-49be-413e-ab6b-b22e4f61e6f8 Sep 28 12:00:07 devstack sudo[103285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d3449b40-69c2-4ffd-a21b-576af1e24d84 tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "cinder-3c115c79-3355-44b4-9c5e-de12512b42a9-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:00:07 devstack sudo[103285]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-db0d3c59-33cd-4999-b210-7c7700f5460e tempest-CreateVolumesFromSnapshotTest-1290784761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-244241af-b2e2-43a3-ae30-48c5ddf2837f.a159a1ad-49be-413e-ab6b-b22e4f61e6f8" returned: 0 in 0.630s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-db0d3c59-33cd-4999-b210-7c7700f5460e tempest-CreateVolumesFromSnapshotTest-1290784761 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-244241af-b2e2-43a3-ae30-48c5ddf2837f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:00:07 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff443fe6-7946-4c43-80fe-2aa6a21af044]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:00:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-db0d3c59-33cd-4999-b210-7c7700f5460e tempest-CreateVolumesFromSnapshotTest-1290784761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-244241af-b2e2-43a3-ae30-48c5ddf2837f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:08 devstack sudo[103295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-244241af-b2e2-43a3-ae30-48c5ddf2837f Sep 28 12:00:08 devstack sudo[103295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:08 devstack sudo[103295]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-db0d3c59-33cd-4999-b210-7c7700f5460e tempest-CreateVolumesFromSnapshotTest-1290784761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-244241af-b2e2-43a3-ae30-48c5ddf2837f" returned: 0 in 0.999s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-db0d3c59-33cd-4999-b210-7c7700f5460e tempest-CreateVolumesFromSnapshotTest-1290784761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-244241af-b2e2-43a3-ae30-48c5ddf2837f.a159a1ad-49be-413e-ab6b-b22e4f61e6f8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:08 devstack sudo[103301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-244241af-b2e2-43a3-ae30-48c5ddf2837f.a159a1ad-49be-413e-ab6b-b22e4f61e6f8 Sep 28 12:00:08 devstack sudo[103301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:09 devstack sudo[103301]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-db0d3c59-33cd-4999-b210-7c7700f5460e tempest-CreateVolumesFromSnapshotTest-1290784761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-244241af-b2e2-43a3-ae30-48c5ddf2837f.a159a1ad-49be-413e-ab6b-b22e4f61e6f8" returned: 0 in 0.843s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-db0d3c59-33cd-4999-b210-7c7700f5460e tempest-CreateVolumesFromSnapshotTest-1290784761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-244241af-b2e2-43a3-ae30-48c5ddf2837f.a159a1ad-49be-413e-ab6b-b22e4f61e6f8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:09 devstack sudo[103343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-244241af-b2e2-43a3-ae30-48c5ddf2837f.a159a1ad-49be-413e-ab6b-b22e4f61e6f8 Sep 28 12:00:09 devstack sudo[103343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:10 devstack sudo[103343]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-db0d3c59-33cd-4999-b210-7c7700f5460e tempest-CreateVolumesFromSnapshotTest-1290784761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-244241af-b2e2-43a3-ae30-48c5ddf2837f.a159a1ad-49be-413e-ab6b-b22e4f61e6f8" returned: 0 in 0.623s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:10 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-db0d3c59-33cd-4999-b210-7c7700f5460e tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "cinder-quobyte-a159a1ad-49be-413e-ab6b-b22e4f61e6f8" released by "_delete_snapshot" :: held 3.373s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:00:10 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-db0d3c59-33cd-4999-b210-7c7700f5460e tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "cinder-quobyte-244241af-b2e2-43a3-ae30-48c5ddf2837f" released by "delete_snapshot" :: held 3.418s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:00:10 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-db0d3c59-33cd-4999-b210-7c7700f5460e tempest-CreateVolumesFromSnapshotTest-1290784761 None] Created reservations ['9aa010a1-2d17-4ddf-a28c-f5ab56d09f15', 'aa2ed823-4384-4d86-8d45-54557e041266', '760d7c67-9b43-4a78-bfd5-49494154951c', '36d710bd-be53-4cc4-a5f7-d8e229191f61'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:00:10 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-db0d3c59-33cd-4999-b210-7c7700f5460e tempest-CreateVolumesFromSnapshotTest-1290784761 None] Delete snapshot completed successfully. Sep 28 12:00:10 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-db0d3c59-33cd-4999-b210-7c7700f5460e tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "cinder-a159a1ad-49be-413e-ab6b-b22e4f61e6f8-delete_snapshot" released by "delete_snapshot" :: held 3.734s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:00:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5e7aa98e-3ab8-4db2-bd9c-5fdb3914967b tempest-CreateVolumesFromSnapshotTest-1290784761 None] Acquiring lock "cinder-244241af-b2e2-43a3-ae30-48c5ddf2837f-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:00:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5e7aa98e-3ab8-4db2-bd9c-5fdb3914967b tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "cinder-244241af-b2e2-43a3-ae30-48c5ddf2837f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:00:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5e7aa98e-3ab8-4db2-bd9c-5fdb3914967b tempest-CreateVolumesFromSnapshotTest-1290784761 None] Acquiring lock "cinder-quobyte-244241af-b2e2-43a3-ae30-48c5ddf2837f" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:00:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5e7aa98e-3ab8-4db2-bd9c-5fdb3914967b tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "cinder-quobyte-244241af-b2e2-43a3-ae30-48c5ddf2837f" acquired by "delete_volume" :: waited 0.026s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:00:11 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0381e2e-4333-4ed5-939e-911d6b0f149a]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:00:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5e7aa98e-3ab8-4db2-bd9c-5fdb3914967b tempest-CreateVolumesFromSnapshotTest-1290784761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-244241af-b2e2-43a3-ae30-48c5ddf2837f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:11 devstack sudo[103376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-244241af-b2e2-43a3-ae30-48c5ddf2837f Sep 28 12:00:11 devstack sudo[103376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:12 devstack sudo[103376]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5e7aa98e-3ab8-4db2-bd9c-5fdb3914967b tempest-CreateVolumesFromSnapshotTest-1290784761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-244241af-b2e2-43a3-ae30-48c5ddf2837f" returned: 0 in 0.625s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5e7aa98e-3ab8-4db2-bd9c-5fdb3914967b tempest-CreateVolumesFromSnapshotTest-1290784761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-244241af-b2e2-43a3-ae30-48c5ddf2837f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:12 devstack sudo[103381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-244241af-b2e2-43a3-ae30-48c5ddf2837f Sep 28 12:00:12 devstack sudo[103381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:12 devstack sudo[103381]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5e7aa98e-3ab8-4db2-bd9c-5fdb3914967b tempest-CreateVolumesFromSnapshotTest-1290784761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-244241af-b2e2-43a3-ae30-48c5ddf2837f" returned: 0 in 0.572s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5e7aa98e-3ab8-4db2-bd9c-5fdb3914967b tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "cinder-quobyte-244241af-b2e2-43a3-ae30-48c5ddf2837f" released by "delete_volume" :: held 1.371s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:00:13 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-5e7aa98e-3ab8-4db2-bd9c-5fdb3914967b tempest-CreateVolumesFromSnapshotTest-1290784761 None] Created reservations ['9e0e7f6e-35be-40d4-a593-ca6050084cf1', '51aff8ba-6c63-4238-b30d-d06c09da285c', '5c2cba74-9901-4651-a595-a748a7977240', 'b74cd37a-50f3-4d76-ac50-388d6f881de7'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:00:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5e7aa98e-3ab8-4db2-bd9c-5fdb3914967b tempest-CreateVolumesFromSnapshotTest-1290784761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:00:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5e7aa98e-3ab8-4db2-bd9c-5fdb3914967b tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:00:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5e7aa98e-3ab8-4db2-bd9c-5fdb3914967b tempest-CreateVolumesFromSnapshotTest-1290784761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:00:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5e7aa98e-3ab8-4db2-bd9c-5fdb3914967b tempest-CreateVolumesFromSnapshotTest-1290784761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:00:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5e7aa98e-3ab8-4db2-bd9c-5fdb3914967b tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:00:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5e7aa98e-3ab8-4db2-bd9c-5fdb3914967b tempest-CreateVolumesFromSnapshotTest-1290784761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:13 devstack sudo[103394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:00:13 devstack sudo[103394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:13 devstack sudo[103394]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5e7aa98e-3ab8-4db2-bd9c-5fdb3914967b tempest-CreateVolumesFromSnapshotTest-1290784761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.369s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:13 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-5e7aa98e-3ab8-4db2-bd9c-5fdb3914967b tempest-CreateVolumesFromSnapshotTest-1290784761 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:00:13 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-5e7aa98e-3ab8-4db2-bd9c-5fdb3914967b tempest-CreateVolumesFromSnapshotTest-1290784761 None] Deleted volume successfully. Sep 28 12:00:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5e7aa98e-3ab8-4db2-bd9c-5fdb3914967b tempest-CreateVolumesFromSnapshotTest-1290784761 None] Lock "cinder-244241af-b2e2-43a3-ae30-48c5ddf2837f-delete_volume" released by "delete_volume" :: held 2.224s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:00:14 devstack sudo[103273]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a34284be-2817-4657-a667-f2b5e9db8a1a tempest-VolumesSnapshotTestJSON-234340527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3e1a92b3-0b3a-462c-b421-9f92de2669e2" returned: 0 in 8.249s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:14 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-a34284be-2817-4657-a667-f2b5e9db8a1a tempest-VolumesSnapshotTestJSON-234340527 None] Image conversion details: src /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b, size 1024.00 MB, duration 8.25 sec, destination /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3e1a92b3-0b3a-462c-b421-9f92de2669e2 {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:00:14 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-a34284be-2817-4657-a667-f2b5e9db8a1a tempest-VolumesSnapshotTestJSON-234340527 None] Converted 1024.00 MB image at 124.12 MB/s Sep 28 12:00:14 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-a34284be-2817-4657-a667-f2b5e9db8a1a tempest-VolumesSnapshotTestJSON-234340527 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3e1a92b3-0b3a-462c-b421-9f92de2669e2 is being set with open permissions: ugo+rw Sep 28 12:00:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a34284be-2817-4657-a667-f2b5e9db8a1a tempest-VolumesSnapshotTestJSON-234340527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3e1a92b3-0b3a-462c-b421-9f92de2669e2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:14 devstack sudo[103397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3e1a92b3-0b3a-462c-b421-9f92de2669e2 Sep 28 12:00:14 devstack sudo[103397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:14 devstack sudo[103397]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a34284be-2817-4657-a667-f2b5e9db8a1a tempest-VolumesSnapshotTestJSON-234340527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3e1a92b3-0b3a-462c-b421-9f92de2669e2" returned: 0 in 0.261s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a34284be-2817-4657-a667-f2b5e9db8a1a tempest-VolumesSnapshotTestJSON-234340527 None] Lock "cinder-quobyte-3e1a92b3-0b3a-462c-b421-9f92de2669e2" released by "_copy_volume_from_snapshot" :: held 9.557s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:00:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a34284be-2817-4657-a667-f2b5e9db8a1a tempest-VolumesSnapshotTestJSON-234340527 None] Lock "cinder-quobyte-241c6fd8-c8ba-4038-a9e3-bab9d03f6053-3e1a92b3-0b3a-462c-b421-9f92de2669e2" released by "_create_volume_from_snapshot" :: held 9.625s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:00:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a34284be-2817-4657-a667-f2b5e9db8a1a tempest-VolumesSnapshotTestJSON-234340527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.641s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:00:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a34284be-2817-4657-a667-f2b5e9db8a1a tempest-VolumesSnapshotTestJSON-234340527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c962306d-232d-4e3d-aca4-13a23cdaf7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e1a92b3-0b3a-462c-b421-9f92de2669e2', 'volume_size': 1, 'snapshot_id': '241c6fd8-c8ba-4038-a9e3-bab9d03f6053'}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:00:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a34284be-2817-4657-a667-f2b5e9db8a1a tempest-VolumesSnapshotTestJSON-234340527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b11dc3e6-2905-409f-b38a-de70e46605d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:00:14 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-a34284be-2817-4657-a667-f2b5e9db8a1a tempest-VolumesSnapshotTestJSON-234340527 None] Volume volume-3e1a92b3-0b3a-462c-b421-9f92de2669e2 (3e1a92b3-0b3a-462c-b421-9f92de2669e2): created successfully Sep 28 12:00:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a34284be-2817-4657-a667-f2b5e9db8a1a tempest-VolumesSnapshotTestJSON-234340527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b11dc3e6-2905-409f-b38a-de70e46605d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:00:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a34284be-2817-4657-a667-f2b5e9db8a1a tempest-VolumesSnapshotTestJSON-234340527 None] Flow 'volume_create_manager' (b699adda-d3a9-43bf-aef8-60b660df9d5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:00:14 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-a34284be-2817-4657-a667-f2b5e9db8a1a tempest-VolumesSnapshotTestJSON-234340527 None] Created volume successfully. Sep 28 12:00:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1cd5993f-d13c-46d8-842a-bb0a90a00ae3 tempest-VolumesSnapshotTestJSON-234340527 None] Acquiring lock "cinder-3e1a92b3-0b3a-462c-b421-9f92de2669e2-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:00:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1cd5993f-d13c-46d8-842a-bb0a90a00ae3 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "cinder-3e1a92b3-0b3a-462c-b421-9f92de2669e2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:00:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1cd5993f-d13c-46d8-842a-bb0a90a00ae3 tempest-VolumesSnapshotTestJSON-234340527 None] Acquiring lock "cinder-quobyte-3e1a92b3-0b3a-462c-b421-9f92de2669e2" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:00:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1cd5993f-d13c-46d8-842a-bb0a90a00ae3 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "cinder-quobyte-3e1a92b3-0b3a-462c-b421-9f92de2669e2" acquired by "delete_volume" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:00:15 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[5258d64e-f7e9-4545-b933-609f60ce860e]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:00:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1cd5993f-d13c-46d8-842a-bb0a90a00ae3 tempest-VolumesSnapshotTestJSON-234340527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3e1a92b3-0b3a-462c-b421-9f92de2669e2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:15 devstack sudo[103400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3e1a92b3-0b3a-462c-b421-9f92de2669e2 Sep 28 12:00:15 devstack sudo[103400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:15 devstack sudo[103400]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1cd5993f-d13c-46d8-842a-bb0a90a00ae3 tempest-VolumesSnapshotTestJSON-234340527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3e1a92b3-0b3a-462c-b421-9f92de2669e2" returned: 0 in 0.377s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1cd5993f-d13c-46d8-842a-bb0a90a00ae3 tempest-VolumesSnapshotTestJSON-234340527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3e1a92b3-0b3a-462c-b421-9f92de2669e2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:15 devstack sudo[103411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3e1a92b3-0b3a-462c-b421-9f92de2669e2 Sep 28 12:00:15 devstack sudo[103411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:16 devstack sudo[103411]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1cd5993f-d13c-46d8-842a-bb0a90a00ae3 tempest-VolumesSnapshotTestJSON-234340527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3e1a92b3-0b3a-462c-b421-9f92de2669e2" returned: 0 in 0.263s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1cd5993f-d13c-46d8-842a-bb0a90a00ae3 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "cinder-quobyte-3e1a92b3-0b3a-462c-b421-9f92de2669e2" released by "delete_volume" :: held 0.686s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:00:16 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-1cd5993f-d13c-46d8-842a-bb0a90a00ae3 tempest-VolumesSnapshotTestJSON-234340527 None] Created reservations ['7264a810-bd24-4138-8ed1-f899b4ffc0b7', '050e6c89-4e91-405c-aa9a-bb3ea4d90d2d', '937d77a5-7d97-4ef3-9b45-7d904bde5bc1', '57758235-3ee7-4b24-901a-e0d38e64f378'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:00:16 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=122,cinder:INSERT=42,cinder:UPDATE=146,cinder:DELETE=12 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:00:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1cd5993f-d13c-46d8-842a-bb0a90a00ae3 tempest-VolumesSnapshotTestJSON-234340527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:00:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1cd5993f-d13c-46d8-842a-bb0a90a00ae3 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:00:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1cd5993f-d13c-46d8-842a-bb0a90a00ae3 tempest-VolumesSnapshotTestJSON-234340527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:00:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1cd5993f-d13c-46d8-842a-bb0a90a00ae3 tempest-VolumesSnapshotTestJSON-234340527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:00:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1cd5993f-d13c-46d8-842a-bb0a90a00ae3 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:00:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1cd5993f-d13c-46d8-842a-bb0a90a00ae3 tempest-VolumesSnapshotTestJSON-234340527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:16 devstack sudo[103414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:00:16 devstack sudo[103414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f96b16cc-77ae-4bfc-8a8d-53189b762b79 tempest-VolumesSnapshotTestJSON-234340527 None] Acquiring lock "cinder-241c6fd8-c8ba-4038-a9e3-bab9d03f6053-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:00:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f96b16cc-77ae-4bfc-8a8d-53189b762b79 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "cinder-241c6fd8-c8ba-4038-a9e3-bab9d03f6053-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:00:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f96b16cc-77ae-4bfc-8a8d-53189b762b79 tempest-VolumesSnapshotTestJSON-234340527 None] Acquiring lock "cinder-quobyte-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:00:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f96b16cc-77ae-4bfc-8a8d-53189b762b79 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "cinder-quobyte-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:00:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f96b16cc-77ae-4bfc-8a8d-53189b762b79 tempest-VolumesSnapshotTestJSON-234340527 None] Acquiring lock "cinder-quobyte-241c6fd8-c8ba-4038-a9e3-bab9d03f6053" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:00:16 devstack sudo[103414]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1cd5993f-d13c-46d8-842a-bb0a90a00ae3 tempest-VolumesSnapshotTestJSON-234340527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.323s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:16 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-1cd5993f-d13c-46d8-842a-bb0a90a00ae3 tempest-VolumesSnapshotTestJSON-234340527 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:00:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f96b16cc-77ae-4bfc-8a8d-53189b762b79 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "cinder-quobyte-241c6fd8-c8ba-4038-a9e3-bab9d03f6053" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:00:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-f96b16cc-77ae-4bfc-8a8d-53189b762b79 tempest-VolumesSnapshotTestJSON-234340527 None] Deleting offline snapshot 241c6fd8-c8ba-4038-a9e3-bab9d03f6053 of volume ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:00:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-f96b16cc-77ae-4bfc-8a8d-53189b762b79 tempest-VolumesSnapshotTestJSON-234340527 None] snapshot_file for this snap is: volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b.241c6fd8-c8ba-4038-a9e3-bab9d03f6053 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:00:16 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-1cd5993f-d13c-46d8-842a-bb0a90a00ae3 tempest-VolumesSnapshotTestJSON-234340527 None] Deleted volume successfully. Sep 28 12:00:16 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=134,cinder:UPDATE=137,cinder:INSERT=39,cinder:DELETE=14 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:00:16 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a260614-440d-4c53-9e00-9fb2cc4acf0d]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:00:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f96b16cc-77ae-4bfc-8a8d-53189b762b79 tempest-VolumesSnapshotTestJSON-234340527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b.241c6fd8-c8ba-4038-a9e3-bab9d03f6053 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1cd5993f-d13c-46d8-842a-bb0a90a00ae3 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "cinder-3e1a92b3-0b3a-462c-b421-9f92de2669e2-delete_volume" released by "delete_volume" :: held 1.365s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:00:16 devstack sudo[103417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b.241c6fd8-c8ba-4038-a9e3-bab9d03f6053 Sep 28 12:00:16 devstack sudo[103417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:16 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dd537e9-1110-4c45-a2e0-a80701177a3a tempest-VolumeDependencyTests-2064860842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:00:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9dd537e9-1110-4c45-a2e0-a80701177a3a tempest-VolumeDependencyTests-2064860842 None] Flow 'volume_create_manager' (63c45f74-e770-4cb7-8b2b-3846287ffcea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:00:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9dd537e9-1110-4c45-a2e0-a80701177a3a tempest-VolumeDependencyTests-2064860842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c73f306-eeee-42a2-8703-888cbb8e43d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:00:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9dd537e9-1110-4c45-a2e0-a80701177a3a tempest-VolumeDependencyTests-2064860842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c73f306-eeee-42a2-8703-888cbb8e43d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-22413073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e913fc61-c217-401b-91af-a823a91bd971,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d42433debbd4b8a85ee75cceeb332a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:00:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:00:17Z,use_quota=True,user_id='85438302dd764e1faabfd02746a013df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:00:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9dd537e9-1110-4c45-a2e0-a80701177a3a tempest-VolumeDependencyTests-2064860842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74fe97ab-3258-4232-aa41-9b19836bf8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:00:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9dd537e9-1110-4c45-a2e0-a80701177a3a tempest-VolumeDependencyTests-2064860842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74fe97ab-3258-4232-aa41-9b19836bf8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:00:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9dd537e9-1110-4c45-a2e0-a80701177a3a tempest-VolumeDependencyTests-2064860842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d91402cb-51e4-4fa7-9418-7a01667cab3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:00:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9dd537e9-1110-4c45-a2e0-a80701177a3a tempest-VolumeDependencyTests-2064860842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d91402cb-51e4-4fa7-9418-7a01667cab3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e913fc61-c217-401b-91af-a823a91bd971', 'volume_name': 'volume-e913fc61-c217-401b-91af-a823a91bd971', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:00:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9dd537e9-1110-4c45-a2e0-a80701177a3a tempest-VolumeDependencyTests-2064860842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c430ca53-e2db-40b0-820f-ada91f66679d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:00:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9dd537e9-1110-4c45-a2e0-a80701177a3a tempest-VolumeDependencyTests-2064860842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c430ca53-e2db-40b0-820f-ada91f66679d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:00:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9dd537e9-1110-4c45-a2e0-a80701177a3a tempest-VolumeDependencyTests-2064860842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dd41d94-de82-4942-b3f9-689b739ad5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:00:17 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-9dd537e9-1110-4c45-a2e0-a80701177a3a tempest-VolumeDependencyTests-2064860842 None] Volume e913fc61-c217-401b-91af-a823a91bd971: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e913fc61-c217-401b-91af-a823a91bd971', 'volume_size': 1} Sep 28 12:00:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9dd537e9-1110-4c45-a2e0-a80701177a3a tempest-VolumeDependencyTests-2064860842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:00:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9dd537e9-1110-4c45-a2e0-a80701177a3a tempest-VolumeDependencyTests-2064860842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:00:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9dd537e9-1110-4c45-a2e0-a80701177a3a tempest-VolumeDependencyTests-2064860842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-22413073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e913fc61-c217-401b-91af-a823a91bd971,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d42433debbd4b8a85ee75cceeb332a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:00:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:00:17Z,use_quota=True,user_id='85438302dd764e1faabfd02746a013df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:00:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-9dd537e9-1110-4c45-a2e0-a80701177a3a tempest-VolumeDependencyTests-2064860842 None] Creating volume e913fc61-c217-401b-91af-a823a91bd971 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:00:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9dd537e9-1110-4c45-a2e0-a80701177a3a tempest-VolumeDependencyTests-2064860842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:00:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9dd537e9-1110-4c45-a2e0-a80701177a3a tempest-VolumeDependencyTests-2064860842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:00:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9dd537e9-1110-4c45-a2e0-a80701177a3a tempest-VolumeDependencyTests-2064860842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:00:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9dd537e9-1110-4c45-a2e0-a80701177a3a tempest-VolumeDependencyTests-2064860842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:00:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9dd537e9-1110-4c45-a2e0-a80701177a3a tempest-VolumeDependencyTests-2064860842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:00:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9dd537e9-1110-4c45-a2e0-a80701177a3a tempest-VolumeDependencyTests-2064860842 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:00:17 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-9dd537e9-1110-4c45-a2e0-a80701177a3a tempest-VolumeDependencyTests-2064860842 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:00:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9dd537e9-1110-4c45-a2e0-a80701177a3a tempest-VolumeDependencyTests-2064860842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e913fc61-c217-401b-91af-a823a91bd971 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:17 devstack sudo[103419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e913fc61-c217-401b-91af-a823a91bd971 1073741824 Sep 28 12:00:17 devstack sudo[103419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:17 devstack sudo[103417]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f96b16cc-77ae-4bfc-8a8d-53189b762b79 tempest-VolumesSnapshotTestJSON-234340527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b.241c6fd8-c8ba-4038-a9e3-bab9d03f6053" returned: 0 in 0.414s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-f96b16cc-77ae-4bfc-8a8d-53189b762b79 tempest-VolumesSnapshotTestJSON-234340527 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:00:17 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b9d2a7-70ef-4049-b068-22b9ce793b1c]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:00:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f96b16cc-77ae-4bfc-8a8d-53189b762b79 tempest-VolumesSnapshotTestJSON-234340527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:17 devstack sudo[103426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b Sep 28 12:00:17 devstack sudo[103426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:17 devstack sudo[103419]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9dd537e9-1110-4c45-a2e0-a80701177a3a tempest-VolumeDependencyTests-2064860842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e913fc61-c217-401b-91af-a823a91bd971 1073741824" returned: 0 in 0.475s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9dd537e9-1110-4c45-a2e0-a80701177a3a tempest-VolumeDependencyTests-2064860842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e913fc61-c217-401b-91af-a823a91bd971 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:17 devstack sudo[103430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e913fc61-c217-401b-91af-a823a91bd971 Sep 28 12:00:17 devstack sudo[103430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:17 devstack sudo[103430]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9dd537e9-1110-4c45-a2e0-a80701177a3a tempest-VolumeDependencyTests-2064860842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e913fc61-c217-401b-91af-a823a91bd971" returned: 0 in 0.264s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9dd537e9-1110-4c45-a2e0-a80701177a3a tempest-VolumeDependencyTests-2064860842 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:00:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9dd537e9-1110-4c45-a2e0-a80701177a3a tempest-VolumeDependencyTests-2064860842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:00:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9dd537e9-1110-4c45-a2e0-a80701177a3a tempest-VolumeDependencyTests-2064860842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dd41d94-de82-4942-b3f9-689b739ad5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e913fc61-c217-401b-91af-a823a91bd971', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:00:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9dd537e9-1110-4c45-a2e0-a80701177a3a tempest-VolumeDependencyTests-2064860842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8a630d8-0f35-4a1e-aa75-9adacbd61e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:00:17 devstack sudo[103426]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f96b16cc-77ae-4bfc-8a8d-53189b762b79 tempest-VolumesSnapshotTestJSON-234340527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b" returned: 0 in 0.578s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f96b16cc-77ae-4bfc-8a8d-53189b762b79 tempest-VolumesSnapshotTestJSON-234340527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b.241c6fd8-c8ba-4038-a9e3-bab9d03f6053 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:17 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-9dd537e9-1110-4c45-a2e0-a80701177a3a tempest-VolumeDependencyTests-2064860842 None] Volume volume-e913fc61-c217-401b-91af-a823a91bd971 (e913fc61-c217-401b-91af-a823a91bd971): created successfully Sep 28 12:00:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9dd537e9-1110-4c45-a2e0-a80701177a3a tempest-VolumeDependencyTests-2064860842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8a630d8-0f35-4a1e-aa75-9adacbd61e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:00:17 devstack sudo[103436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b.241c6fd8-c8ba-4038-a9e3-bab9d03f6053 Sep 28 12:00:17 devstack sudo[103436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9dd537e9-1110-4c45-a2e0-a80701177a3a tempest-VolumeDependencyTests-2064860842 None] Flow 'volume_create_manager' (63c45f74-e770-4cb7-8b2b-3846287ffcea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:00:17 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-9dd537e9-1110-4c45-a2e0-a80701177a3a tempest-VolumeDependencyTests-2064860842 None] Created volume successfully. Sep 28 12:00:18 devstack sudo[103436]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f96b16cc-77ae-4bfc-8a8d-53189b762b79 tempest-VolumesSnapshotTestJSON-234340527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b.241c6fd8-c8ba-4038-a9e3-bab9d03f6053" returned: 0 in 0.340s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f96b16cc-77ae-4bfc-8a8d-53189b762b79 tempest-VolumesSnapshotTestJSON-234340527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b.241c6fd8-c8ba-4038-a9e3-bab9d03f6053 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:18 devstack sudo[103441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b.241c6fd8-c8ba-4038-a9e3-bab9d03f6053 Sep 28 12:00:18 devstack sudo[103441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:18 devstack sudo[103441]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f96b16cc-77ae-4bfc-8a8d-53189b762b79 tempest-VolumesSnapshotTestJSON-234340527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b.241c6fd8-c8ba-4038-a9e3-bab9d03f6053" returned: 0 in 0.240s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f96b16cc-77ae-4bfc-8a8d-53189b762b79 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "cinder-quobyte-241c6fd8-c8ba-4038-a9e3-bab9d03f6053" released by "_delete_snapshot" :: held 1.683s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:00:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f96b16cc-77ae-4bfc-8a8d-53189b762b79 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "cinder-quobyte-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b" released by "delete_snapshot" :: held 1.711s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:00:18 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-f96b16cc-77ae-4bfc-8a8d-53189b762b79 tempest-VolumesSnapshotTestJSON-234340527 None] Created reservations ['e14959ec-9175-4f48-b07c-07cd0e838774', '79c47556-f8bc-490d-8f45-7e3a1397c86a', 'dd90279c-6c85-4334-a8d7-b1e783b9b6d6', '8370aa8d-f782-4d99-ac88-6bba95bb68c4'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:00:18 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-f96b16cc-77ae-4bfc-8a8d-53189b762b79 tempest-VolumesSnapshotTestJSON-234340527 None] Delete snapshot completed successfully. Sep 28 12:00:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f96b16cc-77ae-4bfc-8a8d-53189b762b79 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "cinder-241c6fd8-c8ba-4038-a9e3-bab9d03f6053-delete_snapshot" released by "delete_snapshot" :: held 1.858s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:00:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-90890172-f984-4570-be71-38735dbe89b4 tempest-VolumesSnapshotTestJSON-234340527 None] Acquiring lock "cinder-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:00:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-90890172-f984-4570-be71-38735dbe89b4 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "cinder-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:00:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-90890172-f984-4570-be71-38735dbe89b4 tempest-VolumesSnapshotTestJSON-234340527 None] Acquiring lock "cinder-quobyte-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:00:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-90890172-f984-4570-be71-38735dbe89b4 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "cinder-quobyte-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b" acquired by "delete_volume" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:00:19 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[1193f6bc-ae3c-4b87-883f-611682331f4e]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:00:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-90890172-f984-4570-be71-38735dbe89b4 tempest-VolumesSnapshotTestJSON-234340527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:19 devstack sudo[103444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b Sep 28 12:00:19 devstack sudo[103444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2ad7407e-51b5-40a0-98a0-bde920a5c738 tempest-VolumeDependencyTests-2064860842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:00:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2ad7407e-51b5-40a0-98a0-bde920a5c738 tempest-VolumeDependencyTests-2064860842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:00:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-2ad7407e-51b5-40a0-98a0-bde920a5c738 tempest-VolumeDependencyTests-2064860842 None] Creating offline snapshot 65e1870d-2fca-4d3c-82fe-746e2f773260 of volume e913fc61-c217-401b-91af-a823a91bd971 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:00:19 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[770704d4-b80b-4c71-a0c8-ed55806e49c9]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:00:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2ad7407e-51b5-40a0-98a0-bde920a5c738 tempest-VolumeDependencyTests-2064860842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e913fc61-c217-401b-91af-a823a91bd971 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:19 devstack sudo[103446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e913fc61-c217-401b-91af-a823a91bd971 Sep 28 12:00:19 devstack sudo[103446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:19 devstack sudo[103444]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-90890172-f984-4570-be71-38735dbe89b4 tempest-VolumesSnapshotTestJSON-234340527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b" returned: 0 in 0.389s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-90890172-f984-4570-be71-38735dbe89b4 tempest-VolumesSnapshotTestJSON-234340527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:19 devstack sudo[103451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b Sep 28 12:00:19 devstack sudo[103451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:19 devstack sudo[103446]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2ad7407e-51b5-40a0-98a0-bde920a5c738 tempest-VolumeDependencyTests-2064860842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e913fc61-c217-401b-91af-a823a91bd971" returned: 0 in 0.371s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2ad7407e-51b5-40a0-98a0-bde920a5c738 tempest-VolumeDependencyTests-2064860842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e913fc61-c217-401b-91af-a823a91bd971,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e913fc61-c217-401b-91af-a823a91bd971.65e1870d-2fca-4d3c-82fe-746e2f773260 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:19 devstack sudo[103457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e913fc61-c217-401b-91af-a823a91bd971,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e913fc61-c217-401b-91af-a823a91bd971.65e1870d-2fca-4d3c-82fe-746e2f773260 1G Sep 28 12:00:19 devstack sudo[103457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:19 devstack sudo[103451]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-90890172-f984-4570-be71-38735dbe89b4 tempest-VolumesSnapshotTestJSON-234340527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b" returned: 0 in 0.260s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-90890172-f984-4570-be71-38735dbe89b4 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "cinder-quobyte-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b" released by "delete_volume" :: held 0.729s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:00:19 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-90890172-f984-4570-be71-38735dbe89b4 tempest-VolumesSnapshotTestJSON-234340527 None] Created reservations ['2f8c1531-ec8f-4c32-8111-f516a847bb12', 'f3cc59fb-ad9d-4f1a-8ebd-26b184d55421', '4782ed58-ab7b-4bf5-a47b-c2d022cf79af', 'ab7c1eb6-1d58-4b18-9f7d-513842d84aa5'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:00:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-90890172-f984-4570-be71-38735dbe89b4 tempest-VolumesSnapshotTestJSON-234340527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:00:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-90890172-f984-4570-be71-38735dbe89b4 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:00:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-90890172-f984-4570-be71-38735dbe89b4 tempest-VolumesSnapshotTestJSON-234340527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:00:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-90890172-f984-4570-be71-38735dbe89b4 tempest-VolumesSnapshotTestJSON-234340527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:00:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-90890172-f984-4570-be71-38735dbe89b4 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:00:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-90890172-f984-4570-be71-38735dbe89b4 tempest-VolumesSnapshotTestJSON-234340527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:19 devstack sudo[103459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:00:19 devstack sudo[103459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:20 devstack sudo[103459]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:20 devstack sudo[103457]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-90890172-f984-4570-be71-38735dbe89b4 tempest-VolumesSnapshotTestJSON-234340527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.304s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:20 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-90890172-f984-4570-be71-38735dbe89b4 tempest-VolumesSnapshotTestJSON-234340527 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:00:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2ad7407e-51b5-40a0-98a0-bde920a5c738 tempest-VolumeDependencyTests-2064860842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e913fc61-c217-401b-91af-a823a91bd971,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e913fc61-c217-401b-91af-a823a91bd971.65e1870d-2fca-4d3c-82fe-746e2f773260 1G" returned: 0 in 0.526s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2ad7407e-51b5-40a0-98a0-bde920a5c738 tempest-VolumeDependencyTests-2064860842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e913fc61-c217-401b-91af-a823a91bd971 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e913fc61-c217-401b-91af-a823a91bd971.65e1870d-2fca-4d3c-82fe-746e2f773260 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:20 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-90890172-f984-4570-be71-38735dbe89b4 tempest-VolumesSnapshotTestJSON-234340527 None] Deleted volume successfully. Sep 28 12:00:20 devstack sudo[103467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e913fc61-c217-401b-91af-a823a91bd971 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e913fc61-c217-401b-91af-a823a91bd971.65e1870d-2fca-4d3c-82fe-746e2f773260 Sep 28 12:00:20 devstack sudo[103467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-90890172-f984-4570-be71-38735dbe89b4 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "cinder-ae0bdaf7-2bbc-478e-995e-8cb5e872ea4b-delete_volume" released by "delete_volume" :: held 1.420s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:00:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-08307e6f-9e8a-43d8-98f6-a83b7d36dd68 tempest-VolumesSnapshotTestJSON-234340527 None] Acquiring lock "cinder-8102cf13-9a5b-47cf-aa0f-7d4404f39485-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:00:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-08307e6f-9e8a-43d8-98f6-a83b7d36dd68 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "cinder-8102cf13-9a5b-47cf-aa0f-7d4404f39485-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:00:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-08307e6f-9e8a-43d8-98f6-a83b7d36dd68 tempest-VolumesSnapshotTestJSON-234340527 None] Acquiring lock "cinder-quobyte-8102cf13-9a5b-47cf-aa0f-7d4404f39485" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:00:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-08307e6f-9e8a-43d8-98f6-a83b7d36dd68 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "cinder-quobyte-8102cf13-9a5b-47cf-aa0f-7d4404f39485" acquired by "delete_volume" :: waited 0.021s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:00:20 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce9e251-d1ab-45cd-a030-1ccce9d8fb95]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:00:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-08307e6f-9e8a-43d8-98f6-a83b7d36dd68 tempest-VolumesSnapshotTestJSON-234340527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8102cf13-9a5b-47cf-aa0f-7d4404f39485 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:20 devstack sudo[103467]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2ad7407e-51b5-40a0-98a0-bde920a5c738 tempest-VolumeDependencyTests-2064860842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e913fc61-c217-401b-91af-a823a91bd971 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e913fc61-c217-401b-91af-a823a91bd971.65e1870d-2fca-4d3c-82fe-746e2f773260" returned: 0 in 0.390s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:20 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-2ad7407e-51b5-40a0-98a0-bde920a5c738 tempest-VolumeDependencyTests-2064860842 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e913fc61-c217-401b-91af-a823a91bd971.65e1870d-2fca-4d3c-82fe-746e2f773260 is being set with open permissions: ugo+rw Sep 28 12:00:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2ad7407e-51b5-40a0-98a0-bde920a5c738 tempest-VolumeDependencyTests-2064860842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e913fc61-c217-401b-91af-a823a91bd971.65e1870d-2fca-4d3c-82fe-746e2f773260 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:20 devstack sudo[103473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e913fc61-c217-401b-91af-a823a91bd971.65e1870d-2fca-4d3c-82fe-746e2f773260 Sep 28 12:00:20 devstack sudo[103473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:20 devstack sudo[103472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8102cf13-9a5b-47cf-aa0f-7d4404f39485 Sep 28 12:00:20 devstack sudo[103472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:20 devstack sudo[103473]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2ad7407e-51b5-40a0-98a0-bde920a5c738 tempest-VolumeDependencyTests-2064860842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e913fc61-c217-401b-91af-a823a91bd971.65e1870d-2fca-4d3c-82fe-746e2f773260" returned: 0 in 0.257s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2ad7407e-51b5-40a0-98a0-bde920a5c738 tempest-VolumeDependencyTests-2064860842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e913fc61-c217-401b-91af-a823a91bd971.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:20 devstack sudo[103478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e913fc61-c217-401b-91af-a823a91bd971.info Sep 28 12:00:20 devstack sudo[103478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:20 devstack sudo[103472]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-08307e6f-9e8a-43d8-98f6-a83b7d36dd68 tempest-VolumesSnapshotTestJSON-234340527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8102cf13-9a5b-47cf-aa0f-7d4404f39485" returned: 0 in 0.406s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-08307e6f-9e8a-43d8-98f6-a83b7d36dd68 tempest-VolumesSnapshotTestJSON-234340527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8102cf13-9a5b-47cf-aa0f-7d4404f39485 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:20 devstack sudo[103482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8102cf13-9a5b-47cf-aa0f-7d4404f39485 Sep 28 12:00:21 devstack sudo[103482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:21 devstack sudo[103478]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2ad7407e-51b5-40a0-98a0-bde920a5c738 tempest-VolumeDependencyTests-2064860842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e913fc61-c217-401b-91af-a823a91bd971.info" returned: 0 in 0.263s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:21 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-2ad7407e-51b5-40a0-98a0-bde920a5c738 tempest-VolumeDependencyTests-2064860842 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e913fc61-c217-401b-91af-a823a91bd971.info is being set with open permissions: ugo+rw Sep 28 12:00:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2ad7407e-51b5-40a0-98a0-bde920a5c738 tempest-VolumeDependencyTests-2064860842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e913fc61-c217-401b-91af-a823a91bd971.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:21 devstack sudo[103485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e913fc61-c217-401b-91af-a823a91bd971.info Sep 28 12:00:21 devstack sudo[103485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:21 devstack sudo[103482]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-08307e6f-9e8a-43d8-98f6-a83b7d36dd68 tempest-VolumesSnapshotTestJSON-234340527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8102cf13-9a5b-47cf-aa0f-7d4404f39485" returned: 0 in 0.252s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-08307e6f-9e8a-43d8-98f6-a83b7d36dd68 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "cinder-quobyte-8102cf13-9a5b-47cf-aa0f-7d4404f39485" released by "delete_volume" :: held 0.749s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:00:21 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-08307e6f-9e8a-43d8-98f6-a83b7d36dd68 tempest-VolumesSnapshotTestJSON-234340527 None] Created reservations ['580acce5-862e-4ee8-8e36-9a30f73b97e8', '51c0c9c3-fa51-41cb-937e-2c57aca58688', '68553616-c1f7-421c-a293-33ec4af5c592', '4afcd632-6ebe-41a9-96dd-fda1d8760566'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:00:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-08307e6f-9e8a-43d8-98f6-a83b7d36dd68 tempest-VolumesSnapshotTestJSON-234340527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:00:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-08307e6f-9e8a-43d8-98f6-a83b7d36dd68 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:00:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-08307e6f-9e8a-43d8-98f6-a83b7d36dd68 tempest-VolumesSnapshotTestJSON-234340527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:00:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-08307e6f-9e8a-43d8-98f6-a83b7d36dd68 tempest-VolumesSnapshotTestJSON-234340527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:00:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-08307e6f-9e8a-43d8-98f6-a83b7d36dd68 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:00:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-08307e6f-9e8a-43d8-98f6-a83b7d36dd68 tempest-VolumesSnapshotTestJSON-234340527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:21 devstack sudo[103485]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2ad7407e-51b5-40a0-98a0-bde920a5c738 tempest-VolumeDependencyTests-2064860842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e913fc61-c217-401b-91af-a823a91bd971.info" returned: 0 in 0.267s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:21 devstack sudo[103489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:00:21 devstack sudo[103489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2ad7407e-51b5-40a0-98a0-bde920a5c738 tempest-VolumeDependencyTests-2064860842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.175s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:00:21 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-2ad7407e-51b5-40a0-98a0-bde920a5c738 tempest-VolumeDependencyTests-2064860842 None] Create snapshot completed successfully Sep 28 12:00:21 devstack sudo[103489]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-08307e6f-9e8a-43d8-98f6-a83b7d36dd68 tempest-VolumesSnapshotTestJSON-234340527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.266s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:21 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-08307e6f-9e8a-43d8-98f6-a83b7d36dd68 tempest-VolumesSnapshotTestJSON-234340527 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:00:21 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-08307e6f-9e8a-43d8-98f6-a83b7d36dd68 tempest-VolumesSnapshotTestJSON-234340527 None] Deleted volume successfully. Sep 28 12:00:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-08307e6f-9e8a-43d8-98f6-a83b7d36dd68 tempest-VolumesSnapshotTestJSON-234340527 None] Lock "cinder-8102cf13-9a5b-47cf-aa0f-7d4404f39485-delete_volume" released by "delete_volume" :: held 1.254s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:00:23 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecac0fd2-2039-44ca-ae47-3a2f93e3021e tempest-VolumeDependencyTests-2064860842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:00:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ecac0fd2-2039-44ca-ae47-3a2f93e3021e tempest-VolumeDependencyTests-2064860842 None] Flow 'volume_create_manager' (0c9e1594-dbf2-43ac-b324-941a7298cef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:00:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ecac0fd2-2039-44ca-ae47-3a2f93e3021e tempest-VolumeDependencyTests-2064860842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddc649c6-40be-4795-8e2a-011d5bfbeda7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:00:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ecac0fd2-2039-44ca-ae47-3a2f93e3021e tempest-VolumeDependencyTests-2064860842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddc649c6-40be-4795-8e2a-011d5bfbeda7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:00:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-85061475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20660b3a-0b6d-4c94-958a-abf2031a052c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d42433debbd4b8a85ee75cceeb332a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:00:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=65e1870d-2fca-4d3c-82fe-746e2f773260,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:00:23Z,use_quota=True,user_id='85438302dd764e1faabfd02746a013df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:00:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ecac0fd2-2039-44ca-ae47-3a2f93e3021e tempest-VolumeDependencyTests-2064860842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb2ba7e0-99e8-4f47-a244-b0b8db7c19b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:00:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ecac0fd2-2039-44ca-ae47-3a2f93e3021e tempest-VolumeDependencyTests-2064860842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb2ba7e0-99e8-4f47-a244-b0b8db7c19b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:00:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ecac0fd2-2039-44ca-ae47-3a2f93e3021e tempest-VolumeDependencyTests-2064860842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45d9a843-e821-41db-b635-b0d440daad1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:00:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ecac0fd2-2039-44ca-ae47-3a2f93e3021e tempest-VolumeDependencyTests-2064860842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45d9a843-e821-41db-b635-b0d440daad1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '20660b3a-0b6d-4c94-958a-abf2031a052c', 'volume_name': 'volume-20660b3a-0b6d-4c94-958a-abf2031a052c', 'volume_size': 1, 'snapshot_id': '65e1870d-2fca-4d3c-82fe-746e2f773260'}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:00:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ecac0fd2-2039-44ca-ae47-3a2f93e3021e tempest-VolumeDependencyTests-2064860842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51cafdd8-6b80-4f16-81c8-0d583a261b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:00:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ecac0fd2-2039-44ca-ae47-3a2f93e3021e tempest-VolumeDependencyTests-2064860842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51cafdd8-6b80-4f16-81c8-0d583a261b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:00:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ecac0fd2-2039-44ca-ae47-3a2f93e3021e tempest-VolumeDependencyTests-2064860842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73b645e5-6f9d-497f-8bfa-50ac25b8f262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:00:23 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-ecac0fd2-2039-44ca-ae47-3a2f93e3021e tempest-VolumeDependencyTests-2064860842 None] Volume 20660b3a-0b6d-4c94-958a-abf2031a052c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-20660b3a-0b6d-4c94-958a-abf2031a052c', 'volume_size': 1, 'snapshot_id': '65e1870d-2fca-4d3c-82fe-746e2f773260'} Sep 28 12:00:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ecac0fd2-2039-44ca-ae47-3a2f93e3021e tempest-VolumeDependencyTests-2064860842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:00:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ecac0fd2-2039-44ca-ae47-3a2f93e3021e tempest-VolumeDependencyTests-2064860842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:00:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ecac0fd2-2039-44ca-ae47-3a2f93e3021e tempest-VolumeDependencyTests-2064860842 None] Acquiring lock "cinder-quobyte-65e1870d-2fca-4d3c-82fe-746e2f773260-20660b3a-0b6d-4c94-958a-abf2031a052c" by "_create_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:00:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ecac0fd2-2039-44ca-ae47-3a2f93e3021e tempest-VolumeDependencyTests-2064860842 None] Lock "cinder-quobyte-65e1870d-2fca-4d3c-82fe-746e2f773260-20660b3a-0b6d-4c94-958a-abf2031a052c" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:00:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ecac0fd2-2039-44ca-ae47-3a2f93e3021e tempest-VolumeDependencyTests-2064860842 None] Creating volume 20660b3a-0b6d-4c94-958a-abf2031a052c from snapshot 65e1870d-2fca-4d3c-82fe-746e2f773260 {{(pid=86916) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 12:00:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ecac0fd2-2039-44ca-ae47-3a2f93e3021e tempest-VolumeDependencyTests-2064860842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:00:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ecac0fd2-2039-44ca-ae47-3a2f93e3021e tempest-VolumeDependencyTests-2064860842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:00:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ecac0fd2-2039-44ca-ae47-3a2f93e3021e tempest-VolumeDependencyTests-2064860842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:00:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ecac0fd2-2039-44ca-ae47-3a2f93e3021e tempest-VolumeDependencyTests-2064860842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:00:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ecac0fd2-2039-44ca-ae47-3a2f93e3021e tempest-VolumeDependencyTests-2064860842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:00:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ecac0fd2-2039-44ca-ae47-3a2f93e3021e tempest-VolumeDependencyTests-2064860842 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:00:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ecac0fd2-2039-44ca-ae47-3a2f93e3021e tempest-VolumeDependencyTests-2064860842 None] Acquiring lock "cinder-quobyte-20660b3a-0b6d-4c94-958a-abf2031a052c" by "_copy_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:00:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ecac0fd2-2039-44ca-ae47-3a2f93e3021e tempest-VolumeDependencyTests-2064860842 None] Lock "cinder-quobyte-20660b3a-0b6d-4c94-958a-abf2031a052c" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:00:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ecac0fd2-2039-44ca-ae47-3a2f93e3021e tempest-VolumeDependencyTests-2064860842 None] snapshot: 65e1870d-2fca-4d3c-82fe-746e2f773260, volume: 20660b3a-0b6d-4c94-958a-abf2031a052c, {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 12:00:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ecac0fd2-2039-44ca-ae47-3a2f93e3021e tempest-VolumeDependencyTests-2064860842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:00:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ecac0fd2-2039-44ca-ae47-3a2f93e3021e tempest-VolumeDependencyTests-2064860842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:00:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ecac0fd2-2039-44ca-ae47-3a2f93e3021e tempest-VolumeDependencyTests-2064860842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:00:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ecac0fd2-2039-44ca-ae47-3a2f93e3021e tempest-VolumeDependencyTests-2064860842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:00:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ecac0fd2-2039-44ca-ae47-3a2f93e3021e tempest-VolumeDependencyTests-2064860842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:00:23 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb945b2-896d-4b3b-ae1d-eb4f71b5169b]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:00:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ecac0fd2-2039-44ca-ae47-3a2f93e3021e tempest-VolumeDependencyTests-2064860842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e913fc61-c217-401b-91af-a823a91bd971.65e1870d-2fca-4d3c-82fe-746e2f773260 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:23 devstack sudo[103493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e913fc61-c217-401b-91af-a823a91bd971.65e1870d-2fca-4d3c-82fe-746e2f773260 Sep 28 12:00:23 devstack sudo[103493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:23 devstack sudo[103493]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ecac0fd2-2039-44ca-ae47-3a2f93e3021e tempest-VolumeDependencyTests-2064860842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e913fc61-c217-401b-91af-a823a91bd971.65e1870d-2fca-4d3c-82fe-746e2f773260" returned: 0 in 0.398s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-ecac0fd2-2039-44ca-ae47-3a2f93e3021e tempest-VolumeDependencyTests-2064860842 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e913fc61-c217-401b-91af-a823a91bd971(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:00:23 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[a138676d-11cc-4bbd-886c-20c5d6e64907]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:00:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ecac0fd2-2039-44ca-ae47-3a2f93e3021e tempest-VolumeDependencyTests-2064860842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e913fc61-c217-401b-91af-a823a91bd971 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:23 devstack sudo[103506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e913fc61-c217-401b-91af-a823a91bd971 Sep 28 12:00:23 devstack sudo[103506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:24 devstack sudo[103506]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ecac0fd2-2039-44ca-ae47-3a2f93e3021e tempest-VolumeDependencyTests-2064860842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e913fc61-c217-401b-91af-a823a91bd971" returned: 0 in 0.396s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ecac0fd2-2039-44ca-ae47-3a2f93e3021e tempest-VolumeDependencyTests-2064860842 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e913fc61-c217-401b-91af-a823a91bd971 {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 12:00:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ecac0fd2-2039-44ca-ae47-3a2f93e3021e tempest-VolumeDependencyTests-2064860842 None] Creating direct copy from snapshot {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 12:00:24 devstack cinder-volume[86916]: DEBUG cinder.utils [None req-ecac0fd2-2039-44ca-ae47-3a2f93e3021e tempest-VolumeDependencyTests-2064860842 None] Path /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-20660b3a-0b6d-4c94-958a-abf2031a052c not found in is_blk_device check {{(pid=86916) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 12:00:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ecac0fd2-2039-44ca-ae47-3a2f93e3021e tempest-VolumeDependencyTests-2064860842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e913fc61-c217-401b-91af-a823a91bd971 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-20660b3a-0b6d-4c94-958a-abf2031a052c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:24 devstack sudo[103511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e913fc61-c217-401b-91af-a823a91bd971 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-20660b3a-0b6d-4c94-958a-abf2031a052c Sep 28 12:00:24 devstack sudo[103511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:31 devstack sudo[103511]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ecac0fd2-2039-44ca-ae47-3a2f93e3021e tempest-VolumeDependencyTests-2064860842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e913fc61-c217-401b-91af-a823a91bd971 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-20660b3a-0b6d-4c94-958a-abf2031a052c" returned: 0 in 7.333s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:31 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-ecac0fd2-2039-44ca-ae47-3a2f93e3021e tempest-VolumeDependencyTests-2064860842 None] Image conversion details: src /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e913fc61-c217-401b-91af-a823a91bd971, size 1024.00 MB, duration 7.33 sec, destination /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-20660b3a-0b6d-4c94-958a-abf2031a052c {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:00:31 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-ecac0fd2-2039-44ca-ae47-3a2f93e3021e tempest-VolumeDependencyTests-2064860842 None] Converted 1024.00 MB image at 139.63 MB/s Sep 28 12:00:31 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-ecac0fd2-2039-44ca-ae47-3a2f93e3021e tempest-VolumeDependencyTests-2064860842 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-20660b3a-0b6d-4c94-958a-abf2031a052c is being set with open permissions: ugo+rw Sep 28 12:00:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ecac0fd2-2039-44ca-ae47-3a2f93e3021e tempest-VolumeDependencyTests-2064860842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-20660b3a-0b6d-4c94-958a-abf2031a052c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:31 devstack sudo[103541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-20660b3a-0b6d-4c94-958a-abf2031a052c Sep 28 12:00:31 devstack sudo[103541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:31 devstack sudo[103541]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ecac0fd2-2039-44ca-ae47-3a2f93e3021e tempest-VolumeDependencyTests-2064860842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-20660b3a-0b6d-4c94-958a-abf2031a052c" returned: 0 in 0.441s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ecac0fd2-2039-44ca-ae47-3a2f93e3021e tempest-VolumeDependencyTests-2064860842 None] Lock "cinder-quobyte-20660b3a-0b6d-4c94-958a-abf2031a052c" released by "_copy_volume_from_snapshot" :: held 8.682s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:00:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ecac0fd2-2039-44ca-ae47-3a2f93e3021e tempest-VolumeDependencyTests-2064860842 None] Lock "cinder-quobyte-65e1870d-2fca-4d3c-82fe-746e2f773260-20660b3a-0b6d-4c94-958a-abf2031a052c" released by "_create_volume_from_snapshot" :: held 8.788s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:00:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ecac0fd2-2039-44ca-ae47-3a2f93e3021e tempest-VolumeDependencyTests-2064860842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.803s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:00:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ecac0fd2-2039-44ca-ae47-3a2f93e3021e tempest-VolumeDependencyTests-2064860842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73b645e5-6f9d-497f-8bfa-50ac25b8f262) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20660b3a-0b6d-4c94-958a-abf2031a052c', 'volume_size': 1, 'snapshot_id': '65e1870d-2fca-4d3c-82fe-746e2f773260'}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:00:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ecac0fd2-2039-44ca-ae47-3a2f93e3021e tempest-VolumeDependencyTests-2064860842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e85757fc-0ff1-446e-b251-08cdc8f90524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:00:32 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-ecac0fd2-2039-44ca-ae47-3a2f93e3021e tempest-VolumeDependencyTests-2064860842 None] Volume volume-20660b3a-0b6d-4c94-958a-abf2031a052c (20660b3a-0b6d-4c94-958a-abf2031a052c): created successfully Sep 28 12:00:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ecac0fd2-2039-44ca-ae47-3a2f93e3021e tempest-VolumeDependencyTests-2064860842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e85757fc-0ff1-446e-b251-08cdc8f90524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:00:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ecac0fd2-2039-44ca-ae47-3a2f93e3021e tempest-VolumeDependencyTests-2064860842 None] Flow 'volume_create_manager' (0c9e1594-dbf2-43ac-b324-941a7298cef4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:00:32 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-ecac0fd2-2039-44ca-ae47-3a2f93e3021e tempest-VolumeDependencyTests-2064860842 None] Created volume successfully. Sep 28 12:00:32 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-83171d9b-9043-471d-a901-1d5094ccbb49 req-a464aceb-71f4-4ddc-98d6-b6cfa01c42fd tempest-TestShelveInstance-1719544345 None] Terminate volume connection completed successfully. Sep 28 12:00:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-83171d9b-9043-471d-a901-1d5094ccbb49 req-a464aceb-71f4-4ddc-98d6-b6cfa01c42fd tempest-TestShelveInstance-1719544345 None] Deleting attachment 6c7b9418-12b9-4b40-8217-e3eff02adc2a. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 12:00:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-392b9ef4-ec2d-4e80-81fe-c2059eb35cb5 tempest-VolumeDependencyTests-2064860842 None] Acquiring lock "cinder-65e1870d-2fca-4d3c-82fe-746e2f773260-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:00:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-392b9ef4-ec2d-4e80-81fe-c2059eb35cb5 tempest-VolumeDependencyTests-2064860842 None] Lock "cinder-65e1870d-2fca-4d3c-82fe-746e2f773260-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:00:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-392b9ef4-ec2d-4e80-81fe-c2059eb35cb5 tempest-VolumeDependencyTests-2064860842 None] Acquiring lock "cinder-quobyte-e913fc61-c217-401b-91af-a823a91bd971" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:00:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-392b9ef4-ec2d-4e80-81fe-c2059eb35cb5 tempest-VolumeDependencyTests-2064860842 None] Lock "cinder-quobyte-e913fc61-c217-401b-91af-a823a91bd971" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:00:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-392b9ef4-ec2d-4e80-81fe-c2059eb35cb5 tempest-VolumeDependencyTests-2064860842 None] Acquiring lock "cinder-quobyte-65e1870d-2fca-4d3c-82fe-746e2f773260" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:00:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-392b9ef4-ec2d-4e80-81fe-c2059eb35cb5 tempest-VolumeDependencyTests-2064860842 None] Lock "cinder-quobyte-65e1870d-2fca-4d3c-82fe-746e2f773260" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:00:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-392b9ef4-ec2d-4e80-81fe-c2059eb35cb5 tempest-VolumeDependencyTests-2064860842 None] Deleting offline snapshot 65e1870d-2fca-4d3c-82fe-746e2f773260 of volume e913fc61-c217-401b-91af-a823a91bd971 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:00:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-392b9ef4-ec2d-4e80-81fe-c2059eb35cb5 tempest-VolumeDependencyTests-2064860842 None] snapshot_file for this snap is: volume-e913fc61-c217-401b-91af-a823a91bd971.65e1870d-2fca-4d3c-82fe-746e2f773260 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:00:33 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e8614c-e646-49b1-906d-f96b28815df5]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:00:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-392b9ef4-ec2d-4e80-81fe-c2059eb35cb5 tempest-VolumeDependencyTests-2064860842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e913fc61-c217-401b-91af-a823a91bd971.65e1870d-2fca-4d3c-82fe-746e2f773260 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:33 devstack sudo[103563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e913fc61-c217-401b-91af-a823a91bd971.65e1870d-2fca-4d3c-82fe-746e2f773260 Sep 28 12:00:33 devstack sudo[103563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:33 devstack sudo[103563]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-392b9ef4-ec2d-4e80-81fe-c2059eb35cb5 tempest-VolumeDependencyTests-2064860842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e913fc61-c217-401b-91af-a823a91bd971.65e1870d-2fca-4d3c-82fe-746e2f773260" returned: 0 in 0.428s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-392b9ef4-ec2d-4e80-81fe-c2059eb35cb5 tempest-VolumeDependencyTests-2064860842 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e913fc61-c217-401b-91af-a823a91bd971(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:00:33 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5cddb85-15a2-4194-b32c-34c45f038468]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:00:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-392b9ef4-ec2d-4e80-81fe-c2059eb35cb5 tempest-VolumeDependencyTests-2064860842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e913fc61-c217-401b-91af-a823a91bd971 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:33 devstack sudo[103569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e913fc61-c217-401b-91af-a823a91bd971 Sep 28 12:00:33 devstack sudo[103569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:34 devstack sudo[103569]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-392b9ef4-ec2d-4e80-81fe-c2059eb35cb5 tempest-VolumeDependencyTests-2064860842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e913fc61-c217-401b-91af-a823a91bd971" returned: 0 in 0.618s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-392b9ef4-ec2d-4e80-81fe-c2059eb35cb5 tempest-VolumeDependencyTests-2064860842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e913fc61-c217-401b-91af-a823a91bd971.65e1870d-2fca-4d3c-82fe-746e2f773260 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:34 devstack sudo[103575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e913fc61-c217-401b-91af-a823a91bd971.65e1870d-2fca-4d3c-82fe-746e2f773260 Sep 28 12:00:34 devstack sudo[103575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:34 devstack sudo[103575]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-392b9ef4-ec2d-4e80-81fe-c2059eb35cb5 tempest-VolumeDependencyTests-2064860842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e913fc61-c217-401b-91af-a823a91bd971.65e1870d-2fca-4d3c-82fe-746e2f773260" returned: 0 in 0.465s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-392b9ef4-ec2d-4e80-81fe-c2059eb35cb5 tempest-VolumeDependencyTests-2064860842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e913fc61-c217-401b-91af-a823a91bd971.65e1870d-2fca-4d3c-82fe-746e2f773260 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:34 devstack sudo[103583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e913fc61-c217-401b-91af-a823a91bd971.65e1870d-2fca-4d3c-82fe-746e2f773260 Sep 28 12:00:34 devstack sudo[103583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:34 devstack sudo[103583]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-392b9ef4-ec2d-4e80-81fe-c2059eb35cb5 tempest-VolumeDependencyTests-2064860842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e913fc61-c217-401b-91af-a823a91bd971.65e1870d-2fca-4d3c-82fe-746e2f773260" returned: 0 in 0.270s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-392b9ef4-ec2d-4e80-81fe-c2059eb35cb5 tempest-VolumeDependencyTests-2064860842 None] Lock "cinder-quobyte-65e1870d-2fca-4d3c-82fe-746e2f773260" released by "_delete_snapshot" :: held 1.925s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:00:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-392b9ef4-ec2d-4e80-81fe-c2059eb35cb5 tempest-VolumeDependencyTests-2064860842 None] Lock "cinder-quobyte-e913fc61-c217-401b-91af-a823a91bd971" released by "delete_snapshot" :: held 1.952s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:00:35 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-392b9ef4-ec2d-4e80-81fe-c2059eb35cb5 tempest-VolumeDependencyTests-2064860842 None] Created reservations ['61e3435d-78b2-40d1-ac40-9b9601bc9d19', '5097225f-7174-4a38-813b-f8b323070be1', '28e12129-ba2f-4fb8-a923-0f103a2a57f8', 'fa0da853-960a-43c9-9814-329a006daeb3'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:00:35 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-392b9ef4-ec2d-4e80-81fe-c2059eb35cb5 tempest-VolumeDependencyTests-2064860842 None] Delete snapshot completed successfully. Sep 28 12:00:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-392b9ef4-ec2d-4e80-81fe-c2059eb35cb5 tempest-VolumeDependencyTests-2064860842 None] Lock "cinder-65e1870d-2fca-4d3c-82fe-746e2f773260-delete_snapshot" released by "delete_snapshot" :: held 2.174s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:00:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-c06caf60-61d9-4c5c-ab54-e512d6ea34df req-c7c67db6-fa75-4774-ab7c-58331c2ef68e tempest-TestShelveInstance-1719544345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:00:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-c06caf60-61d9-4c5c-ab54-e512d6ea34df req-c7c67db6-fa75-4774-ab7c-58331c2ef68e tempest-TestShelveInstance-1719544345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:00:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-c06caf60-61d9-4c5c-ab54-e512d6ea34df req-c7c67db6-fa75-4774-ab7c-58331c2ef68e tempest-TestShelveInstance-1719544345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:00:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-c06caf60-61d9-4c5c-ab54-e512d6ea34df req-c7c67db6-fa75-4774-ab7c-58331c2ef68e tempest-TestShelveInstance-1719544345 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0', 'name': 'volume-3abe0bd6-edc9-4431-851c-171bed97922b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '805f8d68-67ff-4006-ae1f-12798a94bd0b', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 12:00:35 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-c06caf60-61d9-4c5c-ab54-e512d6ea34df req-c7c67db6-fa75-4774-ab7c-58331c2ef68e tempest-TestShelveInstance-1719544345 None] attachment_update completed successfully. Sep 28 12:00:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-67978d97-1187-4408-991b-8ac89662c519 tempest-VolumeDependencyTests-2064860842 None] Acquiring lock "cinder-e913fc61-c217-401b-91af-a823a91bd971-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:00:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-67978d97-1187-4408-991b-8ac89662c519 tempest-VolumeDependencyTests-2064860842 None] Lock "cinder-e913fc61-c217-401b-91af-a823a91bd971-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:00:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-67978d97-1187-4408-991b-8ac89662c519 tempest-VolumeDependencyTests-2064860842 None] Acquiring lock "cinder-quobyte-e913fc61-c217-401b-91af-a823a91bd971" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:00:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-67978d97-1187-4408-991b-8ac89662c519 tempest-VolumeDependencyTests-2064860842 None] Lock "cinder-quobyte-e913fc61-c217-401b-91af-a823a91bd971" acquired by "delete_volume" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:00:36 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47d28ea-0f7a-4ac7-ae1b-89609d0e45e3]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:00:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-67978d97-1187-4408-991b-8ac89662c519 tempest-VolumeDependencyTests-2064860842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e913fc61-c217-401b-91af-a823a91bd971 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:36 devstack sudo[103594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e913fc61-c217-401b-91af-a823a91bd971 Sep 28 12:00:36 devstack sudo[103594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:36 devstack sudo[103594]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-67978d97-1187-4408-991b-8ac89662c519 tempest-VolumeDependencyTests-2064860842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e913fc61-c217-401b-91af-a823a91bd971" returned: 0 in 0.450s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-67978d97-1187-4408-991b-8ac89662c519 tempest-VolumeDependencyTests-2064860842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e913fc61-c217-401b-91af-a823a91bd971 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:36 devstack sudo[103599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e913fc61-c217-401b-91af-a823a91bd971 Sep 28 12:00:36 devstack sudo[103599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:37 devstack sudo[103599]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-67978d97-1187-4408-991b-8ac89662c519 tempest-VolumeDependencyTests-2064860842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e913fc61-c217-401b-91af-a823a91bd971" returned: 0 in 0.374s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-67978d97-1187-4408-991b-8ac89662c519 tempest-VolumeDependencyTests-2064860842 None] Lock "cinder-quobyte-e913fc61-c217-401b-91af-a823a91bd971" released by "delete_volume" :: held 0.915s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:00:37 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-67978d97-1187-4408-991b-8ac89662c519 tempest-VolumeDependencyTests-2064860842 None] Created reservations ['681b8b64-400c-4986-a529-74a8282d617b', 'e5b4ad3a-b647-4439-b946-a572ed356476', '800b8676-84a8-4eef-878e-12b8f7a9e843', '8d78e561-0b83-42df-99a5-2e862feeefbb'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:00:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-67978d97-1187-4408-991b-8ac89662c519 tempest-VolumeDependencyTests-2064860842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:00:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-67978d97-1187-4408-991b-8ac89662c519 tempest-VolumeDependencyTests-2064860842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:00:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-67978d97-1187-4408-991b-8ac89662c519 tempest-VolumeDependencyTests-2064860842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:00:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-67978d97-1187-4408-991b-8ac89662c519 tempest-VolumeDependencyTests-2064860842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:00:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-67978d97-1187-4408-991b-8ac89662c519 tempest-VolumeDependencyTests-2064860842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:00:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-67978d97-1187-4408-991b-8ac89662c519 tempest-VolumeDependencyTests-2064860842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:37 devstack sudo[103602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:00:37 devstack sudo[103602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-340a186a-445d-4124-aa32-1cdcff529b5e tempest-VolumeDependencyTests-2064860842 None] Acquiring lock "cinder-20660b3a-0b6d-4c94-958a-abf2031a052c-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:00:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-340a186a-445d-4124-aa32-1cdcff529b5e tempest-VolumeDependencyTests-2064860842 None] Lock "cinder-20660b3a-0b6d-4c94-958a-abf2031a052c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:00:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-340a186a-445d-4124-aa32-1cdcff529b5e tempest-VolumeDependencyTests-2064860842 None] Acquiring lock "cinder-quobyte-20660b3a-0b6d-4c94-958a-abf2031a052c" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:00:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-340a186a-445d-4124-aa32-1cdcff529b5e tempest-VolumeDependencyTests-2064860842 None] Lock "cinder-quobyte-20660b3a-0b6d-4c94-958a-abf2031a052c" acquired by "delete_volume" :: waited 0.028s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:00:37 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[2efd4364-9510-4fbd-981f-cd6b8e084daa]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:00:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-340a186a-445d-4124-aa32-1cdcff529b5e tempest-VolumeDependencyTests-2064860842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-20660b3a-0b6d-4c94-958a-abf2031a052c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:37 devstack sudo[103605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-20660b3a-0b6d-4c94-958a-abf2031a052c Sep 28 12:00:37 devstack sudo[103605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:37 devstack sudo[103602]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-67978d97-1187-4408-991b-8ac89662c519 tempest-VolumeDependencyTests-2064860842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.382s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:37 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-67978d97-1187-4408-991b-8ac89662c519 tempest-VolumeDependencyTests-2064860842 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:00:37 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-67978d97-1187-4408-991b-8ac89662c519 tempest-VolumeDependencyTests-2064860842 None] Deleted volume successfully. Sep 28 12:00:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-67978d97-1187-4408-991b-8ac89662c519 tempest-VolumeDependencyTests-2064860842 None] Lock "cinder-e913fc61-c217-401b-91af-a823a91bd971-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:00:38 devstack sudo[103605]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-340a186a-445d-4124-aa32-1cdcff529b5e tempest-VolumeDependencyTests-2064860842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-20660b3a-0b6d-4c94-958a-abf2031a052c" returned: 0 in 0.398s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-340a186a-445d-4124-aa32-1cdcff529b5e tempest-VolumeDependencyTests-2064860842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-20660b3a-0b6d-4c94-958a-abf2031a052c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:38 devstack sudo[103611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-20660b3a-0b6d-4c94-958a-abf2031a052c Sep 28 12:00:38 devstack sudo[103611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:38 devstack sudo[103611]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-340a186a-445d-4124-aa32-1cdcff529b5e tempest-VolumeDependencyTests-2064860842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-20660b3a-0b6d-4c94-958a-abf2031a052c" returned: 0 in 0.294s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-340a186a-445d-4124-aa32-1cdcff529b5e tempest-VolumeDependencyTests-2064860842 None] Lock "cinder-quobyte-20660b3a-0b6d-4c94-958a-abf2031a052c" released by "delete_volume" :: held 0.763s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:00:38 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-340a186a-445d-4124-aa32-1cdcff529b5e tempest-VolumeDependencyTests-2064860842 None] Created reservations ['b0117952-a9ef-4d50-9ba5-5cc538b3c874', '75fd6a26-da54-4cd4-975d-95281032ca59', '256cd456-59ff-4cff-8ef7-bbbf7c353e48', '567730dd-9d1d-439c-a24b-b8351c69f0af'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:00:38 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:00:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:00:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:00:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:00:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:00:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:00:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-340a186a-445d-4124-aa32-1cdcff529b5e tempest-VolumeDependencyTests-2064860842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:00:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-340a186a-445d-4124-aa32-1cdcff529b5e tempest-VolumeDependencyTests-2064860842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:00:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-340a186a-445d-4124-aa32-1cdcff529b5e tempest-VolumeDependencyTests-2064860842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:00:38 devstack sudo[103614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:00:38 devstack sudo[103614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-340a186a-445d-4124-aa32-1cdcff529b5e tempest-VolumeDependencyTests-2064860842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:00:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-340a186a-445d-4124-aa32-1cdcff529b5e tempest-VolumeDependencyTests-2064860842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:00:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-340a186a-445d-4124-aa32-1cdcff529b5e tempest-VolumeDependencyTests-2064860842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:38 devstack sudo[103617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:00:38 devstack sudo[103617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:39 devstack sudo[103614]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.488s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:39 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:00:39 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:00:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] thread count: 28 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:00:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] thread info: [<_MainThread(MainThread, started 135408582168704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:00:39 devstack sudo[103617]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-340a186a-445d-4124-aa32-1cdcff529b5e tempest-VolumeDependencyTests-2064860842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.468s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:39 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-340a186a-445d-4124-aa32-1cdcff529b5e tempest-VolumeDependencyTests-2064860842 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:00:39 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-340a186a-445d-4124-aa32-1cdcff529b5e tempest-VolumeDependencyTests-2064860842 None] Deleted volume successfully. Sep 28 12:00:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-340a186a-445d-4124-aa32-1cdcff529b5e tempest-VolumeDependencyTests-2064860842 None] Lock "cinder-20660b3a-0b6d-4c94-958a-abf2031a052c-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:00:48 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=51,cinder:UPDATE=58,cinder:INSERT=13,cinder:DELETE=2 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:00:49 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:UPDATE=48,cinder:SELECT=46,cinder:DELETE=5,cinder:INSERT=14 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:00:57 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-74caeeff-a206-466d-8d19-1f3334015487 tempest-TestServerVolumeAttachmentScenario-1736529816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:00:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-74caeeff-a206-466d-8d19-1f3334015487 tempest-TestServerVolumeAttachmentScenario-1736529816 None] Flow 'volume_create_manager' (8bc76b0c-a839-4e17-9107-e019ab7685f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:00:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-74caeeff-a206-466d-8d19-1f3334015487 tempest-TestServerVolumeAttachmentScenario-1736529816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27d94565-d11e-4a75-88b5-5e1ddd08e669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:00:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-74caeeff-a206-466d-8d19-1f3334015487 tempest-TestServerVolumeAttachmentScenario-1736529816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27d94565-d11e-4a75-88b5-5e1ddd08e669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:00:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-331410459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6217887c-114e-4245-83fb-8a6d80431490,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='511beb591fe24d3288f707915f2ecd43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:00:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:00:58Z,use_quota=True,user_id='6840118705d44bb49a1202662332b72b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:00:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-74caeeff-a206-466d-8d19-1f3334015487 tempest-TestServerVolumeAttachmentScenario-1736529816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74c55de3-3631-477c-8080-706bf8688219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:00:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-74caeeff-a206-466d-8d19-1f3334015487 tempest-TestServerVolumeAttachmentScenario-1736529816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74c55de3-3631-477c-8080-706bf8688219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:00:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-74caeeff-a206-466d-8d19-1f3334015487 tempest-TestServerVolumeAttachmentScenario-1736529816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f8fe262-33df-4c85-b1da-5684781ad75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:00:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-74caeeff-a206-466d-8d19-1f3334015487 tempest-TestServerVolumeAttachmentScenario-1736529816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f8fe262-33df-4c85-b1da-5684781ad75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6217887c-114e-4245-83fb-8a6d80431490', 'volume_name': 'volume-6217887c-114e-4245-83fb-8a6d80431490', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:00:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-74caeeff-a206-466d-8d19-1f3334015487 tempest-TestServerVolumeAttachmentScenario-1736529816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cddea28d-b34c-4ad3-b4a5-7d850b0b4bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:00:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-74caeeff-a206-466d-8d19-1f3334015487 tempest-TestServerVolumeAttachmentScenario-1736529816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cddea28d-b34c-4ad3-b4a5-7d850b0b4bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:00:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-74caeeff-a206-466d-8d19-1f3334015487 tempest-TestServerVolumeAttachmentScenario-1736529816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e039bc65-8f14-41ec-9a89-10d3260ffadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:00:58 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-74caeeff-a206-466d-8d19-1f3334015487 tempest-TestServerVolumeAttachmentScenario-1736529816 None] Volume 6217887c-114e-4245-83fb-8a6d80431490: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6217887c-114e-4245-83fb-8a6d80431490', 'volume_size': 1} Sep 28 12:00:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-74caeeff-a206-466d-8d19-1f3334015487 tempest-TestServerVolumeAttachmentScenario-1736529816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:00:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-74caeeff-a206-466d-8d19-1f3334015487 tempest-TestServerVolumeAttachmentScenario-1736529816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:00:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-74caeeff-a206-466d-8d19-1f3334015487 tempest-TestServerVolumeAttachmentScenario-1736529816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:00:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-331410459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6217887c-114e-4245-83fb-8a6d80431490,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='511beb591fe24d3288f707915f2ecd43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:00:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:00:58Z,use_quota=True,user_id='6840118705d44bb49a1202662332b72b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:00:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-74caeeff-a206-466d-8d19-1f3334015487 tempest-TestServerVolumeAttachmentScenario-1736529816 None] Creating volume 6217887c-114e-4245-83fb-8a6d80431490 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:00:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-74caeeff-a206-466d-8d19-1f3334015487 tempest-TestServerVolumeAttachmentScenario-1736529816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:00:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-74caeeff-a206-466d-8d19-1f3334015487 tempest-TestServerVolumeAttachmentScenario-1736529816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:00:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-74caeeff-a206-466d-8d19-1f3334015487 tempest-TestServerVolumeAttachmentScenario-1736529816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:00:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-74caeeff-a206-466d-8d19-1f3334015487 tempest-TestServerVolumeAttachmentScenario-1736529816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:00:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-74caeeff-a206-466d-8d19-1f3334015487 tempest-TestServerVolumeAttachmentScenario-1736529816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:00:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-74caeeff-a206-466d-8d19-1f3334015487 tempest-TestServerVolumeAttachmentScenario-1736529816 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:00:58 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-74caeeff-a206-466d-8d19-1f3334015487 tempest-TestServerVolumeAttachmentScenario-1736529816 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:00:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-74caeeff-a206-466d-8d19-1f3334015487 tempest-TestServerVolumeAttachmentScenario-1736529816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-6217887c-114e-4245-83fb-8a6d80431490 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:58 devstack sudo[104121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-6217887c-114e-4245-83fb-8a6d80431490 1073741824 Sep 28 12:00:58 devstack sudo[104121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:58 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-92e2d489-f4db-4cf9-baf3-175363890eef tempest-TestServerVolumeAttachmentScenario-1736529816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:00:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-92e2d489-f4db-4cf9-baf3-175363890eef tempest-TestServerVolumeAttachmentScenario-1736529816 None] Flow 'volume_create_manager' (4f39e90a-6a41-4821-94bb-b02b70b5486b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:00:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-92e2d489-f4db-4cf9-baf3-175363890eef tempest-TestServerVolumeAttachmentScenario-1736529816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33102afb-e5fb-437f-8c16-8c49de1cad4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:00:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-92e2d489-f4db-4cf9-baf3-175363890eef tempest-TestServerVolumeAttachmentScenario-1736529816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33102afb-e5fb-437f-8c16-8c49de1cad4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:00:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1667622985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b2486da-6570-4ca9-b7c4-c16cceb7e7fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='511beb591fe24d3288f707915f2ecd43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:00:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:00:58Z,use_quota=True,user_id='6840118705d44bb49a1202662332b72b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:00:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-92e2d489-f4db-4cf9-baf3-175363890eef tempest-TestServerVolumeAttachmentScenario-1736529816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62d257ec-abd7-42d1-9073-b817a104b7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:00:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-92e2d489-f4db-4cf9-baf3-175363890eef tempest-TestServerVolumeAttachmentScenario-1736529816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62d257ec-abd7-42d1-9073-b817a104b7b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:00:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-92e2d489-f4db-4cf9-baf3-175363890eef tempest-TestServerVolumeAttachmentScenario-1736529816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f88b7ac-30cc-467b-b735-0b2940652b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:00:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-92e2d489-f4db-4cf9-baf3-175363890eef tempest-TestServerVolumeAttachmentScenario-1736529816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f88b7ac-30cc-467b-b735-0b2940652b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b2486da-6570-4ca9-b7c4-c16cceb7e7fe', 'volume_name': 'volume-1b2486da-6570-4ca9-b7c4-c16cceb7e7fe', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:00:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-92e2d489-f4db-4cf9-baf3-175363890eef tempest-TestServerVolumeAttachmentScenario-1736529816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4b11f76-fd19-4304-8243-6760403b55e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:00:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-92e2d489-f4db-4cf9-baf3-175363890eef tempest-TestServerVolumeAttachmentScenario-1736529816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4b11f76-fd19-4304-8243-6760403b55e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:00:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-92e2d489-f4db-4cf9-baf3-175363890eef tempest-TestServerVolumeAttachmentScenario-1736529816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e23d5928-352d-4a18-8e70-6cacffa8e04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:00:58 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-92e2d489-f4db-4cf9-baf3-175363890eef tempest-TestServerVolumeAttachmentScenario-1736529816 None] Volume 1b2486da-6570-4ca9-b7c4-c16cceb7e7fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b2486da-6570-4ca9-b7c4-c16cceb7e7fe', 'volume_size': 1} Sep 28 12:00:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-92e2d489-f4db-4cf9-baf3-175363890eef tempest-TestServerVolumeAttachmentScenario-1736529816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:00:58 devstack sudo[104121]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-74caeeff-a206-466d-8d19-1f3334015487 tempest-TestServerVolumeAttachmentScenario-1736529816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-6217887c-114e-4245-83fb-8a6d80431490 1073741824" returned: 0 in 0.741s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-74caeeff-a206-466d-8d19-1f3334015487 tempest-TestServerVolumeAttachmentScenario-1736529816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-6217887c-114e-4245-83fb-8a6d80431490 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:58 devstack sudo[104127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-6217887c-114e-4245-83fb-8a6d80431490 Sep 28 12:00:58 devstack sudo[104127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:59 devstack sudo[104127]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-74caeeff-a206-466d-8d19-1f3334015487 tempest-TestServerVolumeAttachmentScenario-1736529816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-6217887c-114e-4245-83fb-8a6d80431490" returned: 0 in 0.344s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-74caeeff-a206-466d-8d19-1f3334015487 tempest-TestServerVolumeAttachmentScenario-1736529816 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:00:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-74caeeff-a206-466d-8d19-1f3334015487 tempest-TestServerVolumeAttachmentScenario-1736529816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:00:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-92e2d489-f4db-4cf9-baf3-175363890eef tempest-TestServerVolumeAttachmentScenario-1736529816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.747s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:00:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-92e2d489-f4db-4cf9-baf3-175363890eef tempest-TestServerVolumeAttachmentScenario-1736529816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:00:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1667622985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b2486da-6570-4ca9-b7c4-c16cceb7e7fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='511beb591fe24d3288f707915f2ecd43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:00:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:00:58Z,use_quota=True,user_id='6840118705d44bb49a1202662332b72b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:00:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-92e2d489-f4db-4cf9-baf3-175363890eef tempest-TestServerVolumeAttachmentScenario-1736529816 None] Creating volume 1b2486da-6570-4ca9-b7c4-c16cceb7e7fe {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:00:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-92e2d489-f4db-4cf9-baf3-175363890eef tempest-TestServerVolumeAttachmentScenario-1736529816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:00:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-92e2d489-f4db-4cf9-baf3-175363890eef tempest-TestServerVolumeAttachmentScenario-1736529816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:00:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-92e2d489-f4db-4cf9-baf3-175363890eef tempest-TestServerVolumeAttachmentScenario-1736529816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:00:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-92e2d489-f4db-4cf9-baf3-175363890eef tempest-TestServerVolumeAttachmentScenario-1736529816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:00:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-92e2d489-f4db-4cf9-baf3-175363890eef tempest-TestServerVolumeAttachmentScenario-1736529816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:00:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-92e2d489-f4db-4cf9-baf3-175363890eef tempest-TestServerVolumeAttachmentScenario-1736529816 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:00:59 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-92e2d489-f4db-4cf9-baf3-175363890eef tempest-TestServerVolumeAttachmentScenario-1736529816 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:00:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-92e2d489-f4db-4cf9-baf3-175363890eef tempest-TestServerVolumeAttachmentScenario-1736529816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1b2486da-6570-4ca9-b7c4-c16cceb7e7fe 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-74caeeff-a206-466d-8d19-1f3334015487 tempest-TestServerVolumeAttachmentScenario-1736529816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e039bc65-8f14-41ec-9a89-10d3260ffadb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6217887c-114e-4245-83fb-8a6d80431490', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:00:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-74caeeff-a206-466d-8d19-1f3334015487 tempest-TestServerVolumeAttachmentScenario-1736529816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f28adba7-0b76-4ca0-88f3-7378f7ce1e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:00:59 devstack sudo[104142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1b2486da-6570-4ca9-b7c4-c16cceb7e7fe 1073741824 Sep 28 12:00:59 devstack sudo[104142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:00:59 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-74caeeff-a206-466d-8d19-1f3334015487 tempest-TestServerVolumeAttachmentScenario-1736529816 None] Volume volume-6217887c-114e-4245-83fb-8a6d80431490 (6217887c-114e-4245-83fb-8a6d80431490): created successfully Sep 28 12:00:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-74caeeff-a206-466d-8d19-1f3334015487 tempest-TestServerVolumeAttachmentScenario-1736529816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f28adba7-0b76-4ca0-88f3-7378f7ce1e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:00:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-74caeeff-a206-466d-8d19-1f3334015487 tempest-TestServerVolumeAttachmentScenario-1736529816 None] Flow 'volume_create_manager' (8bc76b0c-a839-4e17-9107-e019ab7685f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:00:59 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-74caeeff-a206-466d-8d19-1f3334015487 tempest-TestServerVolumeAttachmentScenario-1736529816 None] Created volume successfully. Sep 28 12:00:59 devstack sudo[104142]: pam_unix(sudo:session): session closed for user root Sep 28 12:00:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-92e2d489-f4db-4cf9-baf3-175363890eef tempest-TestServerVolumeAttachmentScenario-1736529816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1b2486da-6570-4ca9-b7c4-c16cceb7e7fe 1073741824" returned: 0 in 0.598s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:00:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-92e2d489-f4db-4cf9-baf3-175363890eef tempest-TestServerVolumeAttachmentScenario-1736529816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1b2486da-6570-4ca9-b7c4-c16cceb7e7fe {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:00:59 devstack sudo[104148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1b2486da-6570-4ca9-b7c4-c16cceb7e7fe Sep 28 12:00:59 devstack sudo[104148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:01:00 devstack sudo[104148]: pam_unix(sudo:session): session closed for user root Sep 28 12:01:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-92e2d489-f4db-4cf9-baf3-175363890eef tempest-TestServerVolumeAttachmentScenario-1736529816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1b2486da-6570-4ca9-b7c4-c16cceb7e7fe" returned: 0 in 0.288s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:01:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-92e2d489-f4db-4cf9-baf3-175363890eef tempest-TestServerVolumeAttachmentScenario-1736529816 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:01:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-92e2d489-f4db-4cf9-baf3-175363890eef tempest-TestServerVolumeAttachmentScenario-1736529816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:01:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-92e2d489-f4db-4cf9-baf3-175363890eef tempest-TestServerVolumeAttachmentScenario-1736529816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e23d5928-352d-4a18-8e70-6cacffa8e04e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b2486da-6570-4ca9-b7c4-c16cceb7e7fe', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:01:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-92e2d489-f4db-4cf9-baf3-175363890eef tempest-TestServerVolumeAttachmentScenario-1736529816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a075d8c0-67f9-4c3f-a8a0-99e745eed1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:01:00 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-92e2d489-f4db-4cf9-baf3-175363890eef tempest-TestServerVolumeAttachmentScenario-1736529816 None] Volume volume-1b2486da-6570-4ca9-b7c4-c16cceb7e7fe (1b2486da-6570-4ca9-b7c4-c16cceb7e7fe): created successfully Sep 28 12:01:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-92e2d489-f4db-4cf9-baf3-175363890eef tempest-TestServerVolumeAttachmentScenario-1736529816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a075d8c0-67f9-4c3f-a8a0-99e745eed1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:01:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-92e2d489-f4db-4cf9-baf3-175363890eef tempest-TestServerVolumeAttachmentScenario-1736529816 None] Flow 'volume_create_manager' (4f39e90a-6a41-4821-94bb-b02b70b5486b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:01:00 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-92e2d489-f4db-4cf9-baf3-175363890eef tempest-TestServerVolumeAttachmentScenario-1736529816 None] Created volume successfully. Sep 28 12:01:10 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=5,cinder:UPDATE=7,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:01:10 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=3,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:01:24 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-2ed1ed99-48ae-4619-b404-9f7239af20c6 req-54185705-baf2-4a13-9026-52eaca0b2fb0 tempest-TestShelveInstance-1719544345 None] Terminate volume connection completed successfully. Sep 28 12:01:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-2ed1ed99-48ae-4619-b404-9f7239af20c6 req-54185705-baf2-4a13-9026-52eaca0b2fb0 tempest-TestShelveInstance-1719544345 None] Deleting attachment 805f8d68-67ff-4006-ae1f-12798a94bd0b. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 12:01:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-2ed1ed99-48ae-4619-b404-9f7239af20c6 req-368372a3-f5fc-4024-9a6d-c99669a5a361 tempest-TestShelveInstance-1719544345 None] Acquiring lock "cinder-3abe0bd6-edc9-4431-851c-171bed97922b-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:01:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-2ed1ed99-48ae-4619-b404-9f7239af20c6 req-368372a3-f5fc-4024-9a6d-c99669a5a361 tempest-TestShelveInstance-1719544345 None] Lock "cinder-3abe0bd6-edc9-4431-851c-171bed97922b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:01:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-2ed1ed99-48ae-4619-b404-9f7239af20c6 req-368372a3-f5fc-4024-9a6d-c99669a5a361 tempest-TestShelveInstance-1719544345 None] Acquiring lock "cinder-quobyte-3abe0bd6-edc9-4431-851c-171bed97922b" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:01:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-2ed1ed99-48ae-4619-b404-9f7239af20c6 req-368372a3-f5fc-4024-9a6d-c99669a5a361 tempest-TestShelveInstance-1719544345 None] Lock "cinder-quobyte-3abe0bd6-edc9-4431-851c-171bed97922b" acquired by "delete_volume" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:01:24 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e7ddac-d8e5-4b1a-bdbd-134a4aa9c8b5]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:01:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-2ed1ed99-48ae-4619-b404-9f7239af20c6 req-368372a3-f5fc-4024-9a6d-c99669a5a361 tempest-TestShelveInstance-1719544345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3abe0bd6-edc9-4431-851c-171bed97922b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:01:24 devstack sudo[104384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3abe0bd6-edc9-4431-851c-171bed97922b Sep 28 12:01:24 devstack sudo[104384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:01:24 devstack sudo[104384]: pam_unix(sudo:session): session closed for user root Sep 28 12:01:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-2ed1ed99-48ae-4619-b404-9f7239af20c6 req-368372a3-f5fc-4024-9a6d-c99669a5a361 tempest-TestShelveInstance-1719544345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3abe0bd6-edc9-4431-851c-171bed97922b" returned: 0 in 0.417s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:01:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-2ed1ed99-48ae-4619-b404-9f7239af20c6 req-368372a3-f5fc-4024-9a6d-c99669a5a361 tempest-TestShelveInstance-1719544345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3abe0bd6-edc9-4431-851c-171bed97922b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:01:25 devstack sudo[104389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3abe0bd6-edc9-4431-851c-171bed97922b Sep 28 12:01:25 devstack sudo[104389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:01:25 devstack sudo[104389]: pam_unix(sudo:session): session closed for user root Sep 28 12:01:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-2ed1ed99-48ae-4619-b404-9f7239af20c6 req-368372a3-f5fc-4024-9a6d-c99669a5a361 tempest-TestShelveInstance-1719544345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3abe0bd6-edc9-4431-851c-171bed97922b" returned: 0 in 0.263s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:01:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-2ed1ed99-48ae-4619-b404-9f7239af20c6 req-368372a3-f5fc-4024-9a6d-c99669a5a361 tempest-TestShelveInstance-1719544345 None] Lock "cinder-quobyte-3abe0bd6-edc9-4431-851c-171bed97922b" released by "delete_volume" :: held 0.722s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:01:25 devstack cinder-volume[86916]: DEBUG cinder.quota [req-2ed1ed99-48ae-4619-b404-9f7239af20c6 req-368372a3-f5fc-4024-9a6d-c99669a5a361 tempest-TestShelveInstance-1719544345 None] Created reservations ['da720405-ddb6-44a4-9cd6-086e32db4a14', '7f978c0a-2881-49c4-af7c-5a8e20764202', 'b71392a4-b699-4153-803f-1b5c04ceeb25', '6433a85b-07c5-4110-8d0c-58b7d757eeba'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:01:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-2ed1ed99-48ae-4619-b404-9f7239af20c6 req-368372a3-f5fc-4024-9a6d-c99669a5a361 tempest-TestShelveInstance-1719544345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:01:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-2ed1ed99-48ae-4619-b404-9f7239af20c6 req-368372a3-f5fc-4024-9a6d-c99669a5a361 tempest-TestShelveInstance-1719544345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:01:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [req-2ed1ed99-48ae-4619-b404-9f7239af20c6 req-368372a3-f5fc-4024-9a6d-c99669a5a361 tempest-TestShelveInstance-1719544345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:01:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [req-2ed1ed99-48ae-4619-b404-9f7239af20c6 req-368372a3-f5fc-4024-9a6d-c99669a5a361 tempest-TestShelveInstance-1719544345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:01:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-2ed1ed99-48ae-4619-b404-9f7239af20c6 req-368372a3-f5fc-4024-9a6d-c99669a5a361 tempest-TestShelveInstance-1719544345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:01:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-2ed1ed99-48ae-4619-b404-9f7239af20c6 req-368372a3-f5fc-4024-9a6d-c99669a5a361 tempest-TestShelveInstance-1719544345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:01:25 devstack sudo[104393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:01:25 devstack sudo[104393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:01:25 devstack sudo[104393]: pam_unix(sudo:session): session closed for user root Sep 28 12:01:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-2ed1ed99-48ae-4619-b404-9f7239af20c6 req-368372a3-f5fc-4024-9a6d-c99669a5a361 tempest-TestShelveInstance-1719544345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.268s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:01:25 devstack cinder-volume[86916]: DEBUG cinder.manager [req-2ed1ed99-48ae-4619-b404-9f7239af20c6 req-368372a3-f5fc-4024-9a6d-c99669a5a361 tempest-TestShelveInstance-1719544345 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:01:25 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-2ed1ed99-48ae-4619-b404-9f7239af20c6 req-368372a3-f5fc-4024-9a6d-c99669a5a361 tempest-TestShelveInstance-1719544345 None] Deleted volume successfully. Sep 28 12:01:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-2ed1ed99-48ae-4619-b404-9f7239af20c6 req-368372a3-f5fc-4024-9a6d-c99669a5a361 tempest-TestShelveInstance-1719544345 None] Lock "cinder-3abe0bd6-edc9-4431-851c-171bed97922b-delete_volume" released by "delete_volume" :: held 1.211s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:01:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-64aa7404-bcfe-493d-8d4d-2f509412a2ac req-f9dc69bd-b684-4ebc-99cf-59fd25d10726 tempest-TestServerVolumeAttachmentScenario-1736529816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:01:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-64aa7404-bcfe-493d-8d4d-2f509412a2ac req-f9dc69bd-b684-4ebc-99cf-59fd25d10726 tempest-TestServerVolumeAttachmentScenario-1736529816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:01:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-64aa7404-bcfe-493d-8d4d-2f509412a2ac req-f9dc69bd-b684-4ebc-99cf-59fd25d10726 tempest-TestServerVolumeAttachmentScenario-1736529816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:01:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-64aa7404-bcfe-493d-8d4d-2f509412a2ac req-f9dc69bd-b684-4ebc-99cf-59fd25d10726 tempest-TestServerVolumeAttachmentScenario-1736529816 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0', 'name': 'volume-6217887c-114e-4245-83fb-8a6d80431490', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9ba81c8a-5b74-4b77-a81b-177781cbbe1b', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 12:01:30 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-64aa7404-bcfe-493d-8d4d-2f509412a2ac req-f9dc69bd-b684-4ebc-99cf-59fd25d10726 tempest-TestServerVolumeAttachmentScenario-1736529816 None] attachment_update completed successfully. Sep 28 12:01:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-6f0bd54b-1fa5-4885-b20d-329335f8fd90 req-1ef96430-2700-423b-adea-28cf8b9fdcbe tempest-TestServerVolumeAttachmentScenario-1736529816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:01:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-6f0bd54b-1fa5-4885-b20d-329335f8fd90 req-1ef96430-2700-423b-adea-28cf8b9fdcbe tempest-TestServerVolumeAttachmentScenario-1736529816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:01:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-6f0bd54b-1fa5-4885-b20d-329335f8fd90 req-1ef96430-2700-423b-adea-28cf8b9fdcbe tempest-TestServerVolumeAttachmentScenario-1736529816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:01:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-6f0bd54b-1fa5-4885-b20d-329335f8fd90 req-1ef96430-2700-423b-adea-28cf8b9fdcbe tempest-TestServerVolumeAttachmentScenario-1736529816 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0', 'name': 'volume-1b2486da-6570-4ca9-b7c4-c16cceb7e7fe', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0bcd4f30-d842-4b49-811b-957fe60c5936', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 12:01:34 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-6f0bd54b-1fa5-4885-b20d-329335f8fd90 req-1ef96430-2700-423b-adea-28cf8b9fdcbe tempest-TestServerVolumeAttachmentScenario-1736529816 None] attachment_update completed successfully. Sep 28 12:01:37 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-f4c75b02-813a-4955-901b-84545f673fa0 req-c6777a29-b0b3-4df2-858e-b5a99e2992c8 tempest-TestServerVolumeAttachmentScenario-1736529816 None] Terminate volume connection completed successfully. Sep 28 12:01:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-f4c75b02-813a-4955-901b-84545f673fa0 req-c6777a29-b0b3-4df2-858e-b5a99e2992c8 tempest-TestServerVolumeAttachmentScenario-1736529816 None] Deleting attachment 0bcd4f30-d842-4b49-811b-957fe60c5936. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 12:01:38 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:01:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:01:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:01:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:01:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:01:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:01:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:01:38 devstack sudo[104850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:01:38 devstack sudo[104850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:01:38 devstack sudo[104850]: pam_unix(sudo:session): session closed for user root Sep 28 12:01:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.314s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:01:38 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:01:38 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:01:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] thread count: 28 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:01:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] thread info: [<_MainThread(MainThread, started 135408582168704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:01:39 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-a982e0c6-30ba-4784-90bd-5cb22bb6e6c6 req-5f33e794-94df-433c-b40d-b00ab15241ea tempest-TestServerVolumeAttachmentScenario-1736529816 None] Terminate volume connection completed successfully. Sep 28 12:01:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-a982e0c6-30ba-4784-90bd-5cb22bb6e6c6 req-5f33e794-94df-433c-b40d-b00ab15241ea tempest-TestServerVolumeAttachmentScenario-1736529816 None] Deleting attachment 9ba81c8a-5b74-4b77-a81b-177781cbbe1b. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 12:01:42 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:01:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Flow 'volume_create_manager' (0409b339-acf1-46b0-b705-79afdee88381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:01:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (798b28e6-a020-4339-973b-5b792a35c8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:01:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (798b28e6-a020-4339-973b-5b792a35c8cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:01:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc5d047c-d458-47d5-9e70-50cd1222124f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54e5275f6b3e409b99a9dbd935232f2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:01:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:01:42Z,use_quota=True,user_id='a30b97ab1edb4f3f9943526e4b707b9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e03a659f-d3f4-4601-860b-701d9942b108),volume_type_id=e03a659f-d3f4-4601-860b-701d9942b108)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:01:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f12fe3d-1f30-4e47-beef-291e11dbac69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:01:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f12fe3d-1f30-4e47-beef-291e11dbac69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:01:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (292a7b6d-5e1f-455b-ad73-e122a403b80c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:01:42 devstack cinder-volume[86916]: DEBUG cinder.image.glance [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Creating Keystone auth plugin from conf {{(pid=86916) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 12:01:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (292a7b6d-5e1f-455b-ad73-e122a403b80c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cc5d047c-d458-47d5-9e70-50cd1222124f', 'volume_name': 'volume-cc5d047c-d458-47d5-9e70-50cd1222124f', 'volume_size': 1, 'image_id': 'b5b10f46-9600-483c-841d-47518779c07e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5b10f46-9600-483c-841d-47518779c07e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b89432c5a7a33518c1e182a2a67105d3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '54e5275f6b3e409b99a9dbd935232f2e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b90f8c72a9d1d165b5d4a2adc4f3718a2e7c9f3d4f8933d86cf0b6c2fdd6912f4572ba696de89682b52800ec09c04364daa280834cc54d35eba24999606cb39f', 'id': 'b5b10f46-9600-483c-841d-47518779c07e', 'created_at': datetime.datetime(2026, 9, 28, 10, 1, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 1, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5b10f46-9600-483c-841d-47518779c07e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:01:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80e92923-9689-4937-a98f-393fff5c39fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:01:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80e92923-9689-4937-a98f-393fff5c39fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:01:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81c3d0c4-2ec3-40e4-bfe7-6ac89e7f1c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:01:42 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Volume cc5d047c-d458-47d5-9e70-50cd1222124f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cc5d047c-d458-47d5-9e70-50cd1222124f', 'volume_size': 1, 'image_id': 'b5b10f46-9600-483c-841d-47518779c07e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5b10f46-9600-483c-841d-47518779c07e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b89432c5a7a33518c1e182a2a67105d3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '54e5275f6b3e409b99a9dbd935232f2e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b90f8c72a9d1d165b5d4a2adc4f3718a2e7c9f3d4f8933d86cf0b6c2fdd6912f4572ba696de89682b52800ec09c04364daa280834cc54d35eba24999606cb39f', 'id': 'b5b10f46-9600-483c-841d-47518779c07e', 'created_at': datetime.datetime(2026, 9, 28, 10, 1, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 1, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5b10f46-9600-483c-841d-47518779c07e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 28 12:01:42 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Trying to clone cc5d047c-d458-47d5-9e70-50cd1222124f from image b5b10f46-9600-483c-841d-47518779c07e at location (None, [{'url': 'file:///opt/stack/data/glance/images/b5b10f46-9600-483c-841d-47518779c07e', 'metadata': {}}]). {{(pid=86916) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 12:01:42 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b5b10f46-9600-483c-841d-47518779c07e_ia2famz3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 12:01:42 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Image download 0.00 MB at 0.00 MB/s Sep 28 12:01:42 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[610e1a9a-d247-40c4-b306-9a52f9d38ee0]: (4, 'raw') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:01:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5b10f46-9600-483c-841d-47518779c07e_ia2famz3devstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:01:43 devstack sudo[104908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5b10f46-9600-483c-841d-47518779c07e_ia2famz3devstack@QuobyteHD Sep 28 12:01:43 devstack sudo[104908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:01:43 devstack sudo[104908]: pam_unix(sudo:session): session closed for user root Sep 28 12:01:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5b10f46-9600-483c-841d-47518779c07e_ia2famz3devstack@QuobyteHD" returned: 0 in 0.382s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:01:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5b10f46-9600-483c-841d-47518779c07e_ia2famz3devstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:01:43 devstack sudo[104912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5b10f46-9600-483c-841d-47518779c07e_ia2famz3devstack@QuobyteHD Sep 28 12:01:43 devstack sudo[104912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:01:43 devstack sudo[104912]: pam_unix(sudo:session): session closed for user root Sep 28 12:01:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5b10f46-9600-483c-841d-47518779c07e_ia2famz3devstack@QuobyteHD" returned: 1 in 0.331s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:01:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5b10f46-9600-483c-841d-47518779c07e_ia2famz3devstack@QuobyteHD' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:01:43 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Temporary image b5b10f46-9600-483c-841d-47518779c07e is fetched for user a30b97ab1edb4f3f9943526e4b707b9a. {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 12:01:43 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2b1854-e872-41f0-9aa8-23eb91e8c287]: (4, 'raw') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:01:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5b10f46-9600-483c-841d-47518779c07e_ia2famz3devstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:01:43 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6852099c-8927-481c-8265-2016ff2d01cb tempest-TestServerVolumeAttachmentScenario-1736529816 None] Acquiring lock "cinder-1b2486da-6570-4ca9-b7c4-c16cceb7e7fe-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:01:43 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6852099c-8927-481c-8265-2016ff2d01cb tempest-TestServerVolumeAttachmentScenario-1736529816 None] Lock "cinder-1b2486da-6570-4ca9-b7c4-c16cceb7e7fe-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:01:43 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6852099c-8927-481c-8265-2016ff2d01cb tempest-TestServerVolumeAttachmentScenario-1736529816 None] Acquiring lock "cinder-quobyte-1b2486da-6570-4ca9-b7c4-c16cceb7e7fe" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:01:43 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6852099c-8927-481c-8265-2016ff2d01cb tempest-TestServerVolumeAttachmentScenario-1736529816 None] Lock "cinder-quobyte-1b2486da-6570-4ca9-b7c4-c16cceb7e7fe" acquired by "delete_volume" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:01:43 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[136f00dd-1416-4577-aecd-f65882a63aea]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:01:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6852099c-8927-481c-8265-2016ff2d01cb tempest-TestServerVolumeAttachmentScenario-1736529816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1b2486da-6570-4ca9-b7c4-c16cceb7e7fe {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:01:43 devstack sudo[104917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5b10f46-9600-483c-841d-47518779c07e_ia2famz3devstack@QuobyteHD Sep 28 12:01:43 devstack sudo[104917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:01:43 devstack sudo[104918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1b2486da-6570-4ca9-b7c4-c16cceb7e7fe Sep 28 12:01:43 devstack sudo[104918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:01:43 devstack sudo[104917]: pam_unix(sudo:session): session closed for user root Sep 28 12:01:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5b10f46-9600-483c-841d-47518779c07e_ia2famz3devstack@QuobyteHD" returned: 0 in 0.350s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:01:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5b10f46-9600-483c-841d-47518779c07e_ia2famz3devstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:01:44 devstack sudo[104923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5b10f46-9600-483c-841d-47518779c07e_ia2famz3devstack@QuobyteHD Sep 28 12:01:44 devstack sudo[104923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:01:44 devstack sudo[104918]: pam_unix(sudo:session): session closed for user root Sep 28 12:01:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6852099c-8927-481c-8265-2016ff2d01cb tempest-TestServerVolumeAttachmentScenario-1736529816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1b2486da-6570-4ca9-b7c4-c16cceb7e7fe" returned: 0 in 0.391s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:01:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6852099c-8927-481c-8265-2016ff2d01cb tempest-TestServerVolumeAttachmentScenario-1736529816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1b2486da-6570-4ca9-b7c4-c16cceb7e7fe {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:01:44 devstack sudo[104928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1b2486da-6570-4ca9-b7c4-c16cceb7e7fe Sep 28 12:01:44 devstack sudo[104928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:01:44 devstack sudo[104923]: pam_unix(sudo:session): session closed for user root Sep 28 12:01:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5b10f46-9600-483c-841d-47518779c07e_ia2famz3devstack@QuobyteHD" returned: 1 in 0.343s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:01:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5b10f46-9600-483c-841d-47518779c07e_ia2famz3devstack@QuobyteHD' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:01:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:01:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:01:44 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:01:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc5d047c-d458-47d5-9e70-50cd1222124f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54e5275f6b3e409b99a9dbd935232f2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:01:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:01:42Z,use_quota=True,user_id='a30b97ab1edb4f3f9943526e4b707b9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e03a659f-d3f4-4601-860b-701d9942b108),volume_type_id=e03a659f-d3f4-4601-860b-701d9942b108)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:01:44 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Creating volume cc5d047c-d458-47d5-9e70-50cd1222124f {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:01:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:01:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:01:44 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:01:44 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:01:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:01:44 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:01:44 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:01:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cc5d047c-d458-47d5-9e70-50cd1222124f 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:01:44 devstack sudo[104933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cc5d047c-d458-47d5-9e70-50cd1222124f 1073741824 Sep 28 12:01:44 devstack sudo[104933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:01:44 devstack sudo[104928]: pam_unix(sudo:session): session closed for user root Sep 28 12:01:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6852099c-8927-481c-8265-2016ff2d01cb tempest-TestServerVolumeAttachmentScenario-1736529816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1b2486da-6570-4ca9-b7c4-c16cceb7e7fe" returned: 0 in 0.260s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:01:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6852099c-8927-481c-8265-2016ff2d01cb tempest-TestServerVolumeAttachmentScenario-1736529816 None] Lock "cinder-quobyte-1b2486da-6570-4ca9-b7c4-c16cceb7e7fe" released by "delete_volume" :: held 0.695s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:01:44 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-6852099c-8927-481c-8265-2016ff2d01cb tempest-TestServerVolumeAttachmentScenario-1736529816 None] Created reservations ['1d8c32da-c8ee-40a8-bf9e-a2b870449e9a', 'ddee7457-fb19-4a50-bacb-7685478b6e2e', 'e1b965f1-7a02-44f9-ac24-692a763cbe17', '94ca8ba3-6fc8-47cf-8012-c0a634b13dcc'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:01:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6852099c-8927-481c-8265-2016ff2d01cb tempest-TestServerVolumeAttachmentScenario-1736529816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:01:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6852099c-8927-481c-8265-2016ff2d01cb tempest-TestServerVolumeAttachmentScenario-1736529816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:01:44 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6852099c-8927-481c-8265-2016ff2d01cb tempest-TestServerVolumeAttachmentScenario-1736529816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:01:44 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6852099c-8927-481c-8265-2016ff2d01cb tempest-TestServerVolumeAttachmentScenario-1736529816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:01:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6852099c-8927-481c-8265-2016ff2d01cb tempest-TestServerVolumeAttachmentScenario-1736529816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:01:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6852099c-8927-481c-8265-2016ff2d01cb tempest-TestServerVolumeAttachmentScenario-1736529816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:01:44 devstack sudo[104936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:01:44 devstack sudo[104936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:01:44 devstack sudo[104936]: pam_unix(sudo:session): session closed for user root Sep 28 12:01:44 devstack sudo[104933]: pam_unix(sudo:session): session closed for user root Sep 28 12:01:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6852099c-8927-481c-8265-2016ff2d01cb tempest-TestServerVolumeAttachmentScenario-1736529816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.267s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:01:44 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-6852099c-8927-481c-8265-2016ff2d01cb tempest-TestServerVolumeAttachmentScenario-1736529816 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:01:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1d2d05f1-bda5-40f3-9f26-4120df6bf219 tempest-TestServerVolumeAttachmentScenario-1736529816 None] Acquiring lock "cinder-6217887c-114e-4245-83fb-8a6d80431490-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:01:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cc5d047c-d458-47d5-9e70-50cd1222124f 1073741824" returned: 0 in 0.496s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:01:44 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-6852099c-8927-481c-8265-2016ff2d01cb tempest-TestServerVolumeAttachmentScenario-1736529816 None] Deleted volume successfully. Sep 28 12:01:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1d2d05f1-bda5-40f3-9f26-4120df6bf219 tempest-TestServerVolumeAttachmentScenario-1736529816 None] Lock "cinder-6217887c-114e-4245-83fb-8a6d80431490-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:01:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6852099c-8927-481c-8265-2016ff2d01cb tempest-TestServerVolumeAttachmentScenario-1736529816 None] Lock "cinder-1b2486da-6570-4ca9-b7c4-c16cceb7e7fe-delete_volume" released by "delete_volume" :: held 1.217s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:01:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cc5d047c-d458-47d5-9e70-50cd1222124f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:01:44 devstack sudo[104942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cc5d047c-d458-47d5-9e70-50cd1222124f Sep 28 12:01:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1d2d05f1-bda5-40f3-9f26-4120df6bf219 tempest-TestServerVolumeAttachmentScenario-1736529816 None] Acquiring lock "cinder-quobyte-6217887c-114e-4245-83fb-8a6d80431490" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:01:44 devstack sudo[104942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:01:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1d2d05f1-bda5-40f3-9f26-4120df6bf219 tempest-TestServerVolumeAttachmentScenario-1736529816 None] Lock "cinder-quobyte-6217887c-114e-4245-83fb-8a6d80431490" acquired by "delete_volume" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:01:44 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[670e3149-40fb-44fd-a3ec-e1714f372e8d]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:01:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1d2d05f1-bda5-40f3-9f26-4120df6bf219 tempest-TestServerVolumeAttachmentScenario-1736529816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-6217887c-114e-4245-83fb-8a6d80431490 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:01:45 devstack sudo[104944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-6217887c-114e-4245-83fb-8a6d80431490 Sep 28 12:01:45 devstack sudo[104944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:01:45 devstack sudo[104942]: pam_unix(sudo:session): session closed for user root Sep 28 12:01:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cc5d047c-d458-47d5-9e70-50cd1222124f" returned: 0 in 0.275s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:01:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:01:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:01:45 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Attempting download of b5b10f46-9600-483c-841d-47518779c07e ((None, [{'url': 'file:///opt/stack/data/glance/images/b5b10f46-9600-483c-841d-47518779c07e', 'metadata': {}}])) to volume cc5d047c-d458-47d5-9e70-50cd1222124f. {{(pid=86916) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 12:01:45 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2c2fcc-beb0-4dcc-9880-4e75d0273b35]: (4, 'raw') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:01:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5b10f46-9600-483c-841d-47518779c07e_0v3qm_el {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:01:45 devstack sudo[104944]: pam_unix(sudo:session): session closed for user root Sep 28 12:01:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1d2d05f1-bda5-40f3-9f26-4120df6bf219 tempest-TestServerVolumeAttachmentScenario-1736529816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-6217887c-114e-4245-83fb-8a6d80431490" returned: 0 in 0.382s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:01:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1d2d05f1-bda5-40f3-9f26-4120df6bf219 tempest-TestServerVolumeAttachmentScenario-1736529816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-6217887c-114e-4245-83fb-8a6d80431490 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:01:45 devstack sudo[104947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5b10f46-9600-483c-841d-47518779c07e_0v3qm_el Sep 28 12:01:45 devstack sudo[104947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:01:45 devstack sudo[104952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-6217887c-114e-4245-83fb-8a6d80431490 Sep 28 12:01:45 devstack sudo[104952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:01:45 devstack sudo[104947]: pam_unix(sudo:session): session closed for user root Sep 28 12:01:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5b10f46-9600-483c-841d-47518779c07e_0v3qm_el" returned: 0 in 0.321s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:01:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5b10f46-9600-483c-841d-47518779c07e_0v3qm_el {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:01:45 devstack sudo[104952]: pam_unix(sudo:session): session closed for user root Sep 28 12:01:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1d2d05f1-bda5-40f3-9f26-4120df6bf219 tempest-TestServerVolumeAttachmentScenario-1736529816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-6217887c-114e-4245-83fb-8a6d80431490" returned: 0 in 0.243s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:01:45 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1d2d05f1-bda5-40f3-9f26-4120df6bf219 tempest-TestServerVolumeAttachmentScenario-1736529816 None] Lock "cinder-quobyte-6217887c-114e-4245-83fb-8a6d80431490" released by "delete_volume" :: held 0.679s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:01:45 devstack sudo[104957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5b10f46-9600-483c-841d-47518779c07e_0v3qm_el Sep 28 12:01:45 devstack sudo[104957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:01:45 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-1d2d05f1-bda5-40f3-9f26-4120df6bf219 tempest-TestServerVolumeAttachmentScenario-1736529816 None] Created reservations ['18a0a47d-990c-42fe-8b52-ccf5da1c4bbe', 'c720aaff-6776-44e8-ad5e-411c6e24791d', 'ff3c4ac9-4622-4746-b556-39c32079f479', 'b52fd387-1b8d-49ab-9bf0-0e8a11f21b9e'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:01:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1d2d05f1-bda5-40f3-9f26-4120df6bf219 tempest-TestServerVolumeAttachmentScenario-1736529816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:01:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1d2d05f1-bda5-40f3-9f26-4120df6bf219 tempest-TestServerVolumeAttachmentScenario-1736529816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:01:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1d2d05f1-bda5-40f3-9f26-4120df6bf219 tempest-TestServerVolumeAttachmentScenario-1736529816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:01:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1d2d05f1-bda5-40f3-9f26-4120df6bf219 tempest-TestServerVolumeAttachmentScenario-1736529816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:01:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1d2d05f1-bda5-40f3-9f26-4120df6bf219 tempest-TestServerVolumeAttachmentScenario-1736529816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:01:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1d2d05f1-bda5-40f3-9f26-4120df6bf219 tempest-TestServerVolumeAttachmentScenario-1736529816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:01:45 devstack sudo[104959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:01:45 devstack sudo[104959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:01:45 devstack sudo[104957]: pam_unix(sudo:session): session closed for user root Sep 28 12:01:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5b10f46-9600-483c-841d-47518779c07e_0v3qm_el" returned: 1 in 0.393s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:01:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5b10f46-9600-483c-841d-47518779c07e_0v3qm_el' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:01:45 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f14c5d-3571-4ccb-9e5d-8b243e9159ac]: (4, 'raw') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:01:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5b10f46-9600-483c-841d-47518779c07e_ia2famz3devstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:01:46 devstack sudo[104963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5b10f46-9600-483c-841d-47518779c07e_ia2famz3devstack@QuobyteHD Sep 28 12:01:46 devstack sudo[104963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:01:46 devstack sudo[104959]: pam_unix(sudo:session): session closed for user root Sep 28 12:01:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1d2d05f1-bda5-40f3-9f26-4120df6bf219 tempest-TestServerVolumeAttachmentScenario-1736529816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.303s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:01:46 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-1d2d05f1-bda5-40f3-9f26-4120df6bf219 tempest-TestServerVolumeAttachmentScenario-1736529816 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:01:46 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-1d2d05f1-bda5-40f3-9f26-4120df6bf219 tempest-TestServerVolumeAttachmentScenario-1736529816 None] Deleted volume successfully. Sep 28 12:01:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1d2d05f1-bda5-40f3-9f26-4120df6bf219 tempest-TestServerVolumeAttachmentScenario-1736529816 None] Lock "cinder-6217887c-114e-4245-83fb-8a6d80431490-delete_volume" released by "delete_volume" :: held 1.305s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:01:46 devstack sudo[104963]: pam_unix(sudo:session): session closed for user root Sep 28 12:01:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5b10f46-9600-483c-841d-47518779c07e_ia2famz3devstack@QuobyteHD" returned: 0 in 0.333s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:01:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5b10f46-9600-483c-841d-47518779c07e_ia2famz3devstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:01:46 devstack sudo[104968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5b10f46-9600-483c-841d-47518779c07e_ia2famz3devstack@QuobyteHD Sep 28 12:01:46 devstack sudo[104968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:01:46 devstack sudo[104968]: pam_unix(sudo:session): session closed for user root Sep 28 12:01:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5b10f46-9600-483c-841d-47518779c07e_ia2famz3devstack@QuobyteHD" returned: 1 in 0.362s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:01:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5b10f46-9600-483c-841d-47518779c07e_ia2famz3devstack@QuobyteHD' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:01:46 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] b5b10f46-9600-483c-841d-47518779c07e was raw, converting to qcow2 {{(pid=86916) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 12:01:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b5b10f46-9600-483c-841d-47518779c07e_ia2famz3devstack@QuobyteHD /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cc5d047c-d458-47d5-9e70-50cd1222124f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:01:46 devstack sudo[104973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b5b10f46-9600-483c-841d-47518779c07e_ia2famz3devstack@QuobyteHD /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cc5d047c-d458-47d5-9e70-50cd1222124f Sep 28 12:01:46 devstack sudo[104973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:01:47 devstack sudo[104973]: pam_unix(sudo:session): session closed for user root Sep 28 12:01:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b5b10f46-9600-483c-841d-47518779c07e_ia2famz3devstack@QuobyteHD /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cc5d047c-d458-47d5-9e70-50cd1222124f" returned: 0 in 0.557s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:01:47 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b5b10f46-9600-483c-841d-47518779c07e_ia2famz3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cc5d047c-d458-47d5-9e70-50cd1222124f {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:01:47 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 12:01:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cc5d047c-d458-47d5-9e70-50cd1222124f 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:01:47 devstack sudo[104979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cc5d047c-d458-47d5-9e70-50cd1222124f 1G Sep 28 12:01:47 devstack sudo[104979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:01:47 devstack sudo[104979]: pam_unix(sudo:session): session closed for user root Sep 28 12:01:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cc5d047c-d458-47d5-9e70-50cd1222124f 1G" returned: 0 in 0.360s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:01:47 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Downloaded image b5b10f46-9600-483c-841d-47518779c07e ((None, [{'url': 'file:///opt/stack/data/glance/images/b5b10f46-9600-483c-841d-47518779c07e', 'metadata': {}}])) to volume cc5d047c-d458-47d5-9e70-50cd1222124f successfully. {{(pid=86916) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 12:01:47 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Temporary image b5b10f46-9600-483c-841d-47518779c07e for user a30b97ab1edb4f3f9943526e4b707b9a is deleted. {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 12:01:47 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Marking volume cc5d047c-d458-47d5-9e70-50cd1222124f as bootable. {{(pid=86916) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 12:01:47 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Copying metadata from image b5b10f46-9600-483c-841d-47518779c07e to cc5d047c-d458-47d5-9e70-50cd1222124f. {{(pid=86916) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 12:01:47 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Creating volume glance metadata for volume cc5d047c-d458-47d5-9e70-50cd1222124f backed by image b5b10f46-9600-483c-841d-47518779c07e with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'b5b10f46-9600-483c-841d-47518779c07e', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'b89432c5a7a33518c1e182a2a67105d3', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86916) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 12:01:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81c3d0c4-2ec3-40e4-bfe7-6ac89e7f1c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc5d047c-d458-47d5-9e70-50cd1222124f', 'volume_size': 1, 'image_id': 'b5b10f46-9600-483c-841d-47518779c07e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5b10f46-9600-483c-841d-47518779c07e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b89432c5a7a33518c1e182a2a67105d3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '54e5275f6b3e409b99a9dbd935232f2e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b90f8c72a9d1d165b5d4a2adc4f3718a2e7c9f3d4f8933d86cf0b6c2fdd6912f4572ba696de89682b52800ec09c04364daa280834cc54d35eba24999606cb39f', 'id': 'b5b10f46-9600-483c-841d-47518779c07e', 'created_at': datetime.datetime(2026, 9, 28, 10, 1, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 1, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5b10f46-9600-483c-841d-47518779c07e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:01:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b4f1364-1a65-4ced-910f-68a8eca314b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:01:47 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Volume volume-cc5d047c-d458-47d5-9e70-50cd1222124f (cc5d047c-d458-47d5-9e70-50cd1222124f): created successfully Sep 28 12:01:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b4f1364-1a65-4ced-910f-68a8eca314b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:01:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Flow 'volume_create_manager' (0409b339-acf1-46b0-b705-79afdee88381) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:01:47 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-40640b15-54ef-46a8-8c2a-beb010f930da tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Created volume successfully. Sep 28 12:01:48 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bca6c531-bc05-48b1-9ec3-31e70610884b tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Acquiring lock "cinder-cc5d047c-d458-47d5-9e70-50cd1222124f-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:01:48 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bca6c531-bc05-48b1-9ec3-31e70610884b tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Lock "cinder-cc5d047c-d458-47d5-9e70-50cd1222124f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:01:48 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bca6c531-bc05-48b1-9ec3-31e70610884b tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Acquiring lock "cinder-quobyte-cc5d047c-d458-47d5-9e70-50cd1222124f" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:01:48 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bca6c531-bc05-48b1-9ec3-31e70610884b tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Lock "cinder-quobyte-cc5d047c-d458-47d5-9e70-50cd1222124f" acquired by "delete_volume" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:01:48 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd4a3a6-b5fc-461c-b0fe-6a46810745b6]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:01:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bca6c531-bc05-48b1-9ec3-31e70610884b tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cc5d047c-d458-47d5-9e70-50cd1222124f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:01:48 devstack sudo[104987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cc5d047c-d458-47d5-9e70-50cd1222124f Sep 28 12:01:48 devstack sudo[104987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:01:49 devstack sudo[104987]: pam_unix(sudo:session): session closed for user root Sep 28 12:01:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bca6c531-bc05-48b1-9ec3-31e70610884b tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cc5d047c-d458-47d5-9e70-50cd1222124f" returned: 0 in 0.346s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:01:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bca6c531-bc05-48b1-9ec3-31e70610884b tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cc5d047c-d458-47d5-9e70-50cd1222124f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:01:49 devstack sudo[104992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cc5d047c-d458-47d5-9e70-50cd1222124f Sep 28 12:01:49 devstack sudo[104992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:01:49 devstack sudo[104992]: pam_unix(sudo:session): session closed for user root Sep 28 12:01:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bca6c531-bc05-48b1-9ec3-31e70610884b tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-cc5d047c-d458-47d5-9e70-50cd1222124f" returned: 0 in 0.231s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:01:49 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bca6c531-bc05-48b1-9ec3-31e70610884b tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Lock "cinder-quobyte-cc5d047c-d458-47d5-9e70-50cd1222124f" released by "delete_volume" :: held 0.622s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:01:49 devstack cinder-volume[86916]: WARNING cinder.quota [None req-bca6c531-bc05-48b1-9ec3-31e70610884b tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:01:49 devstack cinder-volume[86916]: WARNING cinder.quota [None req-bca6c531-bc05-48b1-9ec3-31e70610884b tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:01:49 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-bca6c531-bc05-48b1-9ec3-31e70610884b tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Created reservations ['193ec3aa-c9b2-420a-b487-7d0ffd09a726', 'c0137737-d344-42f7-8a17-bf616c193ea3', '9ec41b7a-6b46-4668-a614-0021d239eab3', '9d71986c-366d-4e1e-9938-caae354ee4e2'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:01:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bca6c531-bc05-48b1-9ec3-31e70610884b tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:01:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bca6c531-bc05-48b1-9ec3-31e70610884b tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:01:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bca6c531-bc05-48b1-9ec3-31e70610884b tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:01:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bca6c531-bc05-48b1-9ec3-31e70610884b tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:01:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bca6c531-bc05-48b1-9ec3-31e70610884b tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:01:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bca6c531-bc05-48b1-9ec3-31e70610884b tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:01:49 devstack sudo[104995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:01:49 devstack sudo[104995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:01:49 devstack sudo[104995]: pam_unix(sudo:session): session closed for user root Sep 28 12:01:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bca6c531-bc05-48b1-9ec3-31e70610884b tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.322s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:01:49 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-bca6c531-bc05-48b1-9ec3-31e70610884b tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:01:49 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-bca6c531-bc05-48b1-9ec3-31e70610884b tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Deleted volume successfully. Sep 28 12:01:49 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bca6c531-bc05-48b1-9ec3-31e70610884b tempest-VolumeAndVolumeTypeFromImageTest-1584655867 None] Lock "cinder-cc5d047c-d458-47d5-9e70-50cd1222124f-delete_volume" released by "delete_volume" :: held 1.157s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:01:54 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-26aa2c0a-4370-49e8-8ab4-68d6717833d8 tempest-CreateVolumesFromImageTest-1246191653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:01:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-26aa2c0a-4370-49e8-8ab4-68d6717833d8 tempest-CreateVolumesFromImageTest-1246191653 None] Flow 'volume_create_manager' (2ef03c79-f85c-46cb-bb41-8746fcc2248e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:01:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-26aa2c0a-4370-49e8-8ab4-68d6717833d8 tempest-CreateVolumesFromImageTest-1246191653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3766284-7bf0-466b-9612-c0d37b6aeda0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:01:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-26aa2c0a-4370-49e8-8ab4-68d6717833d8 tempest-CreateVolumesFromImageTest-1246191653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3766284-7bf0-466b-9612-c0d37b6aeda0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:01:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1840739169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a6f9322-b190-4df6-9a6d-b5b8c554cf2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9c784f9d0f34228b7dcb6a7fcba75e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:01:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:01:55Z,use_quota=True,user_id='e011fb4de6ea4acbacc08b939d613ae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:01:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-26aa2c0a-4370-49e8-8ab4-68d6717833d8 tempest-CreateVolumesFromImageTest-1246191653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bfb6cc0-6248-48c2-b4a9-80f66a100482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:01:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-26aa2c0a-4370-49e8-8ab4-68d6717833d8 tempest-CreateVolumesFromImageTest-1246191653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bfb6cc0-6248-48c2-b4a9-80f66a100482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:01:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-26aa2c0a-4370-49e8-8ab4-68d6717833d8 tempest-CreateVolumesFromImageTest-1246191653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c6247f1-8f48-4ce6-93cf-783685e66dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:01:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-26aa2c0a-4370-49e8-8ab4-68d6717833d8 tempest-CreateVolumesFromImageTest-1246191653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c6247f1-8f48-4ce6-93cf-783685e66dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a6f9322-b190-4df6-9a6d-b5b8c554cf2e', 'volume_name': 'volume-5a6f9322-b190-4df6-9a6d-b5b8c554cf2e', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:01:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-26aa2c0a-4370-49e8-8ab4-68d6717833d8 tempest-CreateVolumesFromImageTest-1246191653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aa4287f-951b-4f2e-86b2-204d63cc78e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:01:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-26aa2c0a-4370-49e8-8ab4-68d6717833d8 tempest-CreateVolumesFromImageTest-1246191653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aa4287f-951b-4f2e-86b2-204d63cc78e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:01:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-26aa2c0a-4370-49e8-8ab4-68d6717833d8 tempest-CreateVolumesFromImageTest-1246191653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (292c3c95-6a49-4ffd-a593-108c1bd14115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:01:54 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-26aa2c0a-4370-49e8-8ab4-68d6717833d8 tempest-CreateVolumesFromImageTest-1246191653 None] Volume 5a6f9322-b190-4df6-9a6d-b5b8c554cf2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a6f9322-b190-4df6-9a6d-b5b8c554cf2e', 'volume_size': 1} Sep 28 12:01:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-26aa2c0a-4370-49e8-8ab4-68d6717833d8 tempest-CreateVolumesFromImageTest-1246191653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:01:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-26aa2c0a-4370-49e8-8ab4-68d6717833d8 tempest-CreateVolumesFromImageTest-1246191653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:01:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-26aa2c0a-4370-49e8-8ab4-68d6717833d8 tempest-CreateVolumesFromImageTest-1246191653 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:01:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1840739169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a6f9322-b190-4df6-9a6d-b5b8c554cf2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9c784f9d0f34228b7dcb6a7fcba75e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:01:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:01:55Z,use_quota=True,user_id='e011fb4de6ea4acbacc08b939d613ae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:01:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-26aa2c0a-4370-49e8-8ab4-68d6717833d8 tempest-CreateVolumesFromImageTest-1246191653 None] Creating volume 5a6f9322-b190-4df6-9a6d-b5b8c554cf2e {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:01:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-26aa2c0a-4370-49e8-8ab4-68d6717833d8 tempest-CreateVolumesFromImageTest-1246191653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:01:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-26aa2c0a-4370-49e8-8ab4-68d6717833d8 tempest-CreateVolumesFromImageTest-1246191653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:01:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-26aa2c0a-4370-49e8-8ab4-68d6717833d8 tempest-CreateVolumesFromImageTest-1246191653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:01:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-26aa2c0a-4370-49e8-8ab4-68d6717833d8 tempest-CreateVolumesFromImageTest-1246191653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:01:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-26aa2c0a-4370-49e8-8ab4-68d6717833d8 tempest-CreateVolumesFromImageTest-1246191653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:01:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-26aa2c0a-4370-49e8-8ab4-68d6717833d8 tempest-CreateVolumesFromImageTest-1246191653 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:01:54 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-26aa2c0a-4370-49e8-8ab4-68d6717833d8 tempest-CreateVolumesFromImageTest-1246191653 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:01:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-26aa2c0a-4370-49e8-8ab4-68d6717833d8 tempest-CreateVolumesFromImageTest-1246191653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5a6f9322-b190-4df6-9a6d-b5b8c554cf2e 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:01:54 devstack sudo[105002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5a6f9322-b190-4df6-9a6d-b5b8c554cf2e 1073741824 Sep 28 12:01:54 devstack sudo[105002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:01:55 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-2172d135-14b1-46a6-bf7a-5dc5d80ef501 tempest-CreateVolumesFromImageTest-1246191653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:01:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2172d135-14b1-46a6-bf7a-5dc5d80ef501 tempest-CreateVolumesFromImageTest-1246191653 None] Flow 'volume_create_manager' (9b3c5e24-610c-4de8-a8c0-bdad5b67876f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:01:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2172d135-14b1-46a6-bf7a-5dc5d80ef501 tempest-CreateVolumesFromImageTest-1246191653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (188cd9b5-6c9f-4b07-81bb-554d42ce60c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:01:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2172d135-14b1-46a6-bf7a-5dc5d80ef501 tempest-CreateVolumesFromImageTest-1246191653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (188cd9b5-6c9f-4b07-81bb-554d42ce60c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:01:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2060265243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a19c041-58ea-496a-9c58-589dc1e6b31f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9c784f9d0f34228b7dcb6a7fcba75e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:01:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:01:55Z,use_quota=True,user_id='e011fb4de6ea4acbacc08b939d613ae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:01:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2172d135-14b1-46a6-bf7a-5dc5d80ef501 tempest-CreateVolumesFromImageTest-1246191653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b23c552-6f47-4151-af8a-14ccd68acf4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:01:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2172d135-14b1-46a6-bf7a-5dc5d80ef501 tempest-CreateVolumesFromImageTest-1246191653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b23c552-6f47-4151-af8a-14ccd68acf4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:01:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2172d135-14b1-46a6-bf7a-5dc5d80ef501 tempest-CreateVolumesFromImageTest-1246191653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bab81baa-99c2-4194-be12-44a4260588c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:01:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2172d135-14b1-46a6-bf7a-5dc5d80ef501 tempest-CreateVolumesFromImageTest-1246191653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bab81baa-99c2-4194-be12-44a4260588c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a19c041-58ea-496a-9c58-589dc1e6b31f', 'volume_name': 'volume-2a19c041-58ea-496a-9c58-589dc1e6b31f', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:01:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2172d135-14b1-46a6-bf7a-5dc5d80ef501 tempest-CreateVolumesFromImageTest-1246191653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (531aebcb-2285-434c-99b1-7992edbc86bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:01:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2172d135-14b1-46a6-bf7a-5dc5d80ef501 tempest-CreateVolumesFromImageTest-1246191653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (531aebcb-2285-434c-99b1-7992edbc86bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:01:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2172d135-14b1-46a6-bf7a-5dc5d80ef501 tempest-CreateVolumesFromImageTest-1246191653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3c6b915-f37d-4a55-b091-bf9dd26cb186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:01:55 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-2172d135-14b1-46a6-bf7a-5dc5d80ef501 tempest-CreateVolumesFromImageTest-1246191653 None] Volume 2a19c041-58ea-496a-9c58-589dc1e6b31f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a19c041-58ea-496a-9c58-589dc1e6b31f', 'volume_size': 1} Sep 28 12:01:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2172d135-14b1-46a6-bf7a-5dc5d80ef501 tempest-CreateVolumesFromImageTest-1246191653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:01:55 devstack sudo[105002]: pam_unix(sudo:session): session closed for user root Sep 28 12:01:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-26aa2c0a-4370-49e8-8ab4-68d6717833d8 tempest-CreateVolumesFromImageTest-1246191653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5a6f9322-b190-4df6-9a6d-b5b8c554cf2e 1073741824" returned: 0 in 0.735s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:01:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-26aa2c0a-4370-49e8-8ab4-68d6717833d8 tempest-CreateVolumesFromImageTest-1246191653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5a6f9322-b190-4df6-9a6d-b5b8c554cf2e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:01:55 devstack sudo[105009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5a6f9322-b190-4df6-9a6d-b5b8c554cf2e Sep 28 12:01:55 devstack sudo[105009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:01:55 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f502557-f9e2-4122-831d-12fa44dd1672 tempest-CreateVolumesFromImageTest-1246191653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:01:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2f502557-f9e2-4122-831d-12fa44dd1672 tempest-CreateVolumesFromImageTest-1246191653 None] Flow 'volume_create_manager' (ec9d6dac-ebb7-4280-9514-d0c4d704c1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:01:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2f502557-f9e2-4122-831d-12fa44dd1672 tempest-CreateVolumesFromImageTest-1246191653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2d41b85-9f7b-4496-80a2-aeee3dc39842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:01:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2f502557-f9e2-4122-831d-12fa44dd1672 tempest-CreateVolumesFromImageTest-1246191653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2d41b85-9f7b-4496-80a2-aeee3dc39842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:01:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1881902995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3a9c7c3-6cee-4011-9e6b-3112b94c1456,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9c784f9d0f34228b7dcb6a7fcba75e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:01:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:01:55Z,use_quota=True,user_id='e011fb4de6ea4acbacc08b939d613ae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:01:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2f502557-f9e2-4122-831d-12fa44dd1672 tempest-CreateVolumesFromImageTest-1246191653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8815f268-b35a-4bb2-ac04-ac01eb2e5a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:01:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2f502557-f9e2-4122-831d-12fa44dd1672 tempest-CreateVolumesFromImageTest-1246191653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8815f268-b35a-4bb2-ac04-ac01eb2e5a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:01:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2f502557-f9e2-4122-831d-12fa44dd1672 tempest-CreateVolumesFromImageTest-1246191653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cef3f66-1ac7-4eea-ab4d-9707b205efe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:01:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2f502557-f9e2-4122-831d-12fa44dd1672 tempest-CreateVolumesFromImageTest-1246191653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cef3f66-1ac7-4eea-ab4d-9707b205efe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3a9c7c3-6cee-4011-9e6b-3112b94c1456', 'volume_name': 'volume-a3a9c7c3-6cee-4011-9e6b-3112b94c1456', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:01:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2f502557-f9e2-4122-831d-12fa44dd1672 tempest-CreateVolumesFromImageTest-1246191653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54cc6644-6ddc-4cc8-a5c3-5bfc4dce544a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:01:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2f502557-f9e2-4122-831d-12fa44dd1672 tempest-CreateVolumesFromImageTest-1246191653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54cc6644-6ddc-4cc8-a5c3-5bfc4dce544a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:01:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2f502557-f9e2-4122-831d-12fa44dd1672 tempest-CreateVolumesFromImageTest-1246191653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6cf4a06-cd3d-4abb-87f0-4b03c0016969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:01:55 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-2f502557-f9e2-4122-831d-12fa44dd1672 tempest-CreateVolumesFromImageTest-1246191653 None] Volume a3a9c7c3-6cee-4011-9e6b-3112b94c1456: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3a9c7c3-6cee-4011-9e6b-3112b94c1456', 'volume_size': 1} Sep 28 12:01:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2f502557-f9e2-4122-831d-12fa44dd1672 tempest-CreateVolumesFromImageTest-1246191653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:01:55 devstack sudo[105009]: pam_unix(sudo:session): session closed for user root Sep 28 12:01:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-26aa2c0a-4370-49e8-8ab4-68d6717833d8 tempest-CreateVolumesFromImageTest-1246191653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5a6f9322-b190-4df6-9a6d-b5b8c554cf2e" returned: 0 in 0.376s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:01:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-26aa2c0a-4370-49e8-8ab4-68d6717833d8 tempest-CreateVolumesFromImageTest-1246191653 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:01:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-26aa2c0a-4370-49e8-8ab4-68d6717833d8 tempest-CreateVolumesFromImageTest-1246191653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:01:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2172d135-14b1-46a6-bf7a-5dc5d80ef501 tempest-CreateVolumesFromImageTest-1246191653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.667s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:01:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2172d135-14b1-46a6-bf7a-5dc5d80ef501 tempest-CreateVolumesFromImageTest-1246191653 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:01:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2060265243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a19c041-58ea-496a-9c58-589dc1e6b31f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9c784f9d0f34228b7dcb6a7fcba75e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:01:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:01:55Z,use_quota=True,user_id='e011fb4de6ea4acbacc08b939d613ae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:01:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-2172d135-14b1-46a6-bf7a-5dc5d80ef501 tempest-CreateVolumesFromImageTest-1246191653 None] Creating volume 2a19c041-58ea-496a-9c58-589dc1e6b31f {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:01:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2172d135-14b1-46a6-bf7a-5dc5d80ef501 tempest-CreateVolumesFromImageTest-1246191653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:01:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2172d135-14b1-46a6-bf7a-5dc5d80ef501 tempest-CreateVolumesFromImageTest-1246191653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:01:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2172d135-14b1-46a6-bf7a-5dc5d80ef501 tempest-CreateVolumesFromImageTest-1246191653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:01:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2172d135-14b1-46a6-bf7a-5dc5d80ef501 tempest-CreateVolumesFromImageTest-1246191653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:01:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2172d135-14b1-46a6-bf7a-5dc5d80ef501 tempest-CreateVolumesFromImageTest-1246191653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:01:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2172d135-14b1-46a6-bf7a-5dc5d80ef501 tempest-CreateVolumesFromImageTest-1246191653 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:01:55 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-2172d135-14b1-46a6-bf7a-5dc5d80ef501 tempest-CreateVolumesFromImageTest-1246191653 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:01:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2172d135-14b1-46a6-bf7a-5dc5d80ef501 tempest-CreateVolumesFromImageTest-1246191653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2a19c041-58ea-496a-9c58-589dc1e6b31f 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:01:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-26aa2c0a-4370-49e8-8ab4-68d6717833d8 tempest-CreateVolumesFromImageTest-1246191653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (292c3c95-6a49-4ffd-a593-108c1bd14115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a6f9322-b190-4df6-9a6d-b5b8c554cf2e', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:01:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-26aa2c0a-4370-49e8-8ab4-68d6717833d8 tempest-CreateVolumesFromImageTest-1246191653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28a36442-d231-4c37-8dac-a2948ec79d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:01:55 devstack sudo[105012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2a19c041-58ea-496a-9c58-589dc1e6b31f 1073741824 Sep 28 12:01:55 devstack sudo[105012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:01:55 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-26aa2c0a-4370-49e8-8ab4-68d6717833d8 tempest-CreateVolumesFromImageTest-1246191653 None] Volume volume-5a6f9322-b190-4df6-9a6d-b5b8c554cf2e (5a6f9322-b190-4df6-9a6d-b5b8c554cf2e): created successfully Sep 28 12:01:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-26aa2c0a-4370-49e8-8ab4-68d6717833d8 tempest-CreateVolumesFromImageTest-1246191653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28a36442-d231-4c37-8dac-a2948ec79d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:01:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-26aa2c0a-4370-49e8-8ab4-68d6717833d8 tempest-CreateVolumesFromImageTest-1246191653 None] Flow 'volume_create_manager' (2ef03c79-f85c-46cb-bb41-8746fcc2248e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:01:56 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-26aa2c0a-4370-49e8-8ab4-68d6717833d8 tempest-CreateVolumesFromImageTest-1246191653 None] Created volume successfully. Sep 28 12:01:56 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3dcf96f-2ce2-47d0-8249-9f6d63682cb9 tempest-CreateVolumesFromImageTest-1246191653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:01:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c3dcf96f-2ce2-47d0-8249-9f6d63682cb9 tempest-CreateVolumesFromImageTest-1246191653 None] Flow 'volume_create_manager' (8e437c3e-44fb-4cc7-b1db-ad9606398a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:01:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c3dcf96f-2ce2-47d0-8249-9f6d63682cb9 tempest-CreateVolumesFromImageTest-1246191653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9226630e-5fda-4266-b511-eddd9330f463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:01:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c3dcf96f-2ce2-47d0-8249-9f6d63682cb9 tempest-CreateVolumesFromImageTest-1246191653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9226630e-5fda-4266-b511-eddd9330f463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1799992465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc75adfc-afc5-45d9-a8dc-a851e9de1423,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9c784f9d0f34228b7dcb6a7fcba75e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:01:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:01:56Z,use_quota=True,user_id='e011fb4de6ea4acbacc08b939d613ae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:01:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c3dcf96f-2ce2-47d0-8249-9f6d63682cb9 tempest-CreateVolumesFromImageTest-1246191653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7169c049-5f5f-4102-9ab9-913218ca0799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:01:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c3dcf96f-2ce2-47d0-8249-9f6d63682cb9 tempest-CreateVolumesFromImageTest-1246191653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7169c049-5f5f-4102-9ab9-913218ca0799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:01:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c3dcf96f-2ce2-47d0-8249-9f6d63682cb9 tempest-CreateVolumesFromImageTest-1246191653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddf2546d-31a2-42fb-8862-6fdb3fa5d8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:01:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c3dcf96f-2ce2-47d0-8249-9f6d63682cb9 tempest-CreateVolumesFromImageTest-1246191653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddf2546d-31a2-42fb-8862-6fdb3fa5d8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc75adfc-afc5-45d9-a8dc-a851e9de1423', 'volume_name': 'volume-dc75adfc-afc5-45d9-a8dc-a851e9de1423', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:01:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c3dcf96f-2ce2-47d0-8249-9f6d63682cb9 tempest-CreateVolumesFromImageTest-1246191653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eec8fea9-8027-4c89-9dbc-d3f9565c9439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:01:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c3dcf96f-2ce2-47d0-8249-9f6d63682cb9 tempest-CreateVolumesFromImageTest-1246191653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eec8fea9-8027-4c89-9dbc-d3f9565c9439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:01:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c3dcf96f-2ce2-47d0-8249-9f6d63682cb9 tempest-CreateVolumesFromImageTest-1246191653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2ffa21d-127c-4bfb-8f7b-f62996af6204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:01:56 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-c3dcf96f-2ce2-47d0-8249-9f6d63682cb9 tempest-CreateVolumesFromImageTest-1246191653 None] Volume dc75adfc-afc5-45d9-a8dc-a851e9de1423: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc75adfc-afc5-45d9-a8dc-a851e9de1423', 'volume_size': 1} Sep 28 12:01:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c3dcf96f-2ce2-47d0-8249-9f6d63682cb9 tempest-CreateVolumesFromImageTest-1246191653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:01:56 devstack sudo[105012]: pam_unix(sudo:session): session closed for user root Sep 28 12:01:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2172d135-14b1-46a6-bf7a-5dc5d80ef501 tempest-CreateVolumesFromImageTest-1246191653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2a19c041-58ea-496a-9c58-589dc1e6b31f 1073741824" returned: 0 in 0.714s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:01:56 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3586374-54b2-4021-906b-4dff3ba40bba tempest-CreateVolumesFromImageTest-1246191653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:01:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c3586374-54b2-4021-906b-4dff3ba40bba tempest-CreateVolumesFromImageTest-1246191653 None] Flow 'volume_create_manager' (47f3936e-bf36-48a5-8343-2df5558aa6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:01:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c3586374-54b2-4021-906b-4dff3ba40bba tempest-CreateVolumesFromImageTest-1246191653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ac625b6-20e9-48c4-925a-b87bc9c05cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:01:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c3586374-54b2-4021-906b-4dff3ba40bba tempest-CreateVolumesFromImageTest-1246191653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ac625b6-20e9-48c4-925a-b87bc9c05cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1150718965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c23270d9-ed5a-49e8-bccc-0d80dca1dccb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9c784f9d0f34228b7dcb6a7fcba75e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:01:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:01:57Z,use_quota=True,user_id='e011fb4de6ea4acbacc08b939d613ae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:01:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c3586374-54b2-4021-906b-4dff3ba40bba tempest-CreateVolumesFromImageTest-1246191653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7598db4a-2b9f-4787-88e6-401e1f93fa53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:01:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c3586374-54b2-4021-906b-4dff3ba40bba tempest-CreateVolumesFromImageTest-1246191653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7598db4a-2b9f-4787-88e6-401e1f93fa53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:01:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c3586374-54b2-4021-906b-4dff3ba40bba tempest-CreateVolumesFromImageTest-1246191653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbc9332a-bf47-4820-9b09-dac9c6b5ce1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:01:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c3586374-54b2-4021-906b-4dff3ba40bba tempest-CreateVolumesFromImageTest-1246191653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbc9332a-bf47-4820-9b09-dac9c6b5ce1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c23270d9-ed5a-49e8-bccc-0d80dca1dccb', 'volume_name': 'volume-c23270d9-ed5a-49e8-bccc-0d80dca1dccb', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:01:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c3586374-54b2-4021-906b-4dff3ba40bba tempest-CreateVolumesFromImageTest-1246191653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a26fb335-85c3-4991-aa88-962d8c7e97bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:01:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c3586374-54b2-4021-906b-4dff3ba40bba tempest-CreateVolumesFromImageTest-1246191653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a26fb335-85c3-4991-aa88-962d8c7e97bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:01:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c3586374-54b2-4021-906b-4dff3ba40bba tempest-CreateVolumesFromImageTest-1246191653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (014700ee-d7c7-41ce-b456-6276c5ff4f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:01:56 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-c3586374-54b2-4021-906b-4dff3ba40bba tempest-CreateVolumesFromImageTest-1246191653 None] Volume c23270d9-ed5a-49e8-bccc-0d80dca1dccb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c23270d9-ed5a-49e8-bccc-0d80dca1dccb', 'volume_size': 1} Sep 28 12:01:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c3586374-54b2-4021-906b-4dff3ba40bba tempest-CreateVolumesFromImageTest-1246191653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:01:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2172d135-14b1-46a6-bf7a-5dc5d80ef501 tempest-CreateVolumesFromImageTest-1246191653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2a19c041-58ea-496a-9c58-589dc1e6b31f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:01:56 devstack sudo[105020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2a19c041-58ea-496a-9c58-589dc1e6b31f Sep 28 12:01:56 devstack sudo[105020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:01:57 devstack sudo[105020]: pam_unix(sudo:session): session closed for user root Sep 28 12:01:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2172d135-14b1-46a6-bf7a-5dc5d80ef501 tempest-CreateVolumesFromImageTest-1246191653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2a19c041-58ea-496a-9c58-589dc1e6b31f" returned: 0 in 0.264s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:01:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2172d135-14b1-46a6-bf7a-5dc5d80ef501 tempest-CreateVolumesFromImageTest-1246191653 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:01:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2172d135-14b1-46a6-bf7a-5dc5d80ef501 tempest-CreateVolumesFromImageTest-1246191653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:01:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2f502557-f9e2-4122-831d-12fa44dd1672 tempest-CreateVolumesFromImageTest-1246191653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.324s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:01:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2f502557-f9e2-4122-831d-12fa44dd1672 tempest-CreateVolumesFromImageTest-1246191653 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:01:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1881902995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3a9c7c3-6cee-4011-9e6b-3112b94c1456,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9c784f9d0f34228b7dcb6a7fcba75e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:01:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:01:55Z,use_quota=True,user_id='e011fb4de6ea4acbacc08b939d613ae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:01:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-2f502557-f9e2-4122-831d-12fa44dd1672 tempest-CreateVolumesFromImageTest-1246191653 None] Creating volume a3a9c7c3-6cee-4011-9e6b-3112b94c1456 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:01:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2f502557-f9e2-4122-831d-12fa44dd1672 tempest-CreateVolumesFromImageTest-1246191653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:01:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2f502557-f9e2-4122-831d-12fa44dd1672 tempest-CreateVolumesFromImageTest-1246191653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:01:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2f502557-f9e2-4122-831d-12fa44dd1672 tempest-CreateVolumesFromImageTest-1246191653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:01:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2f502557-f9e2-4122-831d-12fa44dd1672 tempest-CreateVolumesFromImageTest-1246191653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:01:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2f502557-f9e2-4122-831d-12fa44dd1672 tempest-CreateVolumesFromImageTest-1246191653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:01:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2f502557-f9e2-4122-831d-12fa44dd1672 tempest-CreateVolumesFromImageTest-1246191653 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:01:57 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-2f502557-f9e2-4122-831d-12fa44dd1672 tempest-CreateVolumesFromImageTest-1246191653 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:01:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2f502557-f9e2-4122-831d-12fa44dd1672 tempest-CreateVolumesFromImageTest-1246191653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3a9c7c3-6cee-4011-9e6b-3112b94c1456 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:01:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2172d135-14b1-46a6-bf7a-5dc5d80ef501 tempest-CreateVolumesFromImageTest-1246191653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3c6b915-f37d-4a55-b091-bf9dd26cb186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a19c041-58ea-496a-9c58-589dc1e6b31f', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:01:57 devstack sudo[105023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3a9c7c3-6cee-4011-9e6b-3112b94c1456 1073741824 Sep 28 12:01:57 devstack sudo[105023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:01:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2172d135-14b1-46a6-bf7a-5dc5d80ef501 tempest-CreateVolumesFromImageTest-1246191653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea53e422-0855-46da-8c95-d7284d90589c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:01:57 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-2172d135-14b1-46a6-bf7a-5dc5d80ef501 tempest-CreateVolumesFromImageTest-1246191653 None] Volume volume-2a19c041-58ea-496a-9c58-589dc1e6b31f (2a19c041-58ea-496a-9c58-589dc1e6b31f): created successfully Sep 28 12:01:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2172d135-14b1-46a6-bf7a-5dc5d80ef501 tempest-CreateVolumesFromImageTest-1246191653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea53e422-0855-46da-8c95-d7284d90589c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:01:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2172d135-14b1-46a6-bf7a-5dc5d80ef501 tempest-CreateVolumesFromImageTest-1246191653 None] Flow 'volume_create_manager' (9b3c5e24-610c-4de8-a8c0-bdad5b67876f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:01:57 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-2172d135-14b1-46a6-bf7a-5dc5d80ef501 tempest-CreateVolumesFromImageTest-1246191653 None] Created volume successfully. Sep 28 12:01:57 devstack sudo[105023]: pam_unix(sudo:session): session closed for user root Sep 28 12:01:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2f502557-f9e2-4122-831d-12fa44dd1672 tempest-CreateVolumesFromImageTest-1246191653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3a9c7c3-6cee-4011-9e6b-3112b94c1456 1073741824" returned: 0 in 0.493s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:01:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2f502557-f9e2-4122-831d-12fa44dd1672 tempest-CreateVolumesFromImageTest-1246191653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3a9c7c3-6cee-4011-9e6b-3112b94c1456 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:01:57 devstack sudo[105029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3a9c7c3-6cee-4011-9e6b-3112b94c1456 Sep 28 12:01:57 devstack sudo[105029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:01:57 devstack sudo[105029]: pam_unix(sudo:session): session closed for user root Sep 28 12:01:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2f502557-f9e2-4122-831d-12fa44dd1672 tempest-CreateVolumesFromImageTest-1246191653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3a9c7c3-6cee-4011-9e6b-3112b94c1456" returned: 0 in 0.254s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:01:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2f502557-f9e2-4122-831d-12fa44dd1672 tempest-CreateVolumesFromImageTest-1246191653 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:01:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2f502557-f9e2-4122-831d-12fa44dd1672 tempest-CreateVolumesFromImageTest-1246191653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:01:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c3dcf96f-2ce2-47d0-8249-9f6d63682cb9 tempest-CreateVolumesFromImageTest-1246191653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.599s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:01:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c3dcf96f-2ce2-47d0-8249-9f6d63682cb9 tempest-CreateVolumesFromImageTest-1246191653 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1799992465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc75adfc-afc5-45d9-a8dc-a851e9de1423,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9c784f9d0f34228b7dcb6a7fcba75e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:01:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:01:56Z,use_quota=True,user_id='e011fb4de6ea4acbacc08b939d613ae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:01:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-c3dcf96f-2ce2-47d0-8249-9f6d63682cb9 tempest-CreateVolumesFromImageTest-1246191653 None] Creating volume dc75adfc-afc5-45d9-a8dc-a851e9de1423 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:01:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c3dcf96f-2ce2-47d0-8249-9f6d63682cb9 tempest-CreateVolumesFromImageTest-1246191653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:01:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c3dcf96f-2ce2-47d0-8249-9f6d63682cb9 tempest-CreateVolumesFromImageTest-1246191653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:01:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c3dcf96f-2ce2-47d0-8249-9f6d63682cb9 tempest-CreateVolumesFromImageTest-1246191653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:01:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c3dcf96f-2ce2-47d0-8249-9f6d63682cb9 tempest-CreateVolumesFromImageTest-1246191653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:01:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c3dcf96f-2ce2-47d0-8249-9f6d63682cb9 tempest-CreateVolumesFromImageTest-1246191653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:01:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c3dcf96f-2ce2-47d0-8249-9f6d63682cb9 tempest-CreateVolumesFromImageTest-1246191653 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:01:57 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-c3dcf96f-2ce2-47d0-8249-9f6d63682cb9 tempest-CreateVolumesFromImageTest-1246191653 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:01:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c3dcf96f-2ce2-47d0-8249-9f6d63682cb9 tempest-CreateVolumesFromImageTest-1246191653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dc75adfc-afc5-45d9-a8dc-a851e9de1423 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:01:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2f502557-f9e2-4122-831d-12fa44dd1672 tempest-CreateVolumesFromImageTest-1246191653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6cf4a06-cd3d-4abb-87f0-4b03c0016969) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3a9c7c3-6cee-4011-9e6b-3112b94c1456', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:01:57 devstack sudo[105032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dc75adfc-afc5-45d9-a8dc-a851e9de1423 1073741824 Sep 28 12:01:57 devstack sudo[105032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:01:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2f502557-f9e2-4122-831d-12fa44dd1672 tempest-CreateVolumesFromImageTest-1246191653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60f6538f-1a80-4842-a4b3-901548b27038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:01:57 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-2f502557-f9e2-4122-831d-12fa44dd1672 tempest-CreateVolumesFromImageTest-1246191653 None] Volume volume-a3a9c7c3-6cee-4011-9e6b-3112b94c1456 (a3a9c7c3-6cee-4011-9e6b-3112b94c1456): created successfully Sep 28 12:01:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2f502557-f9e2-4122-831d-12fa44dd1672 tempest-CreateVolumesFromImageTest-1246191653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60f6538f-1a80-4842-a4b3-901548b27038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:01:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2f502557-f9e2-4122-831d-12fa44dd1672 tempest-CreateVolumesFromImageTest-1246191653 None] Flow 'volume_create_manager' (ec9d6dac-ebb7-4280-9514-d0c4d704c1f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:01:57 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-2f502557-f9e2-4122-831d-12fa44dd1672 tempest-CreateVolumesFromImageTest-1246191653 None] Created volume successfully. Sep 28 12:01:58 devstack sudo[105032]: pam_unix(sudo:session): session closed for user root Sep 28 12:01:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c3dcf96f-2ce2-47d0-8249-9f6d63682cb9 tempest-CreateVolumesFromImageTest-1246191653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dc75adfc-afc5-45d9-a8dc-a851e9de1423 1073741824" returned: 0 in 0.482s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:01:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c3dcf96f-2ce2-47d0-8249-9f6d63682cb9 tempest-CreateVolumesFromImageTest-1246191653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dc75adfc-afc5-45d9-a8dc-a851e9de1423 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:01:58 devstack sudo[105037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dc75adfc-afc5-45d9-a8dc-a851e9de1423 Sep 28 12:01:58 devstack sudo[105037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:01:58 devstack sudo[105037]: pam_unix(sudo:session): session closed for user root Sep 28 12:01:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c3dcf96f-2ce2-47d0-8249-9f6d63682cb9 tempest-CreateVolumesFromImageTest-1246191653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dc75adfc-afc5-45d9-a8dc-a851e9de1423" returned: 0 in 0.253s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:01:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c3dcf96f-2ce2-47d0-8249-9f6d63682cb9 tempest-CreateVolumesFromImageTest-1246191653 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:01:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c3dcf96f-2ce2-47d0-8249-9f6d63682cb9 tempest-CreateVolumesFromImageTest-1246191653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:01:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c3586374-54b2-4021-906b-4dff3ba40bba tempest-CreateVolumesFromImageTest-1246191653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.860s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:01:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c3586374-54b2-4021-906b-4dff3ba40bba tempest-CreateVolumesFromImageTest-1246191653 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1150718965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c23270d9-ed5a-49e8-bccc-0d80dca1dccb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9c784f9d0f34228b7dcb6a7fcba75e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:01:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:01:57Z,use_quota=True,user_id='e011fb4de6ea4acbacc08b939d613ae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:01:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-c3586374-54b2-4021-906b-4dff3ba40bba tempest-CreateVolumesFromImageTest-1246191653 None] Creating volume c23270d9-ed5a-49e8-bccc-0d80dca1dccb {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:01:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c3586374-54b2-4021-906b-4dff3ba40bba tempest-CreateVolumesFromImageTest-1246191653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:01:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c3586374-54b2-4021-906b-4dff3ba40bba tempest-CreateVolumesFromImageTest-1246191653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:01:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c3586374-54b2-4021-906b-4dff3ba40bba tempest-CreateVolumesFromImageTest-1246191653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:01:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c3586374-54b2-4021-906b-4dff3ba40bba tempest-CreateVolumesFromImageTest-1246191653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:01:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c3586374-54b2-4021-906b-4dff3ba40bba tempest-CreateVolumesFromImageTest-1246191653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:01:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c3586374-54b2-4021-906b-4dff3ba40bba tempest-CreateVolumesFromImageTest-1246191653 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:01:58 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-c3586374-54b2-4021-906b-4dff3ba40bba tempest-CreateVolumesFromImageTest-1246191653 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:01:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c3586374-54b2-4021-906b-4dff3ba40bba tempest-CreateVolumesFromImageTest-1246191653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c23270d9-ed5a-49e8-bccc-0d80dca1dccb 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:01:58 devstack sudo[105040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c23270d9-ed5a-49e8-bccc-0d80dca1dccb 1073741824 Sep 28 12:01:58 devstack sudo[105040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:01:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c3dcf96f-2ce2-47d0-8249-9f6d63682cb9 tempest-CreateVolumesFromImageTest-1246191653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2ffa21d-127c-4bfb-8f7b-f62996af6204) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc75adfc-afc5-45d9-a8dc-a851e9de1423', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:01:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c3dcf96f-2ce2-47d0-8249-9f6d63682cb9 tempest-CreateVolumesFromImageTest-1246191653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (874f3f80-b737-4677-8ff1-d61433203b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:01:58 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-c3dcf96f-2ce2-47d0-8249-9f6d63682cb9 tempest-CreateVolumesFromImageTest-1246191653 None] Volume volume-dc75adfc-afc5-45d9-a8dc-a851e9de1423 (dc75adfc-afc5-45d9-a8dc-a851e9de1423): created successfully Sep 28 12:01:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c3dcf96f-2ce2-47d0-8249-9f6d63682cb9 tempest-CreateVolumesFromImageTest-1246191653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (874f3f80-b737-4677-8ff1-d61433203b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:01:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c3dcf96f-2ce2-47d0-8249-9f6d63682cb9 tempest-CreateVolumesFromImageTest-1246191653 None] Flow 'volume_create_manager' (8e437c3e-44fb-4cc7-b1db-ad9606398a28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:01:58 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-c3dcf96f-2ce2-47d0-8249-9f6d63682cb9 tempest-CreateVolumesFromImageTest-1246191653 None] Created volume successfully. Sep 28 12:01:59 devstack sudo[105040]: pam_unix(sudo:session): session closed for user root Sep 28 12:01:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c3586374-54b2-4021-906b-4dff3ba40bba tempest-CreateVolumesFromImageTest-1246191653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c23270d9-ed5a-49e8-bccc-0d80dca1dccb 1073741824" returned: 0 in 0.540s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:01:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c3586374-54b2-4021-906b-4dff3ba40bba tempest-CreateVolumesFromImageTest-1246191653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c23270d9-ed5a-49e8-bccc-0d80dca1dccb {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:01:59 devstack sudo[105046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c23270d9-ed5a-49e8-bccc-0d80dca1dccb Sep 28 12:01:59 devstack sudo[105046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:01:59 devstack sudo[105046]: pam_unix(sudo:session): session closed for user root Sep 28 12:01:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c3586374-54b2-4021-906b-4dff3ba40bba tempest-CreateVolumesFromImageTest-1246191653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c23270d9-ed5a-49e8-bccc-0d80dca1dccb" returned: 0 in 0.275s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:01:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c3586374-54b2-4021-906b-4dff3ba40bba tempest-CreateVolumesFromImageTest-1246191653 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:01:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c3586374-54b2-4021-906b-4dff3ba40bba tempest-CreateVolumesFromImageTest-1246191653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:01:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c3586374-54b2-4021-906b-4dff3ba40bba tempest-CreateVolumesFromImageTest-1246191653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (014700ee-d7c7-41ce-b456-6276c5ff4f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c23270d9-ed5a-49e8-bccc-0d80dca1dccb', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:01:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c3586374-54b2-4021-906b-4dff3ba40bba tempest-CreateVolumesFromImageTest-1246191653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e0d907a-3de0-4b96-96fd-7e4cf2a84dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:01:59 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-c3586374-54b2-4021-906b-4dff3ba40bba tempest-CreateVolumesFromImageTest-1246191653 None] Volume volume-c23270d9-ed5a-49e8-bccc-0d80dca1dccb (c23270d9-ed5a-49e8-bccc-0d80dca1dccb): created successfully Sep 28 12:01:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c3586374-54b2-4021-906b-4dff3ba40bba tempest-CreateVolumesFromImageTest-1246191653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e0d907a-3de0-4b96-96fd-7e4cf2a84dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:01:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c3586374-54b2-4021-906b-4dff3ba40bba tempest-CreateVolumesFromImageTest-1246191653 None] Flow 'volume_create_manager' (47f3936e-bf36-48a5-8343-2df5558aa6e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:01:59 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-c3586374-54b2-4021-906b-4dff3ba40bba tempest-CreateVolumesFromImageTest-1246191653 None] Created volume successfully. Sep 28 12:02:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b5ae4985-4522-4080-ab9b-a618d6336454 tempest-CreateVolumesFromImageTest-1246191653 None] Acquiring lock "cinder-c23270d9-ed5a-49e8-bccc-0d80dca1dccb-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:02:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b5ae4985-4522-4080-ab9b-a618d6336454 tempest-CreateVolumesFromImageTest-1246191653 None] Lock "cinder-c23270d9-ed5a-49e8-bccc-0d80dca1dccb-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:02:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b5ae4985-4522-4080-ab9b-a618d6336454 tempest-CreateVolumesFromImageTest-1246191653 None] Acquiring lock "cinder-quobyte-c23270d9-ed5a-49e8-bccc-0d80dca1dccb" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:02:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b5ae4985-4522-4080-ab9b-a618d6336454 tempest-CreateVolumesFromImageTest-1246191653 None] Lock "cinder-quobyte-c23270d9-ed5a-49e8-bccc-0d80dca1dccb" acquired by "delete_volume" :: waited 0.028s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:02:00 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa08795c-456f-4c4c-9854-f42b495fa54c]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:02:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b5ae4985-4522-4080-ab9b-a618d6336454 tempest-CreateVolumesFromImageTest-1246191653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c23270d9-ed5a-49e8-bccc-0d80dca1dccb {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:02:00 devstack sudo[105050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c23270d9-ed5a-49e8-bccc-0d80dca1dccb Sep 28 12:02:00 devstack sudo[105050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:02:00 devstack sudo[105050]: pam_unix(sudo:session): session closed for user root Sep 28 12:02:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b5ae4985-4522-4080-ab9b-a618d6336454 tempest-CreateVolumesFromImageTest-1246191653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c23270d9-ed5a-49e8-bccc-0d80dca1dccb" returned: 0 in 0.422s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:02:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b5ae4985-4522-4080-ab9b-a618d6336454 tempest-CreateVolumesFromImageTest-1246191653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c23270d9-ed5a-49e8-bccc-0d80dca1dccb {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:02:00 devstack sudo[105055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c23270d9-ed5a-49e8-bccc-0d80dca1dccb Sep 28 12:02:00 devstack sudo[105055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:02:01 devstack sudo[105055]: pam_unix(sudo:session): session closed for user root Sep 28 12:02:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b5ae4985-4522-4080-ab9b-a618d6336454 tempest-CreateVolumesFromImageTest-1246191653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c23270d9-ed5a-49e8-bccc-0d80dca1dccb" returned: 0 in 0.282s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:02:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b5ae4985-4522-4080-ab9b-a618d6336454 tempest-CreateVolumesFromImageTest-1246191653 None] Lock "cinder-quobyte-c23270d9-ed5a-49e8-bccc-0d80dca1dccb" released by "delete_volume" :: held 0.765s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:02:01 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-b5ae4985-4522-4080-ab9b-a618d6336454 tempest-CreateVolumesFromImageTest-1246191653 None] Created reservations ['aa038002-5456-41fc-bf6a-70d44c8bc65b', '4e0b46c5-efd8-40c3-981c-d2c296da823e', '66908e01-63d9-4387-9ed7-8274769abeeb', '7c0ba3d5-001a-41fd-aa5c-2931683b868f'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:02:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b5ae4985-4522-4080-ab9b-a618d6336454 tempest-CreateVolumesFromImageTest-1246191653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:02:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b5ae4985-4522-4080-ab9b-a618d6336454 tempest-CreateVolumesFromImageTest-1246191653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:02:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b5ae4985-4522-4080-ab9b-a618d6336454 tempest-CreateVolumesFromImageTest-1246191653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:02:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b5ae4985-4522-4080-ab9b-a618d6336454 tempest-CreateVolumesFromImageTest-1246191653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:02:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b5ae4985-4522-4080-ab9b-a618d6336454 tempest-CreateVolumesFromImageTest-1246191653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:02:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b5ae4985-4522-4080-ab9b-a618d6336454 tempest-CreateVolumesFromImageTest-1246191653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:02:01 devstack sudo[105058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:02:01 devstack sudo[105058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:02:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d2555c09-17bc-43a6-8478-ecca74e6552c tempest-CreateVolumesFromImageTest-1246191653 None] Acquiring lock "cinder-dc75adfc-afc5-45d9-a8dc-a851e9de1423-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:02:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d2555c09-17bc-43a6-8478-ecca74e6552c tempest-CreateVolumesFromImageTest-1246191653 None] Lock "cinder-dc75adfc-afc5-45d9-a8dc-a851e9de1423-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:02:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d2555c09-17bc-43a6-8478-ecca74e6552c tempest-CreateVolumesFromImageTest-1246191653 None] Acquiring lock "cinder-quobyte-dc75adfc-afc5-45d9-a8dc-a851e9de1423" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:02:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d2555c09-17bc-43a6-8478-ecca74e6552c tempest-CreateVolumesFromImageTest-1246191653 None] Lock "cinder-quobyte-dc75adfc-afc5-45d9-a8dc-a851e9de1423" acquired by "delete_volume" :: waited 0.023s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:02:01 devstack sudo[105058]: pam_unix(sudo:session): session closed for user root Sep 28 12:02:01 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d65cce-b522-4c51-add4-b99ca8e4f211]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:02:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d2555c09-17bc-43a6-8478-ecca74e6552c tempest-CreateVolumesFromImageTest-1246191653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dc75adfc-afc5-45d9-a8dc-a851e9de1423 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:02:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b5ae4985-4522-4080-ab9b-a618d6336454 tempest-CreateVolumesFromImageTest-1246191653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.332s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:02:01 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-b5ae4985-4522-4080-ab9b-a618d6336454 tempest-CreateVolumesFromImageTest-1246191653 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:02:01 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b5ae4985-4522-4080-ab9b-a618d6336454 tempest-CreateVolumesFromImageTest-1246191653 None] Deleted volume successfully. Sep 28 12:02:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b5ae4985-4522-4080-ab9b-a618d6336454 tempest-CreateVolumesFromImageTest-1246191653 None] Lock "cinder-c23270d9-ed5a-49e8-bccc-0d80dca1dccb-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:02:01 devstack sudo[105061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dc75adfc-afc5-45d9-a8dc-a851e9de1423 Sep 28 12:02:01 devstack sudo[105061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:02:01 devstack sudo[105061]: pam_unix(sudo:session): session closed for user root Sep 28 12:02:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d2555c09-17bc-43a6-8478-ecca74e6552c tempest-CreateVolumesFromImageTest-1246191653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dc75adfc-afc5-45d9-a8dc-a851e9de1423" returned: 0 in 0.431s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:02:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d2555c09-17bc-43a6-8478-ecca74e6552c tempest-CreateVolumesFromImageTest-1246191653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dc75adfc-afc5-45d9-a8dc-a851e9de1423 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:02:01 devstack sudo[105066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dc75adfc-afc5-45d9-a8dc-a851e9de1423 Sep 28 12:02:01 devstack sudo[105066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:02:02 devstack sudo[105066]: pam_unix(sudo:session): session closed for user root Sep 28 12:02:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d2555c09-17bc-43a6-8478-ecca74e6552c tempest-CreateVolumesFromImageTest-1246191653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dc75adfc-afc5-45d9-a8dc-a851e9de1423" returned: 0 in 0.280s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:02:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d2555c09-17bc-43a6-8478-ecca74e6552c tempest-CreateVolumesFromImageTest-1246191653 None] Lock "cinder-quobyte-dc75adfc-afc5-45d9-a8dc-a851e9de1423" released by "delete_volume" :: held 0.764s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:02:02 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-d2555c09-17bc-43a6-8478-ecca74e6552c tempest-CreateVolumesFromImageTest-1246191653 None] Created reservations ['cdebcac5-50b1-4377-8a03-20a2bafce1e1', '0d4ddbf7-32a7-4da4-88c0-b19e6509def6', '43634c01-250a-4757-9324-8dc8065eb968', '40a95c7c-1a36-4294-9a0f-03dd14f9bfb0'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:02:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d2555c09-17bc-43a6-8478-ecca74e6552c tempest-CreateVolumesFromImageTest-1246191653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:02:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d2555c09-17bc-43a6-8478-ecca74e6552c tempest-CreateVolumesFromImageTest-1246191653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:02:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d2555c09-17bc-43a6-8478-ecca74e6552c tempest-CreateVolumesFromImageTest-1246191653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:02:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d2555c09-17bc-43a6-8478-ecca74e6552c tempest-CreateVolumesFromImageTest-1246191653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:02:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d2555c09-17bc-43a6-8478-ecca74e6552c tempest-CreateVolumesFromImageTest-1246191653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:02:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d2555c09-17bc-43a6-8478-ecca74e6552c tempest-CreateVolumesFromImageTest-1246191653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:02:02 devstack sudo[105069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:02:02 devstack sudo[105069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:02:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1dc2fa2c-5608-4fee-bf80-68265974d1d3 tempest-CreateVolumesFromImageTest-1246191653 None] Acquiring lock "cinder-a3a9c7c3-6cee-4011-9e6b-3112b94c1456-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:02:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1dc2fa2c-5608-4fee-bf80-68265974d1d3 tempest-CreateVolumesFromImageTest-1246191653 None] Lock "cinder-a3a9c7c3-6cee-4011-9e6b-3112b94c1456-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:02:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1dc2fa2c-5608-4fee-bf80-68265974d1d3 tempest-CreateVolumesFromImageTest-1246191653 None] Acquiring lock "cinder-quobyte-a3a9c7c3-6cee-4011-9e6b-3112b94c1456" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:02:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1dc2fa2c-5608-4fee-bf80-68265974d1d3 tempest-CreateVolumesFromImageTest-1246191653 None] Lock "cinder-quobyte-a3a9c7c3-6cee-4011-9e6b-3112b94c1456" acquired by "delete_volume" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:02:02 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01a087c-1482-458a-84b6-20070e576013]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:02:02 devstack sudo[105069]: pam_unix(sudo:session): session closed for user root Sep 28 12:02:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1dc2fa2c-5608-4fee-bf80-68265974d1d3 tempest-CreateVolumesFromImageTest-1246191653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3a9c7c3-6cee-4011-9e6b-3112b94c1456 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:02:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d2555c09-17bc-43a6-8478-ecca74e6552c tempest-CreateVolumesFromImageTest-1246191653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.353s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:02:02 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-d2555c09-17bc-43a6-8478-ecca74e6552c tempest-CreateVolumesFromImageTest-1246191653 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:02:02 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-d2555c09-17bc-43a6-8478-ecca74e6552c tempest-CreateVolumesFromImageTest-1246191653 None] Deleted volume successfully. Sep 28 12:02:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d2555c09-17bc-43a6-8478-ecca74e6552c tempest-CreateVolumesFromImageTest-1246191653 None] Lock "cinder-dc75adfc-afc5-45d9-a8dc-a851e9de1423-delete_volume" released by "delete_volume" :: held 1.402s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:02:02 devstack sudo[105072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3a9c7c3-6cee-4011-9e6b-3112b94c1456 Sep 28 12:02:02 devstack sudo[105072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:02:03 devstack sudo[105072]: pam_unix(sudo:session): session closed for user root Sep 28 12:02:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1dc2fa2c-5608-4fee-bf80-68265974d1d3 tempest-CreateVolumesFromImageTest-1246191653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3a9c7c3-6cee-4011-9e6b-3112b94c1456" returned: 0 in 0.427s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:02:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1dc2fa2c-5608-4fee-bf80-68265974d1d3 tempest-CreateVolumesFromImageTest-1246191653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3a9c7c3-6cee-4011-9e6b-3112b94c1456 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:02:03 devstack sudo[105077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3a9c7c3-6cee-4011-9e6b-3112b94c1456 Sep 28 12:02:03 devstack sudo[105077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:02:03 devstack sudo[105077]: pam_unix(sudo:session): session closed for user root Sep 28 12:02:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1dc2fa2c-5608-4fee-bf80-68265974d1d3 tempest-CreateVolumesFromImageTest-1246191653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3a9c7c3-6cee-4011-9e6b-3112b94c1456" returned: 0 in 0.244s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:02:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1dc2fa2c-5608-4fee-bf80-68265974d1d3 tempest-CreateVolumesFromImageTest-1246191653 None] Lock "cinder-quobyte-a3a9c7c3-6cee-4011-9e6b-3112b94c1456" released by "delete_volume" :: held 0.727s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:02:03 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-1dc2fa2c-5608-4fee-bf80-68265974d1d3 tempest-CreateVolumesFromImageTest-1246191653 None] Created reservations ['ceaa3568-464a-4813-9646-474c4b2c5765', '86aaa102-9d28-4639-8cba-50fbe4032f56', 'c2987998-7c15-4de2-a6d8-ff80246c2cad', '4cc85153-92b1-4598-9309-6d84c0902b35'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:02:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1dc2fa2c-5608-4fee-bf80-68265974d1d3 tempest-CreateVolumesFromImageTest-1246191653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:02:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1dc2fa2c-5608-4fee-bf80-68265974d1d3 tempest-CreateVolumesFromImageTest-1246191653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:02:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1dc2fa2c-5608-4fee-bf80-68265974d1d3 tempest-CreateVolumesFromImageTest-1246191653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:02:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1dc2fa2c-5608-4fee-bf80-68265974d1d3 tempest-CreateVolumesFromImageTest-1246191653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:02:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1dc2fa2c-5608-4fee-bf80-68265974d1d3 tempest-CreateVolumesFromImageTest-1246191653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:02:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1dc2fa2c-5608-4fee-bf80-68265974d1d3 tempest-CreateVolumesFromImageTest-1246191653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:02:03 devstack sudo[105080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:02:03 devstack sudo[105080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:02:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7bc94bc8-dc52-42a1-b952-721488fe5cb7 tempest-CreateVolumesFromImageTest-1246191653 None] Acquiring lock "cinder-2a19c041-58ea-496a-9c58-589dc1e6b31f-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:02:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7bc94bc8-dc52-42a1-b952-721488fe5cb7 tempest-CreateVolumesFromImageTest-1246191653 None] Lock "cinder-2a19c041-58ea-496a-9c58-589dc1e6b31f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:02:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7bc94bc8-dc52-42a1-b952-721488fe5cb7 tempest-CreateVolumesFromImageTest-1246191653 None] Acquiring lock "cinder-quobyte-2a19c041-58ea-496a-9c58-589dc1e6b31f" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:02:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7bc94bc8-dc52-42a1-b952-721488fe5cb7 tempest-CreateVolumesFromImageTest-1246191653 None] Lock "cinder-quobyte-2a19c041-58ea-496a-9c58-589dc1e6b31f" acquired by "delete_volume" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:02:03 devstack sudo[105080]: pam_unix(sudo:session): session closed for user root Sep 28 12:02:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1dc2fa2c-5608-4fee-bf80-68265974d1d3 tempest-CreateVolumesFromImageTest-1246191653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.346s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:02:03 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-1dc2fa2c-5608-4fee-bf80-68265974d1d3 tempest-CreateVolumesFromImageTest-1246191653 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:02:03 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-1dc2fa2c-5608-4fee-bf80-68265974d1d3 tempest-CreateVolumesFromImageTest-1246191653 None] Deleted volume successfully. Sep 28 12:02:03 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[af729281-bc51-496f-9c81-e3c0aacbf75e]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:02:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7bc94bc8-dc52-42a1-b952-721488fe5cb7 tempest-CreateVolumesFromImageTest-1246191653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2a19c041-58ea-496a-9c58-589dc1e6b31f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:02:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1dc2fa2c-5608-4fee-bf80-68265974d1d3 tempest-CreateVolumesFromImageTest-1246191653 None] Lock "cinder-a3a9c7c3-6cee-4011-9e6b-3112b94c1456-delete_volume" released by "delete_volume" :: held 1.337s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:02:04 devstack sudo[105083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2a19c041-58ea-496a-9c58-589dc1e6b31f Sep 28 12:02:04 devstack sudo[105083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:02:04 devstack sudo[105083]: pam_unix(sudo:session): session closed for user root Sep 28 12:02:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7bc94bc8-dc52-42a1-b952-721488fe5cb7 tempest-CreateVolumesFromImageTest-1246191653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2a19c041-58ea-496a-9c58-589dc1e6b31f" returned: 0 in 0.473s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:02:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7bc94bc8-dc52-42a1-b952-721488fe5cb7 tempest-CreateVolumesFromImageTest-1246191653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2a19c041-58ea-496a-9c58-589dc1e6b31f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:02:04 devstack sudo[105088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2a19c041-58ea-496a-9c58-589dc1e6b31f Sep 28 12:02:04 devstack sudo[105088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:02:04 devstack sudo[105088]: pam_unix(sudo:session): session closed for user root Sep 28 12:02:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7bc94bc8-dc52-42a1-b952-721488fe5cb7 tempest-CreateVolumesFromImageTest-1246191653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2a19c041-58ea-496a-9c58-589dc1e6b31f" returned: 0 in 0.302s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:02:04 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7bc94bc8-dc52-42a1-b952-721488fe5cb7 tempest-CreateVolumesFromImageTest-1246191653 None] Lock "cinder-quobyte-2a19c041-58ea-496a-9c58-589dc1e6b31f" released by "delete_volume" :: held 0.852s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:02:04 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-7bc94bc8-dc52-42a1-b952-721488fe5cb7 tempest-CreateVolumesFromImageTest-1246191653 None] Created reservations ['2b55127e-c13c-48fa-a545-88505d7ee674', '0c5967f5-e6b5-42e0-a4d1-ec306a411e01', 'c5b3dd7d-9930-4267-a8f9-182c04ce7c20', 'd4f40c47-3b5a-4046-84ed-e774e5f8f86c'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:02:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7bc94bc8-dc52-42a1-b952-721488fe5cb7 tempest-CreateVolumesFromImageTest-1246191653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:02:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7bc94bc8-dc52-42a1-b952-721488fe5cb7 tempest-CreateVolumesFromImageTest-1246191653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:02:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7bc94bc8-dc52-42a1-b952-721488fe5cb7 tempest-CreateVolumesFromImageTest-1246191653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:02:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7bc94bc8-dc52-42a1-b952-721488fe5cb7 tempest-CreateVolumesFromImageTest-1246191653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:02:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7bc94bc8-dc52-42a1-b952-721488fe5cb7 tempest-CreateVolumesFromImageTest-1246191653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:02:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7bc94bc8-dc52-42a1-b952-721488fe5cb7 tempest-CreateVolumesFromImageTest-1246191653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:02:04 devstack sudo[105091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:02:04 devstack sudo[105091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:02:04 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e4893e8e-3ec3-40ad-b846-c2003ee47497 tempest-CreateVolumesFromImageTest-1246191653 None] Acquiring lock "cinder-5a6f9322-b190-4df6-9a6d-b5b8c554cf2e-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:02:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e4893e8e-3ec3-40ad-b846-c2003ee47497 tempest-CreateVolumesFromImageTest-1246191653 None] Lock "cinder-5a6f9322-b190-4df6-9a6d-b5b8c554cf2e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:02:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e4893e8e-3ec3-40ad-b846-c2003ee47497 tempest-CreateVolumesFromImageTest-1246191653 None] Acquiring lock "cinder-quobyte-5a6f9322-b190-4df6-9a6d-b5b8c554cf2e" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:02:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e4893e8e-3ec3-40ad-b846-c2003ee47497 tempest-CreateVolumesFromImageTest-1246191653 None] Lock "cinder-quobyte-5a6f9322-b190-4df6-9a6d-b5b8c554cf2e" acquired by "delete_volume" :: waited 0.029s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:02:05 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26c6c9c-e2e4-4277-af62-12713843ccd9]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:02:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e4893e8e-3ec3-40ad-b846-c2003ee47497 tempest-CreateVolumesFromImageTest-1246191653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5a6f9322-b190-4df6-9a6d-b5b8c554cf2e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:02:05 devstack sudo[105091]: pam_unix(sudo:session): session closed for user root Sep 28 12:02:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7bc94bc8-dc52-42a1-b952-721488fe5cb7 tempest-CreateVolumesFromImageTest-1246191653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.393s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:02:05 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-7bc94bc8-dc52-42a1-b952-721488fe5cb7 tempest-CreateVolumesFromImageTest-1246191653 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:02:05 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-7bc94bc8-dc52-42a1-b952-721488fe5cb7 tempest-CreateVolumesFromImageTest-1246191653 None] Deleted volume successfully. Sep 28 12:02:05 devstack sudo[105093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5a6f9322-b190-4df6-9a6d-b5b8c554cf2e Sep 28 12:02:05 devstack sudo[105093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:02:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7bc94bc8-dc52-42a1-b952-721488fe5cb7 tempest-CreateVolumesFromImageTest-1246191653 None] Lock "cinder-2a19c041-58ea-496a-9c58-589dc1e6b31f-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:02:05 devstack sudo[105093]: pam_unix(sudo:session): session closed for user root Sep 28 12:02:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e4893e8e-3ec3-40ad-b846-c2003ee47497 tempest-CreateVolumesFromImageTest-1246191653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5a6f9322-b190-4df6-9a6d-b5b8c554cf2e" returned: 0 in 0.473s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:02:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e4893e8e-3ec3-40ad-b846-c2003ee47497 tempest-CreateVolumesFromImageTest-1246191653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5a6f9322-b190-4df6-9a6d-b5b8c554cf2e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:02:05 devstack sudo[105099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5a6f9322-b190-4df6-9a6d-b5b8c554cf2e Sep 28 12:02:05 devstack sudo[105099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:02:05 devstack sudo[105099]: pam_unix(sudo:session): session closed for user root Sep 28 12:02:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e4893e8e-3ec3-40ad-b846-c2003ee47497 tempest-CreateVolumesFromImageTest-1246191653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5a6f9322-b190-4df6-9a6d-b5b8c554cf2e" returned: 0 in 0.314s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:02:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e4893e8e-3ec3-40ad-b846-c2003ee47497 tempest-CreateVolumesFromImageTest-1246191653 None] Lock "cinder-quobyte-5a6f9322-b190-4df6-9a6d-b5b8c554cf2e" released by "delete_volume" :: held 0.842s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:02:06 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-e4893e8e-3ec3-40ad-b846-c2003ee47497 tempest-CreateVolumesFromImageTest-1246191653 None] Created reservations ['1fbaf0b8-ca2f-4717-9f1b-698902a81d11', 'e76643de-96e6-460d-9879-954cd1826719', '6ec36e91-ab4c-4753-a04a-99c2318688c8', 'b0a68578-4336-4467-8a06-f0c1da69eeb0'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:02:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e4893e8e-3ec3-40ad-b846-c2003ee47497 tempest-CreateVolumesFromImageTest-1246191653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:02:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e4893e8e-3ec3-40ad-b846-c2003ee47497 tempest-CreateVolumesFromImageTest-1246191653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:02:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e4893e8e-3ec3-40ad-b846-c2003ee47497 tempest-CreateVolumesFromImageTest-1246191653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:02:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e4893e8e-3ec3-40ad-b846-c2003ee47497 tempest-CreateVolumesFromImageTest-1246191653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:02:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e4893e8e-3ec3-40ad-b846-c2003ee47497 tempest-CreateVolumesFromImageTest-1246191653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:02:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e4893e8e-3ec3-40ad-b846-c2003ee47497 tempest-CreateVolumesFromImageTest-1246191653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:02:06 devstack sudo[105102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:02:06 devstack sudo[105102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:02:06 devstack sudo[105102]: pam_unix(sudo:session): session closed for user root Sep 28 12:02:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e4893e8e-3ec3-40ad-b846-c2003ee47497 tempest-CreateVolumesFromImageTest-1246191653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.368s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:02:06 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-e4893e8e-3ec3-40ad-b846-c2003ee47497 tempest-CreateVolumesFromImageTest-1246191653 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:02:06 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e4893e8e-3ec3-40ad-b846-c2003ee47497 tempest-CreateVolumesFromImageTest-1246191653 None] Deleted volume successfully. Sep 28 12:02:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e4893e8e-3ec3-40ad-b846-c2003ee47497 tempest-CreateVolumesFromImageTest-1246191653 None] Lock "cinder-5a6f9322-b190-4df6-9a6d-b5b8c554cf2e-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:02:10 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-73295e01-6b27-499c-971a-dda226e20fda tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:02:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-73295e01-6b27-499c-971a-dda226e20fda tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Flow 'volume_create_manager' (c3374404-47b0-45d9-883c-c2faa584dcca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:02:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-73295e01-6b27-499c-971a-dda226e20fda tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6b914a6-10af-4985-923d-3776b94cd843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:02:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-73295e01-6b27-499c-971a-dda226e20fda tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6b914a6-10af-4985-923d-3776b94cd843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:02:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-237183732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f9256bb-4990-429f-9ebf-62bab878b700,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd7fbb2d7b934fce9cd774a23d447250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:02:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:02:10Z,use_quota=True,user_id='35a2c09d8d214087b61e10965e63fcdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:02:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-73295e01-6b27-499c-971a-dda226e20fda tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1653b2b4-0cd5-4ae5-bb16-4a568fa0601d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:02:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-73295e01-6b27-499c-971a-dda226e20fda tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1653b2b4-0cd5-4ae5-bb16-4a568fa0601d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:02:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-73295e01-6b27-499c-971a-dda226e20fda tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d51c55c-14a2-4b8b-b41c-a124cbd24b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:02:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-73295e01-6b27-499c-971a-dda226e20fda tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d51c55c-14a2-4b8b-b41c-a124cbd24b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f9256bb-4990-429f-9ebf-62bab878b700', 'volume_name': 'volume-5f9256bb-4990-429f-9ebf-62bab878b700', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:02:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-73295e01-6b27-499c-971a-dda226e20fda tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eed77de1-bde1-4a19-8e7f-b1bd12f66cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:02:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-73295e01-6b27-499c-971a-dda226e20fda tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eed77de1-bde1-4a19-8e7f-b1bd12f66cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:02:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-73295e01-6b27-499c-971a-dda226e20fda tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (392906bc-6769-4c2d-9900-9c89968bbda5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:02:10 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-73295e01-6b27-499c-971a-dda226e20fda tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Volume 5f9256bb-4990-429f-9ebf-62bab878b700: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f9256bb-4990-429f-9ebf-62bab878b700', 'volume_size': 1} Sep 28 12:02:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-73295e01-6b27-499c-971a-dda226e20fda tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:02:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-73295e01-6b27-499c-971a-dda226e20fda tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:02:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-73295e01-6b27-499c-971a-dda226e20fda tempest-CreateVolumesFromSourceVolumeTest-663662933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:02:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-237183732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f9256bb-4990-429f-9ebf-62bab878b700,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd7fbb2d7b934fce9cd774a23d447250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:02:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:02:10Z,use_quota=True,user_id='35a2c09d8d214087b61e10965e63fcdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:02:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-73295e01-6b27-499c-971a-dda226e20fda tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Creating volume 5f9256bb-4990-429f-9ebf-62bab878b700 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:02:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-73295e01-6b27-499c-971a-dda226e20fda tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:02:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-73295e01-6b27-499c-971a-dda226e20fda tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:02:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-73295e01-6b27-499c-971a-dda226e20fda tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:02:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-73295e01-6b27-499c-971a-dda226e20fda tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:02:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-73295e01-6b27-499c-971a-dda226e20fda tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:02:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-73295e01-6b27-499c-971a-dda226e20fda tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:02:10 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-73295e01-6b27-499c-971a-dda226e20fda tempest-CreateVolumesFromSourceVolumeTest-663662933 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:02:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-73295e01-6b27-499c-971a-dda226e20fda tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5f9256bb-4990-429f-9ebf-62bab878b700 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:02:10 devstack sudo[105108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5f9256bb-4990-429f-9ebf-62bab878b700 1073741824 Sep 28 12:02:10 devstack sudo[105108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:02:11 devstack sudo[105108]: pam_unix(sudo:session): session closed for user root Sep 28 12:02:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-73295e01-6b27-499c-971a-dda226e20fda tempest-CreateVolumesFromSourceVolumeTest-663662933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5f9256bb-4990-429f-9ebf-62bab878b700 1073741824" returned: 0 in 0.607s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:02:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-73295e01-6b27-499c-971a-dda226e20fda tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5f9256bb-4990-429f-9ebf-62bab878b700 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:02:11 devstack sudo[105148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5f9256bb-4990-429f-9ebf-62bab878b700 Sep 28 12:02:11 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:02:11 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root Sep 28 12:02:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-73295e01-6b27-499c-971a-dda226e20fda tempest-CreateVolumesFromSourceVolumeTest-663662933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5f9256bb-4990-429f-9ebf-62bab878b700" returned: 0 in 0.343s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:02:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-73295e01-6b27-499c-971a-dda226e20fda tempest-CreateVolumesFromSourceVolumeTest-663662933 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:02:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-73295e01-6b27-499c-971a-dda226e20fda tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:02:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-73295e01-6b27-499c-971a-dda226e20fda tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (392906bc-6769-4c2d-9900-9c89968bbda5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f9256bb-4990-429f-9ebf-62bab878b700', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:02:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-73295e01-6b27-499c-971a-dda226e20fda tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (624ad7a1-e227-4ac3-b35c-d69f2a7f941e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:02:11 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-73295e01-6b27-499c-971a-dda226e20fda tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Volume volume-5f9256bb-4990-429f-9ebf-62bab878b700 (5f9256bb-4990-429f-9ebf-62bab878b700): created successfully Sep 28 12:02:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-73295e01-6b27-499c-971a-dda226e20fda tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (624ad7a1-e227-4ac3-b35c-d69f2a7f941e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:02:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-73295e01-6b27-499c-971a-dda226e20fda tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Flow 'volume_create_manager' (c3374404-47b0-45d9-883c-c2faa584dcca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:02:11 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-73295e01-6b27-499c-971a-dda226e20fda tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Created volume successfully. Sep 28 12:02:13 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-af5b3a8b-246e-4bb0-a701-1f1e0d89c1dc tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:02:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-af5b3a8b-246e-4bb0-a701-1f1e0d89c1dc tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Flow 'volume_create_manager' (95c0d2d7-fce8-42bf-9ce7-4edcd7304903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:02:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-af5b3a8b-246e-4bb0-a701-1f1e0d89c1dc tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56e45b75-dcf7-4cef-9cc7-f64d729f2342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:02:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-af5b3a8b-246e-4bb0-a701-1f1e0d89c1dc tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56e45b75-dcf7-4cef-9cc7-f64d729f2342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:02:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-171529215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85db801d-9363-47fc-85f2-687e03c110e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd7fbb2d7b934fce9cd774a23d447250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:02:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:02:13Z,use_quota=True,user_id='35a2c09d8d214087b61e10965e63fcdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:02:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-af5b3a8b-246e-4bb0-a701-1f1e0d89c1dc tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb41744e-3391-40fb-a0f5-bbf7d8c81015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:02:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-af5b3a8b-246e-4bb0-a701-1f1e0d89c1dc tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb41744e-3391-40fb-a0f5-bbf7d8c81015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:02:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-af5b3a8b-246e-4bb0-a701-1f1e0d89c1dc tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a623f681-0dc4-4741-bc59-a11af2f06395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:02:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-af5b3a8b-246e-4bb0-a701-1f1e0d89c1dc tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a623f681-0dc4-4741-bc59-a11af2f06395) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85db801d-9363-47fc-85f2-687e03c110e1', 'volume_name': 'volume-85db801d-9363-47fc-85f2-687e03c110e1', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:02:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-af5b3a8b-246e-4bb0-a701-1f1e0d89c1dc tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dc33873-a708-483d-8f08-c43c9ac481b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:02:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-af5b3a8b-246e-4bb0-a701-1f1e0d89c1dc tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dc33873-a708-483d-8f08-c43c9ac481b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:02:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-af5b3a8b-246e-4bb0-a701-1f1e0d89c1dc tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (523aed2a-1807-48ad-84ee-e1abf1949001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:02:13 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-af5b3a8b-246e-4bb0-a701-1f1e0d89c1dc tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Volume 85db801d-9363-47fc-85f2-687e03c110e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85db801d-9363-47fc-85f2-687e03c110e1', 'volume_size': 1} Sep 28 12:02:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-af5b3a8b-246e-4bb0-a701-1f1e0d89c1dc tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:02:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-af5b3a8b-246e-4bb0-a701-1f1e0d89c1dc tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:02:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-af5b3a8b-246e-4bb0-a701-1f1e0d89c1dc tempest-CreateVolumesFromSourceVolumeTest-663662933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:02:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-171529215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85db801d-9363-47fc-85f2-687e03c110e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd7fbb2d7b934fce9cd774a23d447250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:02:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:02:13Z,use_quota=True,user_id='35a2c09d8d214087b61e10965e63fcdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:02:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-af5b3a8b-246e-4bb0-a701-1f1e0d89c1dc tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Creating volume 85db801d-9363-47fc-85f2-687e03c110e1 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:02:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-af5b3a8b-246e-4bb0-a701-1f1e0d89c1dc tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:02:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-af5b3a8b-246e-4bb0-a701-1f1e0d89c1dc tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:02:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-af5b3a8b-246e-4bb0-a701-1f1e0d89c1dc tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:02:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-af5b3a8b-246e-4bb0-a701-1f1e0d89c1dc tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:02:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-af5b3a8b-246e-4bb0-a701-1f1e0d89c1dc tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:02:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-af5b3a8b-246e-4bb0-a701-1f1e0d89c1dc tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:02:13 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-af5b3a8b-246e-4bb0-a701-1f1e0d89c1dc tempest-CreateVolumesFromSourceVolumeTest-663662933 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:02:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-af5b3a8b-246e-4bb0-a701-1f1e0d89c1dc tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-85db801d-9363-47fc-85f2-687e03c110e1 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:02:13 devstack sudo[105153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-85db801d-9363-47fc-85f2-687e03c110e1 1073741824 Sep 28 12:02:13 devstack sudo[105153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:02:13 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfc79b76-696e-441f-b54a-b8e878a37993 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:02:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bfc79b76-696e-441f-b54a-b8e878a37993 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Flow 'volume_create_manager' (85125523-e45d-4b97-8f52-c7d683cabe21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:02:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bfc79b76-696e-441f-b54a-b8e878a37993 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d0b8126-8a7c-40de-b736-422bd501ac55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:02:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bfc79b76-696e-441f-b54a-b8e878a37993 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d0b8126-8a7c-40de-b736-422bd501ac55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:02:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-7217573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b1bf9e9-e080-404f-a10d-00eaa9c1c116,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd7fbb2d7b934fce9cd774a23d447250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:02:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:02:14Z,use_quota=True,user_id='35a2c09d8d214087b61e10965e63fcdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:02:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bfc79b76-696e-441f-b54a-b8e878a37993 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77dc694f-6e1b-486f-87ee-36f889585533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:02:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bfc79b76-696e-441f-b54a-b8e878a37993 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77dc694f-6e1b-486f-87ee-36f889585533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:02:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bfc79b76-696e-441f-b54a-b8e878a37993 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (947408e7-3ebb-4d7d-8062-0f2c0a98bc64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:02:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bfc79b76-696e-441f-b54a-b8e878a37993 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (947408e7-3ebb-4d7d-8062-0f2c0a98bc64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b1bf9e9-e080-404f-a10d-00eaa9c1c116', 'volume_name': 'volume-7b1bf9e9-e080-404f-a10d-00eaa9c1c116', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:02:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bfc79b76-696e-441f-b54a-b8e878a37993 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (229cf3f6-1a56-4416-bbad-4199b99a479c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:02:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bfc79b76-696e-441f-b54a-b8e878a37993 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (229cf3f6-1a56-4416-bbad-4199b99a479c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:02:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bfc79b76-696e-441f-b54a-b8e878a37993 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6787b26c-e3c6-424f-8a14-7b7f070477cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:02:13 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-bfc79b76-696e-441f-b54a-b8e878a37993 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Volume 7b1bf9e9-e080-404f-a10d-00eaa9c1c116: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b1bf9e9-e080-404f-a10d-00eaa9c1c116', 'volume_size': 1} Sep 28 12:02:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bfc79b76-696e-441f-b54a-b8e878a37993 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:02:13 devstack sudo[105153]: pam_unix(sudo:session): session closed for user root Sep 28 12:02:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-af5b3a8b-246e-4bb0-a701-1f1e0d89c1dc tempest-CreateVolumesFromSourceVolumeTest-663662933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-85db801d-9363-47fc-85f2-687e03c110e1 1073741824" returned: 0 in 0.638s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:02:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-af5b3a8b-246e-4bb0-a701-1f1e0d89c1dc tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-85db801d-9363-47fc-85f2-687e03c110e1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:02:13 devstack sudo[105159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-85db801d-9363-47fc-85f2-687e03c110e1 Sep 28 12:02:13 devstack sudo[105159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:02:14 devstack sudo[105159]: pam_unix(sudo:session): session closed for user root Sep 28 12:02:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-af5b3a8b-246e-4bb0-a701-1f1e0d89c1dc tempest-CreateVolumesFromSourceVolumeTest-663662933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-85db801d-9363-47fc-85f2-687e03c110e1" returned: 0 in 0.323s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:02:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-af5b3a8b-246e-4bb0-a701-1f1e0d89c1dc tempest-CreateVolumesFromSourceVolumeTest-663662933 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:02:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-af5b3a8b-246e-4bb0-a701-1f1e0d89c1dc tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:02:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bfc79b76-696e-441f-b54a-b8e878a37993 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.475s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:02:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bfc79b76-696e-441f-b54a-b8e878a37993 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:02:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-7217573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b1bf9e9-e080-404f-a10d-00eaa9c1c116,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd7fbb2d7b934fce9cd774a23d447250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:02:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:02:14Z,use_quota=True,user_id='35a2c09d8d214087b61e10965e63fcdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:02:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-bfc79b76-696e-441f-b54a-b8e878a37993 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Creating volume 7b1bf9e9-e080-404f-a10d-00eaa9c1c116 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:02:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bfc79b76-696e-441f-b54a-b8e878a37993 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:02:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bfc79b76-696e-441f-b54a-b8e878a37993 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:02:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bfc79b76-696e-441f-b54a-b8e878a37993 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:02:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bfc79b76-696e-441f-b54a-b8e878a37993 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:02:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bfc79b76-696e-441f-b54a-b8e878a37993 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:02:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bfc79b76-696e-441f-b54a-b8e878a37993 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:02:14 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-bfc79b76-696e-441f-b54a-b8e878a37993 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:02:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bfc79b76-696e-441f-b54a-b8e878a37993 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-7b1bf9e9-e080-404f-a10d-00eaa9c1c116 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:02:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-af5b3a8b-246e-4bb0-a701-1f1e0d89c1dc tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (523aed2a-1807-48ad-84ee-e1abf1949001) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85db801d-9363-47fc-85f2-687e03c110e1', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:02:14 devstack sudo[105162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-7b1bf9e9-e080-404f-a10d-00eaa9c1c116 1073741824 Sep 28 12:02:14 devstack sudo[105162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:02:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-af5b3a8b-246e-4bb0-a701-1f1e0d89c1dc tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0913c510-1ccf-47dc-915c-bb1613d4040a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:02:14 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-0facbb9c-fcb0-464e-ab7e-f5903ab5fa04 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:02:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0facbb9c-fcb0-464e-ab7e-f5903ab5fa04 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Flow 'volume_create_manager' (c26c3378-699b-4bb7-87f5-16b3bd8e6f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:02:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0facbb9c-fcb0-464e-ab7e-f5903ab5fa04 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37214f33-b496-47a6-8f1e-ebcc853d2a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:02:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0facbb9c-fcb0-464e-ab7e-f5903ab5fa04 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37214f33-b496-47a6-8f1e-ebcc853d2a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:02:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-784957837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=231a8322-0bdd-4699-9128-b68e343c65d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd7fbb2d7b934fce9cd774a23d447250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:02:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:02:14Z,use_quota=True,user_id='35a2c09d8d214087b61e10965e63fcdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:02:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0facbb9c-fcb0-464e-ab7e-f5903ab5fa04 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3833632f-4049-4a08-adfa-c8ac45f5d447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:02:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0facbb9c-fcb0-464e-ab7e-f5903ab5fa04 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3833632f-4049-4a08-adfa-c8ac45f5d447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:02:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0facbb9c-fcb0-464e-ab7e-f5903ab5fa04 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0772f43-36ba-4714-961d-c40d2ed74334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:02:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0facbb9c-fcb0-464e-ab7e-f5903ab5fa04 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0772f43-36ba-4714-961d-c40d2ed74334) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '231a8322-0bdd-4699-9128-b68e343c65d2', 'volume_name': 'volume-231a8322-0bdd-4699-9128-b68e343c65d2', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:02:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0facbb9c-fcb0-464e-ab7e-f5903ab5fa04 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b9c02d5-9edb-4e7e-a413-65fe667480ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:02:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0facbb9c-fcb0-464e-ab7e-f5903ab5fa04 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b9c02d5-9edb-4e7e-a413-65fe667480ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:02:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0facbb9c-fcb0-464e-ab7e-f5903ab5fa04 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4905e284-4636-40f3-87f0-1923c02cb896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:02:14 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-0facbb9c-fcb0-464e-ab7e-f5903ab5fa04 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Volume 231a8322-0bdd-4699-9128-b68e343c65d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-231a8322-0bdd-4699-9128-b68e343c65d2', 'volume_size': 1} Sep 28 12:02:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0facbb9c-fcb0-464e-ab7e-f5903ab5fa04 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:02:14 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-af5b3a8b-246e-4bb0-a701-1f1e0d89c1dc tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Volume volume-85db801d-9363-47fc-85f2-687e03c110e1 (85db801d-9363-47fc-85f2-687e03c110e1): created successfully Sep 28 12:02:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-af5b3a8b-246e-4bb0-a701-1f1e0d89c1dc tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0913c510-1ccf-47dc-915c-bb1613d4040a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:02:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-af5b3a8b-246e-4bb0-a701-1f1e0d89c1dc tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Flow 'volume_create_manager' (95c0d2d7-fce8-42bf-9ce7-4edcd7304903) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:02:14 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-af5b3a8b-246e-4bb0-a701-1f1e0d89c1dc tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Created volume successfully. Sep 28 12:02:14 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6b5e160-dab8-4f85-b589-33af9d5a364d tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:02:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d6b5e160-dab8-4f85-b589-33af9d5a364d tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Flow 'volume_create_manager' (5039a0a7-5ddd-4e15-ad38-4cfcb2d11717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:02:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d6b5e160-dab8-4f85-b589-33af9d5a364d tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (149a233c-c24b-43ac-9977-d69c3d92edc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:02:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d6b5e160-dab8-4f85-b589-33af9d5a364d tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (149a233c-c24b-43ac-9977-d69c3d92edc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:02:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-326036208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b64354e7-8a48-4373-b832-3a7d61a6bc98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd7fbb2d7b934fce9cd774a23d447250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:02:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:02:15Z,use_quota=True,user_id='35a2c09d8d214087b61e10965e63fcdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:02:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d6b5e160-dab8-4f85-b589-33af9d5a364d tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3cd9543-afba-4008-b123-f758d92efd89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:02:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d6b5e160-dab8-4f85-b589-33af9d5a364d tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3cd9543-afba-4008-b123-f758d92efd89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:02:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d6b5e160-dab8-4f85-b589-33af9d5a364d tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1335585b-1501-4582-9efd-b8ba6e401168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:02:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d6b5e160-dab8-4f85-b589-33af9d5a364d tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1335585b-1501-4582-9efd-b8ba6e401168) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b64354e7-8a48-4373-b832-3a7d61a6bc98', 'volume_name': 'volume-b64354e7-8a48-4373-b832-3a7d61a6bc98', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:02:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d6b5e160-dab8-4f85-b589-33af9d5a364d tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4517a170-5837-48ad-8568-24c1d1be58f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:02:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d6b5e160-dab8-4f85-b589-33af9d5a364d tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4517a170-5837-48ad-8568-24c1d1be58f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:02:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d6b5e160-dab8-4f85-b589-33af9d5a364d tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ad6fd08-6cef-4ce7-bd37-67be129afc10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:02:14 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-d6b5e160-dab8-4f85-b589-33af9d5a364d tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Volume b64354e7-8a48-4373-b832-3a7d61a6bc98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b64354e7-8a48-4373-b832-3a7d61a6bc98', 'volume_size': 1} Sep 28 12:02:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d6b5e160-dab8-4f85-b589-33af9d5a364d tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:02:14 devstack sudo[105162]: pam_unix(sudo:session): session closed for user root Sep 28 12:02:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bfc79b76-696e-441f-b54a-b8e878a37993 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-7b1bf9e9-e080-404f-a10d-00eaa9c1c116 1073741824" returned: 0 in 0.611s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:02:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bfc79b76-696e-441f-b54a-b8e878a37993 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-7b1bf9e9-e080-404f-a10d-00eaa9c1c116 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:02:15 devstack sudo[105169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-7b1bf9e9-e080-404f-a10d-00eaa9c1c116 Sep 28 12:02:15 devstack sudo[105169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:02:15 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b3e244d-9b20-40db-b2c1-d9b091a67f3a tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:02:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8b3e244d-9b20-40db-b2c1-d9b091a67f3a tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Flow 'volume_create_manager' (cc7ba8c4-bdca-4d83-aa9a-1385e7362e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:02:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8b3e244d-9b20-40db-b2c1-d9b091a67f3a tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (622b497b-0790-4b17-a770-1be237e69d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:02:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8b3e244d-9b20-40db-b2c1-d9b091a67f3a tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (622b497b-0790-4b17-a770-1be237e69d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-659175822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62ebdfb9-d678-4f90-95bd-ec38c8030878,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd7fbb2d7b934fce9cd774a23d447250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:02:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:02:15Z,use_quota=True,user_id='35a2c09d8d214087b61e10965e63fcdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:02:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8b3e244d-9b20-40db-b2c1-d9b091a67f3a tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a140d9c-ac02-497a-81d6-451de2b5a2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:02:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8b3e244d-9b20-40db-b2c1-d9b091a67f3a tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a140d9c-ac02-497a-81d6-451de2b5a2ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:02:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8b3e244d-9b20-40db-b2c1-d9b091a67f3a tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71899a7e-ff8a-4455-ae1c-15dd763b37c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:02:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8b3e244d-9b20-40db-b2c1-d9b091a67f3a tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71899a7e-ff8a-4455-ae1c-15dd763b37c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62ebdfb9-d678-4f90-95bd-ec38c8030878', 'volume_name': 'volume-62ebdfb9-d678-4f90-95bd-ec38c8030878', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:02:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8b3e244d-9b20-40db-b2c1-d9b091a67f3a tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e376af99-2254-4359-9149-e75e19284ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:02:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8b3e244d-9b20-40db-b2c1-d9b091a67f3a tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e376af99-2254-4359-9149-e75e19284ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:02:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8b3e244d-9b20-40db-b2c1-d9b091a67f3a tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c09a7b2a-8ef8-48e8-955a-b12d64895ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:02:15 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-8b3e244d-9b20-40db-b2c1-d9b091a67f3a tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Volume 62ebdfb9-d678-4f90-95bd-ec38c8030878: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62ebdfb9-d678-4f90-95bd-ec38c8030878', 'volume_size': 1} Sep 28 12:02:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8b3e244d-9b20-40db-b2c1-d9b091a67f3a tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:02:15 devstack sudo[105169]: pam_unix(sudo:session): session closed for user root Sep 28 12:02:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bfc79b76-696e-441f-b54a-b8e878a37993 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-7b1bf9e9-e080-404f-a10d-00eaa9c1c116" returned: 0 in 0.525s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:02:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bfc79b76-696e-441f-b54a-b8e878a37993 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:02:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bfc79b76-696e-441f-b54a-b8e878a37993 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.232s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:02:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0facbb9c-fcb0-464e-ab7e-f5903ab5fa04 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.060s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:02:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0facbb9c-fcb0-464e-ab7e-f5903ab5fa04 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:02:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-784957837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=231a8322-0bdd-4699-9128-b68e343c65d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd7fbb2d7b934fce9cd774a23d447250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:02:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:02:14Z,use_quota=True,user_id='35a2c09d8d214087b61e10965e63fcdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:02:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-0facbb9c-fcb0-464e-ab7e-f5903ab5fa04 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Creating volume 231a8322-0bdd-4699-9128-b68e343c65d2 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:02:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0facbb9c-fcb0-464e-ab7e-f5903ab5fa04 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:02:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0facbb9c-fcb0-464e-ab7e-f5903ab5fa04 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:02:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0facbb9c-fcb0-464e-ab7e-f5903ab5fa04 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:02:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0facbb9c-fcb0-464e-ab7e-f5903ab5fa04 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:02:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0facbb9c-fcb0-464e-ab7e-f5903ab5fa04 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:02:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0facbb9c-fcb0-464e-ab7e-f5903ab5fa04 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:02:15 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-0facbb9c-fcb0-464e-ab7e-f5903ab5fa04 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:02:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0facbb9c-fcb0-464e-ab7e-f5903ab5fa04 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-231a8322-0bdd-4699-9128-b68e343c65d2 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:02:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bfc79b76-696e-441f-b54a-b8e878a37993 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6787b26c-e3c6-424f-8a14-7b7f070477cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b1bf9e9-e080-404f-a10d-00eaa9c1c116', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:02:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bfc79b76-696e-441f-b54a-b8e878a37993 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efe0cfbd-a6d0-4a3b-91ab-24db81f95be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:02:15 devstack sudo[105172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-231a8322-0bdd-4699-9128-b68e343c65d2 1073741824 Sep 28 12:02:15 devstack sudo[105172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:02:15 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-bfc79b76-696e-441f-b54a-b8e878a37993 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Volume volume-7b1bf9e9-e080-404f-a10d-00eaa9c1c116 (7b1bf9e9-e080-404f-a10d-00eaa9c1c116): created successfully Sep 28 12:02:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bfc79b76-696e-441f-b54a-b8e878a37993 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efe0cfbd-a6d0-4a3b-91ab-24db81f95be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:02:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-bfc79b76-696e-441f-b54a-b8e878a37993 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Flow 'volume_create_manager' (85125523-e45d-4b97-8f52-c7d683cabe21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:02:15 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-bfc79b76-696e-441f-b54a-b8e878a37993 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Created volume successfully. Sep 28 12:02:16 devstack sudo[105172]: pam_unix(sudo:session): session closed for user root Sep 28 12:02:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0facbb9c-fcb0-464e-ab7e-f5903ab5fa04 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-231a8322-0bdd-4699-9128-b68e343c65d2 1073741824" returned: 0 in 0.537s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:02:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0facbb9c-fcb0-464e-ab7e-f5903ab5fa04 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-231a8322-0bdd-4699-9128-b68e343c65d2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:02:16 devstack sudo[105183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-231a8322-0bdd-4699-9128-b68e343c65d2 Sep 28 12:02:16 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:02:16 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root Sep 28 12:02:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0facbb9c-fcb0-464e-ab7e-f5903ab5fa04 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-231a8322-0bdd-4699-9128-b68e343c65d2" returned: 0 in 0.325s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:02:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0facbb9c-fcb0-464e-ab7e-f5903ab5fa04 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:02:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0facbb9c-fcb0-464e-ab7e-f5903ab5fa04 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:02:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d6b5e160-dab8-4f85-b589-33af9d5a364d tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.583s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:02:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d6b5e160-dab8-4f85-b589-33af9d5a364d tempest-CreateVolumesFromSourceVolumeTest-663662933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:02:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-326036208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b64354e7-8a48-4373-b832-3a7d61a6bc98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd7fbb2d7b934fce9cd774a23d447250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:02:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:02:15Z,use_quota=True,user_id='35a2c09d8d214087b61e10965e63fcdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:02:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-d6b5e160-dab8-4f85-b589-33af9d5a364d tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Creating volume b64354e7-8a48-4373-b832-3a7d61a6bc98 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:02:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d6b5e160-dab8-4f85-b589-33af9d5a364d tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:02:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d6b5e160-dab8-4f85-b589-33af9d5a364d tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:02:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d6b5e160-dab8-4f85-b589-33af9d5a364d tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:02:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d6b5e160-dab8-4f85-b589-33af9d5a364d tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:02:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d6b5e160-dab8-4f85-b589-33af9d5a364d tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:02:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d6b5e160-dab8-4f85-b589-33af9d5a364d tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:02:16 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-d6b5e160-dab8-4f85-b589-33af9d5a364d tempest-CreateVolumesFromSourceVolumeTest-663662933 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:02:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d6b5e160-dab8-4f85-b589-33af9d5a364d tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b64354e7-8a48-4373-b832-3a7d61a6bc98 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:02:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0facbb9c-fcb0-464e-ab7e-f5903ab5fa04 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4905e284-4636-40f3-87f0-1923c02cb896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-231a8322-0bdd-4699-9128-b68e343c65d2', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:02:16 devstack sudo[105189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b64354e7-8a48-4373-b832-3a7d61a6bc98 1073741824 Sep 28 12:02:16 devstack sudo[105189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:02:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0facbb9c-fcb0-464e-ab7e-f5903ab5fa04 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89ace850-d84b-4b5d-b654-43f97c42a250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:02:16 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-0facbb9c-fcb0-464e-ab7e-f5903ab5fa04 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Volume volume-231a8322-0bdd-4699-9128-b68e343c65d2 (231a8322-0bdd-4699-9128-b68e343c65d2): created successfully Sep 28 12:02:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0facbb9c-fcb0-464e-ab7e-f5903ab5fa04 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89ace850-d84b-4b5d-b654-43f97c42a250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:02:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0facbb9c-fcb0-464e-ab7e-f5903ab5fa04 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Flow 'volume_create_manager' (c26c3378-699b-4bb7-87f5-16b3bd8e6f70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:02:16 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-0facbb9c-fcb0-464e-ab7e-f5903ab5fa04 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Created volume successfully. Sep 28 12:02:16 devstack sudo[105189]: pam_unix(sudo:session): session closed for user root Sep 28 12:02:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d6b5e160-dab8-4f85-b589-33af9d5a364d tempest-CreateVolumesFromSourceVolumeTest-663662933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b64354e7-8a48-4373-b832-3a7d61a6bc98 1073741824" returned: 0 in 0.497s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:02:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d6b5e160-dab8-4f85-b589-33af9d5a364d tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b64354e7-8a48-4373-b832-3a7d61a6bc98 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:02:16 devstack sudo[105195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b64354e7-8a48-4373-b832-3a7d61a6bc98 Sep 28 12:02:16 devstack sudo[105195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:02:17 devstack sudo[105195]: pam_unix(sudo:session): session closed for user root Sep 28 12:02:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d6b5e160-dab8-4f85-b589-33af9d5a364d tempest-CreateVolumesFromSourceVolumeTest-663662933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b64354e7-8a48-4373-b832-3a7d61a6bc98" returned: 0 in 0.286s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:02:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d6b5e160-dab8-4f85-b589-33af9d5a364d tempest-CreateVolumesFromSourceVolumeTest-663662933 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:02:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d6b5e160-dab8-4f85-b589-33af9d5a364d tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:02:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8b3e244d-9b20-40db-b2c1-d9b091a67f3a tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.783s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:02:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8b3e244d-9b20-40db-b2c1-d9b091a67f3a tempest-CreateVolumesFromSourceVolumeTest-663662933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-659175822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62ebdfb9-d678-4f90-95bd-ec38c8030878,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd7fbb2d7b934fce9cd774a23d447250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:02:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:02:15Z,use_quota=True,user_id='35a2c09d8d214087b61e10965e63fcdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:02:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-8b3e244d-9b20-40db-b2c1-d9b091a67f3a tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Creating volume 62ebdfb9-d678-4f90-95bd-ec38c8030878 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:02:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8b3e244d-9b20-40db-b2c1-d9b091a67f3a tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:02:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8b3e244d-9b20-40db-b2c1-d9b091a67f3a tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:02:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8b3e244d-9b20-40db-b2c1-d9b091a67f3a tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:02:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8b3e244d-9b20-40db-b2c1-d9b091a67f3a tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:02:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8b3e244d-9b20-40db-b2c1-d9b091a67f3a tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:02:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8b3e244d-9b20-40db-b2c1-d9b091a67f3a tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:02:17 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-8b3e244d-9b20-40db-b2c1-d9b091a67f3a tempest-CreateVolumesFromSourceVolumeTest-663662933 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:02:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8b3e244d-9b20-40db-b2c1-d9b091a67f3a tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-62ebdfb9-d678-4f90-95bd-ec38c8030878 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:02:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d6b5e160-dab8-4f85-b589-33af9d5a364d tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ad6fd08-6cef-4ce7-bd37-67be129afc10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b64354e7-8a48-4373-b832-3a7d61a6bc98', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:02:17 devstack sudo[105198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-62ebdfb9-d678-4f90-95bd-ec38c8030878 1073741824 Sep 28 12:02:17 devstack sudo[105198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:02:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d6b5e160-dab8-4f85-b589-33af9d5a364d tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f872e605-81fb-4590-8498-ade043032ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:02:17 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-d6b5e160-dab8-4f85-b589-33af9d5a364d tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Volume volume-b64354e7-8a48-4373-b832-3a7d61a6bc98 (b64354e7-8a48-4373-b832-3a7d61a6bc98): created successfully Sep 28 12:02:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d6b5e160-dab8-4f85-b589-33af9d5a364d tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f872e605-81fb-4590-8498-ade043032ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:02:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d6b5e160-dab8-4f85-b589-33af9d5a364d tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Flow 'volume_create_manager' (5039a0a7-5ddd-4e15-ad38-4cfcb2d11717) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:02:17 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-d6b5e160-dab8-4f85-b589-33af9d5a364d tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Created volume successfully. Sep 28 12:02:17 devstack sudo[105198]: pam_unix(sudo:session): session closed for user root Sep 28 12:02:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8b3e244d-9b20-40db-b2c1-d9b091a67f3a tempest-CreateVolumesFromSourceVolumeTest-663662933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-62ebdfb9-d678-4f90-95bd-ec38c8030878 1073741824" returned: 0 in 0.570s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:02:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8b3e244d-9b20-40db-b2c1-d9b091a67f3a tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-62ebdfb9-d678-4f90-95bd-ec38c8030878 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:02:17 devstack sudo[105204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-62ebdfb9-d678-4f90-95bd-ec38c8030878 Sep 28 12:02:17 devstack sudo[105204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:02:18 devstack sudo[105204]: pam_unix(sudo:session): session closed for user root Sep 28 12:02:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8b3e244d-9b20-40db-b2c1-d9b091a67f3a tempest-CreateVolumesFromSourceVolumeTest-663662933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-62ebdfb9-d678-4f90-95bd-ec38c8030878" returned: 0 in 0.271s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:02:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8b3e244d-9b20-40db-b2c1-d9b091a67f3a tempest-CreateVolumesFromSourceVolumeTest-663662933 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:02:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8b3e244d-9b20-40db-b2c1-d9b091a67f3a tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:02:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8b3e244d-9b20-40db-b2c1-d9b091a67f3a tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c09a7b2a-8ef8-48e8-955a-b12d64895ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62ebdfb9-d678-4f90-95bd-ec38c8030878', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:02:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8b3e244d-9b20-40db-b2c1-d9b091a67f3a tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b8344ff-7a13-4e2e-b4ec-0afa8f0eda23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:02:18 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-8b3e244d-9b20-40db-b2c1-d9b091a67f3a tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Volume volume-62ebdfb9-d678-4f90-95bd-ec38c8030878 (62ebdfb9-d678-4f90-95bd-ec38c8030878): created successfully Sep 28 12:02:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8b3e244d-9b20-40db-b2c1-d9b091a67f3a tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b8344ff-7a13-4e2e-b4ec-0afa8f0eda23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:02:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8b3e244d-9b20-40db-b2c1-d9b091a67f3a tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Flow 'volume_create_manager' (cc7ba8c4-bdca-4d83-aa9a-1385e7362e75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:02:18 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-8b3e244d-9b20-40db-b2c1-d9b091a67f3a tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Created volume successfully. Sep 28 12:02:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f57f83b4-e436-4333-b3b7-0a5bdc06a0d1 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Acquiring lock "cinder-62ebdfb9-d678-4f90-95bd-ec38c8030878-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:02:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f57f83b4-e436-4333-b3b7-0a5bdc06a0d1 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Lock "cinder-62ebdfb9-d678-4f90-95bd-ec38c8030878-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:02:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f57f83b4-e436-4333-b3b7-0a5bdc06a0d1 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Acquiring lock "cinder-quobyte-62ebdfb9-d678-4f90-95bd-ec38c8030878" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:02:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f57f83b4-e436-4333-b3b7-0a5bdc06a0d1 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Lock "cinder-quobyte-62ebdfb9-d678-4f90-95bd-ec38c8030878" acquired by "delete_volume" :: waited 0.023s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:02:18 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b11ce4-5c0b-4717-ba2f-8db1aa41a61f]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:02:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f57f83b4-e436-4333-b3b7-0a5bdc06a0d1 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-62ebdfb9-d678-4f90-95bd-ec38c8030878 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:02:19 devstack sudo[105207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-62ebdfb9-d678-4f90-95bd-ec38c8030878 Sep 28 12:02:19 devstack sudo[105207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:02:19 devstack sudo[105207]: pam_unix(sudo:session): session closed for user root Sep 28 12:02:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f57f83b4-e436-4333-b3b7-0a5bdc06a0d1 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-62ebdfb9-d678-4f90-95bd-ec38c8030878" returned: 0 in 0.412s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:02:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f57f83b4-e436-4333-b3b7-0a5bdc06a0d1 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-62ebdfb9-d678-4f90-95bd-ec38c8030878 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:02:19 devstack sudo[105212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-62ebdfb9-d678-4f90-95bd-ec38c8030878 Sep 28 12:02:19 devstack sudo[105212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:02:19 devstack sudo[105212]: pam_unix(sudo:session): session closed for user root Sep 28 12:02:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f57f83b4-e436-4333-b3b7-0a5bdc06a0d1 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-62ebdfb9-d678-4f90-95bd-ec38c8030878" returned: 0 in 0.288s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:02:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f57f83b4-e436-4333-b3b7-0a5bdc06a0d1 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Lock "cinder-quobyte-62ebdfb9-d678-4f90-95bd-ec38c8030878" released by "delete_volume" :: held 0.751s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:02:19 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-f57f83b4-e436-4333-b3b7-0a5bdc06a0d1 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Created reservations ['03bd0af9-3470-4200-93b9-27ac60d67262', '74d2d8d8-d0c7-45c4-a251-f6348f701c0a', 'fd422680-8787-46ef-8ff7-da3617288ea5', 'c9e414a1-0ea6-4647-bbfc-d2c8607ac561'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:02:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f57f83b4-e436-4333-b3b7-0a5bdc06a0d1 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:02:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f57f83b4-e436-4333-b3b7-0a5bdc06a0d1 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:02:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f57f83b4-e436-4333-b3b7-0a5bdc06a0d1 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:02:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f57f83b4-e436-4333-b3b7-0a5bdc06a0d1 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:02:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f57f83b4-e436-4333-b3b7-0a5bdc06a0d1 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:02:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f57f83b4-e436-4333-b3b7-0a5bdc06a0d1 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:02:19 devstack sudo[105215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:02:19 devstack sudo[105215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:02:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-752a769f-b6e5-493c-b4a0-5615ac7ce0ee tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Acquiring lock "cinder-b64354e7-8a48-4373-b832-3a7d61a6bc98-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:02:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-752a769f-b6e5-493c-b4a0-5615ac7ce0ee tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Lock "cinder-b64354e7-8a48-4373-b832-3a7d61a6bc98-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:02:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-752a769f-b6e5-493c-b4a0-5615ac7ce0ee tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Acquiring lock "cinder-quobyte-b64354e7-8a48-4373-b832-3a7d61a6bc98" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:02:20 devstack sudo[105215]: pam_unix(sudo:session): session closed for user root Sep 28 12:02:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f57f83b4-e436-4333-b3b7-0a5bdc06a0d1 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.313s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:02:20 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-f57f83b4-e436-4333-b3b7-0a5bdc06a0d1 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:02:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-752a769f-b6e5-493c-b4a0-5615ac7ce0ee tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Lock "cinder-quobyte-b64354e7-8a48-4373-b832-3a7d61a6bc98" acquired by "delete_volume" :: waited 0.025s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:02:20 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-f57f83b4-e436-4333-b3b7-0a5bdc06a0d1 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Deleted volume successfully. Sep 28 12:02:20 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[548d4a46-6548-4650-b649-4a9cbb39c7d0]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:02:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-752a769f-b6e5-493c-b4a0-5615ac7ce0ee tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b64354e7-8a48-4373-b832-3a7d61a6bc98 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:02:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f57f83b4-e436-4333-b3b7-0a5bdc06a0d1 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Lock "cinder-62ebdfb9-d678-4f90-95bd-ec38c8030878-delete_volume" released by "delete_volume" :: held 1.362s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:02:20 devstack sudo[105219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b64354e7-8a48-4373-b832-3a7d61a6bc98 Sep 28 12:02:20 devstack sudo[105219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:02:20 devstack sudo[105219]: pam_unix(sudo:session): session closed for user root Sep 28 12:02:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-752a769f-b6e5-493c-b4a0-5615ac7ce0ee tempest-CreateVolumesFromSourceVolumeTest-663662933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b64354e7-8a48-4373-b832-3a7d61a6bc98" returned: 0 in 0.404s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:02:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-752a769f-b6e5-493c-b4a0-5615ac7ce0ee tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b64354e7-8a48-4373-b832-3a7d61a6bc98 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:02:20 devstack sudo[105224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b64354e7-8a48-4373-b832-3a7d61a6bc98 Sep 28 12:02:20 devstack sudo[105224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:02:20 devstack sudo[105224]: pam_unix(sudo:session): session closed for user root Sep 28 12:02:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-752a769f-b6e5-493c-b4a0-5615ac7ce0ee tempest-CreateVolumesFromSourceVolumeTest-663662933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b64354e7-8a48-4373-b832-3a7d61a6bc98" returned: 0 in 0.268s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:02:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-752a769f-b6e5-493c-b4a0-5615ac7ce0ee tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Lock "cinder-quobyte-b64354e7-8a48-4373-b832-3a7d61a6bc98" released by "delete_volume" :: held 0.747s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:02:20 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=105,cinder:UPDATE=121,cinder:INSERT=35,cinder:DELETE=12 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:02:20 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=92,cinder:INSERT=27,cinder:UPDATE=122,cinder:DELETE=10 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:02:20 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-752a769f-b6e5-493c-b4a0-5615ac7ce0ee tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Created reservations ['1ef5a085-6557-46d4-9136-afe8cb76cb5e', '33850cf7-a080-495b-af5c-3b596e1fa1aa', '1a753557-a454-4a4f-8a05-167175dafa9c', '3ca2e195-e498-48b2-9452-f3db4e38be13'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:02:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-752a769f-b6e5-493c-b4a0-5615ac7ce0ee tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:02:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-752a769f-b6e5-493c-b4a0-5615ac7ce0ee tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:02:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-752a769f-b6e5-493c-b4a0-5615ac7ce0ee tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:02:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-752a769f-b6e5-493c-b4a0-5615ac7ce0ee tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:02:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-752a769f-b6e5-493c-b4a0-5615ac7ce0ee tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:02:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-752a769f-b6e5-493c-b4a0-5615ac7ce0ee tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:02:21 devstack sudo[105227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:02:21 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:02:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-cc69df16-b5d4-4bcd-8ce4-83e460d74ae1 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Acquiring lock "cinder-231a8322-0bdd-4699-9128-b68e343c65d2-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:02:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-cc69df16-b5d4-4bcd-8ce4-83e460d74ae1 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Lock "cinder-231a8322-0bdd-4699-9128-b68e343c65d2-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:02:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-cc69df16-b5d4-4bcd-8ce4-83e460d74ae1 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Acquiring lock "cinder-quobyte-231a8322-0bdd-4699-9128-b68e343c65d2" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:02:21 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root Sep 28 12:02:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-752a769f-b6e5-493c-b4a0-5615ac7ce0ee tempest-CreateVolumesFromSourceVolumeTest-663662933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.342s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:02:21 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-752a769f-b6e5-493c-b4a0-5615ac7ce0ee tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:02:21 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-752a769f-b6e5-493c-b4a0-5615ac7ce0ee tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Deleted volume successfully. Sep 28 12:02:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-cc69df16-b5d4-4bcd-8ce4-83e460d74ae1 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Lock "cinder-quobyte-231a8322-0bdd-4699-9128-b68e343c65d2" acquired by "delete_volume" :: waited 0.023s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:02:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-752a769f-b6e5-493c-b4a0-5615ac7ce0ee tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Lock "cinder-b64354e7-8a48-4373-b832-3a7d61a6bc98-delete_volume" released by "delete_volume" :: held 1.382s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:02:21 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[c214f42e-0aa0-46ce-a468-3abc1ee58bf0]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:02:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cc69df16-b5d4-4bcd-8ce4-83e460d74ae1 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-231a8322-0bdd-4699-9128-b68e343c65d2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:02:21 devstack sudo[105230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-231a8322-0bdd-4699-9128-b68e343c65d2 Sep 28 12:02:21 devstack sudo[105230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:02:21 devstack sudo[105230]: pam_unix(sudo:session): session closed for user root Sep 28 12:02:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cc69df16-b5d4-4bcd-8ce4-83e460d74ae1 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-231a8322-0bdd-4699-9128-b68e343c65d2" returned: 0 in 0.433s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:02:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cc69df16-b5d4-4bcd-8ce4-83e460d74ae1 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-231a8322-0bdd-4699-9128-b68e343c65d2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:02:21 devstack sudo[105235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-231a8322-0bdd-4699-9128-b68e343c65d2 Sep 28 12:02:21 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:02:22 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root Sep 28 12:02:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cc69df16-b5d4-4bcd-8ce4-83e460d74ae1 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-231a8322-0bdd-4699-9128-b68e343c65d2" returned: 0 in 0.288s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:02:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-cc69df16-b5d4-4bcd-8ce4-83e460d74ae1 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Lock "cinder-quobyte-231a8322-0bdd-4699-9128-b68e343c65d2" released by "delete_volume" :: held 0.780s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:02:22 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-cc69df16-b5d4-4bcd-8ce4-83e460d74ae1 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Created reservations ['36aded83-6ba5-4c17-8ffc-7cc53178208e', '830c9ea6-dafd-43b7-9892-55faefe254b8', 'dbac2b2d-ca4d-4ef5-b698-30ccdd83a54e', '79df4385-bc36-410d-ba67-11ad459604e3'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:02:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cc69df16-b5d4-4bcd-8ce4-83e460d74ae1 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:02:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cc69df16-b5d4-4bcd-8ce4-83e460d74ae1 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:02:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cc69df16-b5d4-4bcd-8ce4-83e460d74ae1 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:02:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cc69df16-b5d4-4bcd-8ce4-83e460d74ae1 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:02:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cc69df16-b5d4-4bcd-8ce4-83e460d74ae1 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:02:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cc69df16-b5d4-4bcd-8ce4-83e460d74ae1 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:02:22 devstack sudo[105238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:02:22 devstack sudo[105238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:02:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-67a47bec-b20a-402e-99cd-0bd5f0cee978 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Acquiring lock "cinder-7b1bf9e9-e080-404f-a10d-00eaa9c1c116-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:02:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-67a47bec-b20a-402e-99cd-0bd5f0cee978 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Lock "cinder-7b1bf9e9-e080-404f-a10d-00eaa9c1c116-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:02:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-67a47bec-b20a-402e-99cd-0bd5f0cee978 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Acquiring lock "cinder-quobyte-7b1bf9e9-e080-404f-a10d-00eaa9c1c116" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:02:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-67a47bec-b20a-402e-99cd-0bd5f0cee978 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Lock "cinder-quobyte-7b1bf9e9-e080-404f-a10d-00eaa9c1c116" acquired by "delete_volume" :: waited 0.026s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:02:22 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[88972224-a8a3-4b1a-b093-9082261c6d38]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:02:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-67a47bec-b20a-402e-99cd-0bd5f0cee978 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-7b1bf9e9-e080-404f-a10d-00eaa9c1c116 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:02:22 devstack sudo[105238]: pam_unix(sudo:session): session closed for user root Sep 28 12:02:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cc69df16-b5d4-4bcd-8ce4-83e460d74ae1 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.308s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:02:22 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-cc69df16-b5d4-4bcd-8ce4-83e460d74ae1 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:02:22 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-cc69df16-b5d4-4bcd-8ce4-83e460d74ae1 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Deleted volume successfully. Sep 28 12:02:22 devstack sudo[105240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-7b1bf9e9-e080-404f-a10d-00eaa9c1c116 Sep 28 12:02:22 devstack sudo[105240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:02:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-cc69df16-b5d4-4bcd-8ce4-83e460d74ae1 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Lock "cinder-231a8322-0bdd-4699-9128-b68e343c65d2-delete_volume" released by "delete_volume" :: held 1.413s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:02:23 devstack sudo[105240]: pam_unix(sudo:session): session closed for user root Sep 28 12:02:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-67a47bec-b20a-402e-99cd-0bd5f0cee978 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-7b1bf9e9-e080-404f-a10d-00eaa9c1c116" returned: 0 in 0.422s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:02:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-67a47bec-b20a-402e-99cd-0bd5f0cee978 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-7b1bf9e9-e080-404f-a10d-00eaa9c1c116 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:02:23 devstack sudo[105246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-7b1bf9e9-e080-404f-a10d-00eaa9c1c116 Sep 28 12:02:23 devstack sudo[105246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:02:23 devstack sudo[105246]: pam_unix(sudo:session): session closed for user root Sep 28 12:02:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-67a47bec-b20a-402e-99cd-0bd5f0cee978 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-7b1bf9e9-e080-404f-a10d-00eaa9c1c116" returned: 0 in 0.275s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:02:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-67a47bec-b20a-402e-99cd-0bd5f0cee978 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Lock "cinder-quobyte-7b1bf9e9-e080-404f-a10d-00eaa9c1c116" released by "delete_volume" :: held 0.754s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:02:23 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9c7c8db-a522-449b-8dc0-c5de47e7f680 tempest-TestImageHashVerification-1584884133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:02:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c9c7c8db-a522-449b-8dc0-c5de47e7f680 tempest-TestImageHashVerification-1584884133 None] Flow 'volume_create_manager' (89d68e6a-d86b-4696-ae1a-18b311039c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:02:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c9c7c8db-a522-449b-8dc0-c5de47e7f680 tempest-TestImageHashVerification-1584884133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96c69800-d5f2-4692-9149-70ddb4215cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:02:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c9c7c8db-a522-449b-8dc0-c5de47e7f680 tempest-TestImageHashVerification-1584884133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96c69800-d5f2-4692-9149-70ddb4215cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:02:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1115917733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e6e3933-0799-42fd-8361-9759f06e0996,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31bed6fd0212452a8eeff4671c5a5d0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:02:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:02:23Z,use_quota=True,user_id='cd00354fff664a18961a26a056e4cc18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:02:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c9c7c8db-a522-449b-8dc0-c5de47e7f680 tempest-TestImageHashVerification-1584884133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1de4df48-0723-42d3-a84f-f60e3a08015b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:02:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c9c7c8db-a522-449b-8dc0-c5de47e7f680 tempest-TestImageHashVerification-1584884133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1de4df48-0723-42d3-a84f-f60e3a08015b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:02:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c9c7c8db-a522-449b-8dc0-c5de47e7f680 tempest-TestImageHashVerification-1584884133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a1d7d7d-b913-49e7-b1f7-23422d31990f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:02:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c9c7c8db-a522-449b-8dc0-c5de47e7f680 tempest-TestImageHashVerification-1584884133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a1d7d7d-b913-49e7-b1f7-23422d31990f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e6e3933-0799-42fd-8361-9759f06e0996', 'volume_name': 'volume-4e6e3933-0799-42fd-8361-9759f06e0996', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:02:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c9c7c8db-a522-449b-8dc0-c5de47e7f680 tempest-TestImageHashVerification-1584884133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f8e8ad8-c071-4a1c-833d-0b4b0d38e920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:02:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c9c7c8db-a522-449b-8dc0-c5de47e7f680 tempest-TestImageHashVerification-1584884133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f8e8ad8-c071-4a1c-833d-0b4b0d38e920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:02:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c9c7c8db-a522-449b-8dc0-c5de47e7f680 tempest-TestImageHashVerification-1584884133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17ff47de-0d47-4828-b45a-cb81dbf191ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:02:23 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-c9c7c8db-a522-449b-8dc0-c5de47e7f680 tempest-TestImageHashVerification-1584884133 None] Volume 4e6e3933-0799-42fd-8361-9759f06e0996: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e6e3933-0799-42fd-8361-9759f06e0996', 'volume_size': 1} Sep 28 12:02:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c9c7c8db-a522-449b-8dc0-c5de47e7f680 tempest-TestImageHashVerification-1584884133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:02:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c9c7c8db-a522-449b-8dc0-c5de47e7f680 tempest-TestImageHashVerification-1584884133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:02:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c9c7c8db-a522-449b-8dc0-c5de47e7f680 tempest-TestImageHashVerification-1584884133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:02:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1115917733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e6e3933-0799-42fd-8361-9759f06e0996,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31bed6fd0212452a8eeff4671c5a5d0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:02:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:02:23Z,use_quota=True,user_id='cd00354fff664a18961a26a056e4cc18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:02:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-c9c7c8db-a522-449b-8dc0-c5de47e7f680 tempest-TestImageHashVerification-1584884133 None] Creating volume 4e6e3933-0799-42fd-8361-9759f06e0996 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:02:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c9c7c8db-a522-449b-8dc0-c5de47e7f680 tempest-TestImageHashVerification-1584884133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:02:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c9c7c8db-a522-449b-8dc0-c5de47e7f680 tempest-TestImageHashVerification-1584884133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:02:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c9c7c8db-a522-449b-8dc0-c5de47e7f680 tempest-TestImageHashVerification-1584884133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:02:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c9c7c8db-a522-449b-8dc0-c5de47e7f680 tempest-TestImageHashVerification-1584884133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:02:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c9c7c8db-a522-449b-8dc0-c5de47e7f680 tempest-TestImageHashVerification-1584884133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:02:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c9c7c8db-a522-449b-8dc0-c5de47e7f680 tempest-TestImageHashVerification-1584884133 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:02:23 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-c9c7c8db-a522-449b-8dc0-c5de47e7f680 tempest-TestImageHashVerification-1584884133 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:02:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c9c7c8db-a522-449b-8dc0-c5de47e7f680 tempest-TestImageHashVerification-1584884133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4e6e3933-0799-42fd-8361-9759f06e0996 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:02:23 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-67a47bec-b20a-402e-99cd-0bd5f0cee978 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Created reservations ['45aaf816-b785-45b9-b304-28e52456dae2', '9f972bcf-1e0f-48bf-acfc-0ed1f864ce57', 'e3244562-10ac-47c2-8ebf-fc0799da51b8', '275d5bcf-0af6-4c00-8303-39429c7e8349'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:02:23 devstack sudo[105249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4e6e3933-0799-42fd-8361-9759f06e0996 1073741824 Sep 28 12:02:23 devstack sudo[105249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:02:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-67a47bec-b20a-402e-99cd-0bd5f0cee978 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:02:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-67a47bec-b20a-402e-99cd-0bd5f0cee978 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:02:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-67a47bec-b20a-402e-99cd-0bd5f0cee978 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:02:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-67a47bec-b20a-402e-99cd-0bd5f0cee978 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:02:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-67a47bec-b20a-402e-99cd-0bd5f0cee978 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:02:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-67a47bec-b20a-402e-99cd-0bd5f0cee978 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:02:23 devstack sudo[105251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:02:23 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:02:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-47a636c2-de80-4c6f-a04e-cf4a9e00919a tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Acquiring lock "cinder-85db801d-9363-47fc-85f2-687e03c110e1-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:02:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-47a636c2-de80-4c6f-a04e-cf4a9e00919a tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Lock "cinder-85db801d-9363-47fc-85f2-687e03c110e1-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:02:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-47a636c2-de80-4c6f-a04e-cf4a9e00919a tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Acquiring lock "cinder-quobyte-85db801d-9363-47fc-85f2-687e03c110e1" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:02:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-47a636c2-de80-4c6f-a04e-cf4a9e00919a tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Lock "cinder-quobyte-85db801d-9363-47fc-85f2-687e03c110e1" acquired by "delete_volume" :: waited 0.021s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:02:23 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb51948-224c-41f1-a862-253df913406c]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:02:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-47a636c2-de80-4c6f-a04e-cf4a9e00919a tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-85db801d-9363-47fc-85f2-687e03c110e1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:02:23 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root Sep 28 12:02:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-67a47bec-b20a-402e-99cd-0bd5f0cee978 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.294s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:02:23 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-67a47bec-b20a-402e-99cd-0bd5f0cee978 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:02:23 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-67a47bec-b20a-402e-99cd-0bd5f0cee978 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Deleted volume successfully. Sep 28 12:02:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-67a47bec-b20a-402e-99cd-0bd5f0cee978 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Lock "cinder-7b1bf9e9-e080-404f-a10d-00eaa9c1c116-delete_volume" released by "delete_volume" :: held 1.398s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:02:23 devstack sudo[105256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-85db801d-9363-47fc-85f2-687e03c110e1 Sep 28 12:02:23 devstack sudo[105256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:02:23 devstack sudo[105249]: pam_unix(sudo:session): session closed for user root Sep 28 12:02:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c9c7c8db-a522-449b-8dc0-c5de47e7f680 tempest-TestImageHashVerification-1584884133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4e6e3933-0799-42fd-8361-9759f06e0996 1073741824" returned: 0 in 0.533s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:02:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c9c7c8db-a522-449b-8dc0-c5de47e7f680 tempest-TestImageHashVerification-1584884133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4e6e3933-0799-42fd-8361-9759f06e0996 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:02:24 devstack sudo[105260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4e6e3933-0799-42fd-8361-9759f06e0996 Sep 28 12:02:24 devstack sudo[105260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:02:24 devstack sudo[105256]: pam_unix(sudo:session): session closed for user root Sep 28 12:02:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-47a636c2-de80-4c6f-a04e-cf4a9e00919a tempest-CreateVolumesFromSourceVolumeTest-663662933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-85db801d-9363-47fc-85f2-687e03c110e1" returned: 0 in 0.485s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:02:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-47a636c2-de80-4c6f-a04e-cf4a9e00919a tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-85db801d-9363-47fc-85f2-687e03c110e1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:02:24 devstack sudo[105265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-85db801d-9363-47fc-85f2-687e03c110e1 Sep 28 12:02:24 devstack sudo[105265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:02:24 devstack sudo[105260]: pam_unix(sudo:session): session closed for user root Sep 28 12:02:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c9c7c8db-a522-449b-8dc0-c5de47e7f680 tempest-TestImageHashVerification-1584884133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4e6e3933-0799-42fd-8361-9759f06e0996" returned: 0 in 0.295s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:02:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c9c7c8db-a522-449b-8dc0-c5de47e7f680 tempest-TestImageHashVerification-1584884133 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:02:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c9c7c8db-a522-449b-8dc0-c5de47e7f680 tempest-TestImageHashVerification-1584884133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:02:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c9c7c8db-a522-449b-8dc0-c5de47e7f680 tempest-TestImageHashVerification-1584884133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17ff47de-0d47-4828-b45a-cb81dbf191ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e6e3933-0799-42fd-8361-9759f06e0996', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:02:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c9c7c8db-a522-449b-8dc0-c5de47e7f680 tempest-TestImageHashVerification-1584884133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3660958-1b5e-48d0-a66a-a2917667698b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:02:24 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-c9c7c8db-a522-449b-8dc0-c5de47e7f680 tempest-TestImageHashVerification-1584884133 None] Volume volume-4e6e3933-0799-42fd-8361-9759f06e0996 (4e6e3933-0799-42fd-8361-9759f06e0996): created successfully Sep 28 12:02:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c9c7c8db-a522-449b-8dc0-c5de47e7f680 tempest-TestImageHashVerification-1584884133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3660958-1b5e-48d0-a66a-a2917667698b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:02:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c9c7c8db-a522-449b-8dc0-c5de47e7f680 tempest-TestImageHashVerification-1584884133 None] Flow 'volume_create_manager' (89d68e6a-d86b-4696-ae1a-18b311039c37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:02:24 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-c9c7c8db-a522-449b-8dc0-c5de47e7f680 tempest-TestImageHashVerification-1584884133 None] Created volume successfully. Sep 28 12:02:24 devstack sudo[105265]: pam_unix(sudo:session): session closed for user root Sep 28 12:02:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-47a636c2-de80-4c6f-a04e-cf4a9e00919a tempest-CreateVolumesFromSourceVolumeTest-663662933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-85db801d-9363-47fc-85f2-687e03c110e1" returned: 0 in 0.296s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:02:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-47a636c2-de80-4c6f-a04e-cf4a9e00919a tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Lock "cinder-quobyte-85db801d-9363-47fc-85f2-687e03c110e1" released by "delete_volume" :: held 0.825s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:02:24 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-47a636c2-de80-4c6f-a04e-cf4a9e00919a tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Created reservations ['3711a595-4964-4c64-9420-ab73a7844cfa', '4c269e4f-f58b-4fe9-bd8f-6ff883d3f18f', '100f9329-1274-4dcf-a8c2-13e89ef84caa', 'ad9c3cdd-8a88-434f-91a3-ead7a829e2e3'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:02:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-47a636c2-de80-4c6f-a04e-cf4a9e00919a tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:02:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-47a636c2-de80-4c6f-a04e-cf4a9e00919a tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:02:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-47a636c2-de80-4c6f-a04e-cf4a9e00919a tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:02:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-47a636c2-de80-4c6f-a04e-cf4a9e00919a tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:02:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-47a636c2-de80-4c6f-a04e-cf4a9e00919a tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:02:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-47a636c2-de80-4c6f-a04e-cf4a9e00919a tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:02:24 devstack sudo[105269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:02:24 devstack sudo[105269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:02:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4a61504b-ceca-45ff-93b6-1163ef7c28e8 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Acquiring lock "cinder-5f9256bb-4990-429f-9ebf-62bab878b700-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:02:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4a61504b-ceca-45ff-93b6-1163ef7c28e8 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Lock "cinder-5f9256bb-4990-429f-9ebf-62bab878b700-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:02:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4a61504b-ceca-45ff-93b6-1163ef7c28e8 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Acquiring lock "cinder-quobyte-5f9256bb-4990-429f-9ebf-62bab878b700" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:02:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4a61504b-ceca-45ff-93b6-1163ef7c28e8 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Lock "cinder-quobyte-5f9256bb-4990-429f-9ebf-62bab878b700" acquired by "delete_volume" :: waited 0.023s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:02:24 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[081e47e7-dccb-473e-812d-88dfedb6ea54]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:02:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4a61504b-ceca-45ff-93b6-1163ef7c28e8 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5f9256bb-4990-429f-9ebf-62bab878b700 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:02:24 devstack sudo[105269]: pam_unix(sudo:session): session closed for user root Sep 28 12:02:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-47a636c2-de80-4c6f-a04e-cf4a9e00919a tempest-CreateVolumesFromSourceVolumeTest-663662933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.280s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:02:24 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-47a636c2-de80-4c6f-a04e-cf4a9e00919a tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:02:24 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-47a636c2-de80-4c6f-a04e-cf4a9e00919a tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Deleted volume successfully. Sep 28 12:02:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-47a636c2-de80-4c6f-a04e-cf4a9e00919a tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Lock "cinder-85db801d-9363-47fc-85f2-687e03c110e1-delete_volume" released by "delete_volume" :: held 1.331s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:02:25 devstack sudo[105272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5f9256bb-4990-429f-9ebf-62bab878b700 Sep 28 12:02:25 devstack sudo[105272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:02:25 devstack sudo[105272]: pam_unix(sudo:session): session closed for user root Sep 28 12:02:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4a61504b-ceca-45ff-93b6-1163ef7c28e8 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5f9256bb-4990-429f-9ebf-62bab878b700" returned: 0 in 0.375s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:02:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4a61504b-ceca-45ff-93b6-1163ef7c28e8 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5f9256bb-4990-429f-9ebf-62bab878b700 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:02:25 devstack sudo[105278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5f9256bb-4990-429f-9ebf-62bab878b700 Sep 28 12:02:25 devstack sudo[105278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:02:25 devstack sudo[105278]: pam_unix(sudo:session): session closed for user root Sep 28 12:02:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4a61504b-ceca-45ff-93b6-1163ef7c28e8 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5f9256bb-4990-429f-9ebf-62bab878b700" returned: 0 in 0.258s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:02:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4a61504b-ceca-45ff-93b6-1163ef7c28e8 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Lock "cinder-quobyte-5f9256bb-4990-429f-9ebf-62bab878b700" released by "delete_volume" :: held 0.681s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:02:25 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-4a61504b-ceca-45ff-93b6-1163ef7c28e8 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Created reservations ['92eeceaf-08a5-4425-9666-a7186d05a708', 'f361da17-77be-4538-a5aa-6b485aae5833', '3546810a-72cd-4783-8006-69a5cede1e0a', '9396885a-66fb-4335-a4b0-a4166f092b70'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:02:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4a61504b-ceca-45ff-93b6-1163ef7c28e8 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:02:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4a61504b-ceca-45ff-93b6-1163ef7c28e8 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:02:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4a61504b-ceca-45ff-93b6-1163ef7c28e8 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:02:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4a61504b-ceca-45ff-93b6-1163ef7c28e8 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:02:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4a61504b-ceca-45ff-93b6-1163ef7c28e8 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:02:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4a61504b-ceca-45ff-93b6-1163ef7c28e8 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:02:25 devstack sudo[105281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:02:25 devstack sudo[105281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:02:25 devstack sudo[105281]: pam_unix(sudo:session): session closed for user root Sep 28 12:02:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4a61504b-ceca-45ff-93b6-1163ef7c28e8 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.254s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:02:26 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-4a61504b-ceca-45ff-93b6-1163ef7c28e8 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:02:26 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-4a61504b-ceca-45ff-93b6-1163ef7c28e8 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Deleted volume successfully. Sep 28 12:02:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4a61504b-ceca-45ff-93b6-1163ef7c28e8 tempest-CreateVolumesFromSourceVolumeTest-663662933 None] Lock "cinder-5f9256bb-4990-429f-9ebf-62bab878b700-delete_volume" released by "delete_volume" :: held 1.174s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:02:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1a6991d6-aeb5-4074-a0b6-af3cee5d6836 tempest-TestImageHashVerification-1584884133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:02:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1a6991d6-aeb5-4074-a0b6-af3cee5d6836 tempest-TestImageHashVerification-1584884133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:02:26 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[e266e224-373b-48de-8bc9-10d0bc741f98]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:02:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1a6991d6-aeb5-4074-a0b6-af3cee5d6836 tempest-TestImageHashVerification-1584884133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4e6e3933-0799-42fd-8361-9759f06e0996 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:02:26 devstack sudo[105284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4e6e3933-0799-42fd-8361-9759f06e0996 Sep 28 12:02:26 devstack sudo[105284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:02:26 devstack sudo[105284]: pam_unix(sudo:session): session closed for user root Sep 28 12:02:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1a6991d6-aeb5-4074-a0b6-af3cee5d6836 tempest-TestImageHashVerification-1584884133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4e6e3933-0799-42fd-8361-9759f06e0996" returned: 0 in 0.380s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:02:26 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0d481b-17e1-4900-ab82-d03093b9ccaf]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:02:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1a6991d6-aeb5-4074-a0b6-af3cee5d6836 tempest-TestImageHashVerification-1584884133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4e6e3933-0799-42fd-8361-9759f06e0996 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:02:26 devstack sudo[105289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4e6e3933-0799-42fd-8361-9759f06e0996 Sep 28 12:02:26 devstack sudo[105289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:02:27 devstack sudo[105289]: pam_unix(sudo:session): session closed for user root Sep 28 12:02:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1a6991d6-aeb5-4074-a0b6-af3cee5d6836 tempest-TestImageHashVerification-1584884133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4e6e3933-0799-42fd-8361-9759f06e0996" returned: 0 in 0.388s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:02:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1a6991d6-aeb5-4074-a0b6-af3cee5d6836 tempest-TestImageHashVerification-1584884133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4e6e3933-0799-42fd-8361-9759f06e0996 /opt/stack/data/cinder/conversion/4e6e3933-0799-42fd-8361-9759f06e0996.temp_image.56a7cbbc-d08e-4d0e-b0de-c832e4441630uex06iom.img {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:02:27 devstack sudo[105294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4e6e3933-0799-42fd-8361-9759f06e0996 /opt/stack/data/cinder/conversion/4e6e3933-0799-42fd-8361-9759f06e0996.temp_image.56a7cbbc-d08e-4d0e-b0de-c832e4441630uex06iom.img Sep 28 12:02:27 devstack sudo[105294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:02:33 devstack sudo[105294]: pam_unix(sudo:session): session closed for user root Sep 28 12:02:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1a6991d6-aeb5-4074-a0b6-af3cee5d6836 tempest-TestImageHashVerification-1584884133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4e6e3933-0799-42fd-8361-9759f06e0996 /opt/stack/data/cinder/conversion/4e6e3933-0799-42fd-8361-9759f06e0996.temp_image.56a7cbbc-d08e-4d0e-b0de-c832e4441630uex06iom.img" returned: 0 in 6.807s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:02:33 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef98f3c-15b0-4f8a-8dc0-2dfc00387e12]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:02:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1a6991d6-aeb5-4074-a0b6-af3cee5d6836 tempest-TestImageHashVerification-1584884133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4e6e3933-0799-42fd-8361-9759f06e0996 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:02:34 devstack sudo[105308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4e6e3933-0799-42fd-8361-9759f06e0996 Sep 28 12:02:34 devstack sudo[105308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:02:34 devstack sudo[105308]: pam_unix(sudo:session): session closed for user root Sep 28 12:02:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1a6991d6-aeb5-4074-a0b6-af3cee5d6836 tempest-TestImageHashVerification-1584884133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4e6e3933-0799-42fd-8361-9759f06e0996" returned: 0 in 0.555s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:02:34 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-1a6991d6-aeb5-4074-a0b6-af3cee5d6836 tempest-TestImageHashVerification-1584884133 None] Image conversion details: src /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4e6e3933-0799-42fd-8361-9759f06e0996, size 1024.00 MB, duration 6.81 sec, destination /opt/stack/data/cinder/conversion/4e6e3933-0799-42fd-8361-9759f06e0996.temp_image.56a7cbbc-d08e-4d0e-b0de-c832e4441630uex06iom.img {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:02:34 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-1a6991d6-aeb5-4074-a0b6-af3cee5d6836 tempest-TestImageHashVerification-1584884133 None] Converted 1024.00 MB image at 150.40 MB/s Sep 28 12:02:34 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-1a6991d6-aeb5-4074-a0b6-af3cee5d6836 tempest-TestImageHashVerification-1584884133 None] 56a7cbbc-d08e-4d0e-b0de-c832e4441630 was raw, no need to convert to raw {{(pid=86916) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 28 12:02:38 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:02:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:02:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:02:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:02:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:02:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:02:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:02:38 devstack sudo[105313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:02:38 devstack sudo[105313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:02:38 devstack sudo[105313]: pam_unix(sudo:session): session closed for user root Sep 28 12:02:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.336s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:02:38 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:02:39 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:02:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] thread count: 28 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:02:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] thread info: [<_MainThread(MainThread, started 135408582168704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:02:44 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=28,cinder:INSERT=13,cinder:UPDATE=41,cinder:DELETE=2 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:02:44 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:INSERT=8,cinder:UPDATE=44,cinder:SELECT=25,cinder:DELETE=4 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:02:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1a6991d6-aeb5-4074-a0b6-af3cee5d6836 tempest-TestImageHashVerification-1584884133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.422s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:02:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1a6991d6-aeb5-4074-a0b6-af3cee5d6836 tempest-TestImageHashVerification-1584884133 None] Uploaded volume to glance image-id: 56a7cbbc-d08e-4d0e-b0de-c832e4441630. {{(pid=86916) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 12:02:53 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-1a6991d6-aeb5-4074-a0b6-af3cee5d6836 tempest-TestImageHashVerification-1584884133 None] Copy volume to image completed successfully. Sep 28 12:02:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-94df7ee5-8dda-456c-a3e3-cd04b7414b30 tempest-TestImageHashVerification-1584884133 None] Acquiring lock "cinder-4e6e3933-0799-42fd-8361-9759f06e0996-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:02:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-94df7ee5-8dda-456c-a3e3-cd04b7414b30 tempest-TestImageHashVerification-1584884133 None] Lock "cinder-4e6e3933-0799-42fd-8361-9759f06e0996-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:02:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-94df7ee5-8dda-456c-a3e3-cd04b7414b30 tempest-TestImageHashVerification-1584884133 None] Acquiring lock "cinder-quobyte-4e6e3933-0799-42fd-8361-9759f06e0996" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:02:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-94df7ee5-8dda-456c-a3e3-cd04b7414b30 tempest-TestImageHashVerification-1584884133 None] Lock "cinder-quobyte-4e6e3933-0799-42fd-8361-9759f06e0996" acquired by "delete_volume" :: waited 0.021s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:02:55 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5fb0492-8f45-4d5e-bc97-f776cfe69713]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:02:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-94df7ee5-8dda-456c-a3e3-cd04b7414b30 tempest-TestImageHashVerification-1584884133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4e6e3933-0799-42fd-8361-9759f06e0996 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:02:55 devstack sudo[105319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4e6e3933-0799-42fd-8361-9759f06e0996 Sep 28 12:02:55 devstack sudo[105319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:02:55 devstack sudo[105319]: pam_unix(sudo:session): session closed for user root Sep 28 12:02:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-94df7ee5-8dda-456c-a3e3-cd04b7414b30 tempest-TestImageHashVerification-1584884133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4e6e3933-0799-42fd-8361-9759f06e0996" returned: 0 in 0.387s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:02:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-94df7ee5-8dda-456c-a3e3-cd04b7414b30 tempest-TestImageHashVerification-1584884133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4e6e3933-0799-42fd-8361-9759f06e0996 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:02:55 devstack sudo[105324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4e6e3933-0799-42fd-8361-9759f06e0996 Sep 28 12:02:55 devstack sudo[105324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:02:55 devstack sudo[105324]: pam_unix(sudo:session): session closed for user root Sep 28 12:02:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-94df7ee5-8dda-456c-a3e3-cd04b7414b30 tempest-TestImageHashVerification-1584884133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4e6e3933-0799-42fd-8361-9759f06e0996" returned: 0 in 0.242s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:02:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-94df7ee5-8dda-456c-a3e3-cd04b7414b30 tempest-TestImageHashVerification-1584884133 None] Lock "cinder-quobyte-4e6e3933-0799-42fd-8361-9759f06e0996" released by "delete_volume" :: held 0.670s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:02:55 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-94df7ee5-8dda-456c-a3e3-cd04b7414b30 tempest-TestImageHashVerification-1584884133 None] Created reservations ['9c2adfb1-4f76-48bb-a14a-89db92487ef8', '6a5915c4-5c0c-465c-9b67-ba537e8c52c2', '4173abf3-2049-44f0-b44a-59291e254070', '02e61a83-fb47-410f-946c-2c1f2a56a832'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:02:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-94df7ee5-8dda-456c-a3e3-cd04b7414b30 tempest-TestImageHashVerification-1584884133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:02:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-94df7ee5-8dda-456c-a3e3-cd04b7414b30 tempest-TestImageHashVerification-1584884133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:02:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-94df7ee5-8dda-456c-a3e3-cd04b7414b30 tempest-TestImageHashVerification-1584884133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:02:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-94df7ee5-8dda-456c-a3e3-cd04b7414b30 tempest-TestImageHashVerification-1584884133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:02:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-94df7ee5-8dda-456c-a3e3-cd04b7414b30 tempest-TestImageHashVerification-1584884133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:02:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-94df7ee5-8dda-456c-a3e3-cd04b7414b30 tempest-TestImageHashVerification-1584884133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:02:55 devstack sudo[105327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:02:55 devstack sudo[105327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:02:56 devstack sudo[105327]: pam_unix(sudo:session): session closed for user root Sep 28 12:02:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-94df7ee5-8dda-456c-a3e3-cd04b7414b30 tempest-TestImageHashVerification-1584884133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.241s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:02:56 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-94df7ee5-8dda-456c-a3e3-cd04b7414b30 tempest-TestImageHashVerification-1584884133 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:02:56 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-94df7ee5-8dda-456c-a3e3-cd04b7414b30 tempest-TestImageHashVerification-1584884133 None] Deleted volume successfully. Sep 28 12:02:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-94df7ee5-8dda-456c-a3e3-cd04b7414b30 tempest-TestImageHashVerification-1584884133 None] Lock "cinder-4e6e3933-0799-42fd-8361-9759f06e0996-delete_volume" released by "delete_volume" :: held 1.118s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:03:05 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:UPDATE=8,cinder:SELECT=3,cinder:INSERT=2 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:03:06 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=8,cinder:UPDATE=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:03:27 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-619ed248-4a20-4615-94e9-07c6599db56e tempest-TestStampPattern-620350536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:03:27 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-619ed248-4a20-4615-94e9-07c6599db56e tempest-TestStampPattern-620350536 None] Flow 'volume_create_manager' (e7bb34c5-28eb-419a-8d25-be49931245b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:03:27 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-619ed248-4a20-4615-94e9-07c6599db56e tempest-TestStampPattern-620350536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1749de00-3012-460a-a42c-8f43e9b0bc0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:03:27 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-619ed248-4a20-4615-94e9-07c6599db56e tempest-TestStampPattern-620350536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1749de00-3012-460a-a42c-8f43e9b0bc0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-544598839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='374930197a5f4a5690cb6e0187bf26ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:03:28Z,use_quota=True,user_id='f2b7c47da73a4bac8f9506d39e4a92d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:03:27 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-619ed248-4a20-4615-94e9-07c6599db56e tempest-TestStampPattern-620350536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9365fe34-08aa-430c-93c9-9a6a9882fa2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:03:27 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-619ed248-4a20-4615-94e9-07c6599db56e tempest-TestStampPattern-620350536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9365fe34-08aa-430c-93c9-9a6a9882fa2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:03:27 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-619ed248-4a20-4615-94e9-07c6599db56e tempest-TestStampPattern-620350536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (283e7ff5-a5b6-4861-9740-af2f7c4d1e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:03:27 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-619ed248-4a20-4615-94e9-07c6599db56e tempest-TestStampPattern-620350536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (283e7ff5-a5b6-4861-9740-af2f7c4d1e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d', 'volume_name': 'volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:03:27 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-619ed248-4a20-4615-94e9-07c6599db56e tempest-TestStampPattern-620350536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59bf52b1-8673-4a98-9dd0-9f8d02b45935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:03:27 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-619ed248-4a20-4615-94e9-07c6599db56e tempest-TestStampPattern-620350536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59bf52b1-8673-4a98-9dd0-9f8d02b45935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:03:27 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-619ed248-4a20-4615-94e9-07c6599db56e tempest-TestStampPattern-620350536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53e5bb43-2482-4948-9df6-7c5c1ea3f7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:03:27 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-619ed248-4a20-4615-94e9-07c6599db56e tempest-TestStampPattern-620350536 None] Volume a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d', 'volume_size': 1} Sep 28 12:03:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-619ed248-4a20-4615-94e9-07c6599db56e tempest-TestStampPattern-620350536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:03:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-619ed248-4a20-4615-94e9-07c6599db56e tempest-TestStampPattern-620350536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:03:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-619ed248-4a20-4615-94e9-07c6599db56e tempest-TestStampPattern-620350536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-544598839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='374930197a5f4a5690cb6e0187bf26ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:03:28Z,use_quota=True,user_id='f2b7c47da73a4bac8f9506d39e4a92d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:03:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-619ed248-4a20-4615-94e9-07c6599db56e tempest-TestStampPattern-620350536 None] Creating volume a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:03:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-619ed248-4a20-4615-94e9-07c6599db56e tempest-TestStampPattern-620350536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:03:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-619ed248-4a20-4615-94e9-07c6599db56e tempest-TestStampPattern-620350536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:03:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-619ed248-4a20-4615-94e9-07c6599db56e tempest-TestStampPattern-620350536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:03:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-619ed248-4a20-4615-94e9-07c6599db56e tempest-TestStampPattern-620350536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:03:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-619ed248-4a20-4615-94e9-07c6599db56e tempest-TestStampPattern-620350536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:03:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-619ed248-4a20-4615-94e9-07c6599db56e tempest-TestStampPattern-620350536 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:03:27 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-619ed248-4a20-4615-94e9-07c6599db56e tempest-TestStampPattern-620350536 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:03:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-619ed248-4a20-4615-94e9-07c6599db56e tempest-TestStampPattern-620350536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:03:28 devstack sudo[105384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d 1073741824 Sep 28 12:03:28 devstack sudo[105384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:03:28 devstack sudo[105384]: pam_unix(sudo:session): session closed for user root Sep 28 12:03:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-619ed248-4a20-4615-94e9-07c6599db56e tempest-TestStampPattern-620350536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d 1073741824" returned: 0 in 0.426s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:03:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-619ed248-4a20-4615-94e9-07c6599db56e tempest-TestStampPattern-620350536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:03:28 devstack sudo[105390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d Sep 28 12:03:28 devstack sudo[105390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:03:28 devstack sudo[105390]: pam_unix(sudo:session): session closed for user root Sep 28 12:03:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-619ed248-4a20-4615-94e9-07c6599db56e tempest-TestStampPattern-620350536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d" returned: 0 in 0.252s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:03:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-619ed248-4a20-4615-94e9-07c6599db56e tempest-TestStampPattern-620350536 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:03:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-619ed248-4a20-4615-94e9-07c6599db56e tempest-TestStampPattern-620350536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:03:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-619ed248-4a20-4615-94e9-07c6599db56e tempest-TestStampPattern-620350536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53e5bb43-2482-4948-9df6-7c5c1ea3f7d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:03:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-619ed248-4a20-4615-94e9-07c6599db56e tempest-TestStampPattern-620350536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef02b985-74bc-42b2-aa4e-c9856290fccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:03:28 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-619ed248-4a20-4615-94e9-07c6599db56e tempest-TestStampPattern-620350536 None] Volume volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d (a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d): created successfully Sep 28 12:03:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-619ed248-4a20-4615-94e9-07c6599db56e tempest-TestStampPattern-620350536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef02b985-74bc-42b2-aa4e-c9856290fccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:03:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-619ed248-4a20-4615-94e9-07c6599db56e tempest-TestStampPattern-620350536 None] Flow 'volume_create_manager' (e7bb34c5-28eb-419a-8d25-be49931245b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:03:28 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-619ed248-4a20-4615-94e9-07c6599db56e tempest-TestStampPattern-620350536 None] Created volume successfully. Sep 28 12:03:38 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:03:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:03:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:03:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:03:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:03:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:03:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:03:38 devstack sudo[105498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:03:38 devstack sudo[105498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:03:38 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:03:38 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:UPDATE=2,cinder:SELECT=2,cinder:DELETE=1 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:03:38 devstack sudo[105498]: pam_unix(sudo:session): session closed for user root Sep 28 12:03:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.249s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:03:38 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:03:38 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:03:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] thread count: 28 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:03:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] thread info: [<_MainThread(MainThread, started 135408582168704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:03:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-9cc0e166-e39c-47fe-ad7b-d97c7b367675 req-ebb4b7b7-da1d-490b-a54c-638dc97f68a9 tempest-TestStampPattern-620350536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:03:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-9cc0e166-e39c-47fe-ad7b-d97c7b367675 req-ebb4b7b7-da1d-490b-a54c-638dc97f68a9 tempest-TestStampPattern-620350536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:03:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-9cc0e166-e39c-47fe-ad7b-d97c7b367675 req-ebb4b7b7-da1d-490b-a54c-638dc97f68a9 tempest-TestStampPattern-620350536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:03:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-9cc0e166-e39c-47fe-ad7b-d97c7b367675 req-ebb4b7b7-da1d-490b-a54c-638dc97f68a9 tempest-TestStampPattern-620350536 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0', 'name': 'volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '425c0200-fc86-48ad-ae35-431a55847e3c', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 12:03:57 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-9cc0e166-e39c-47fe-ad7b-d97c7b367675 req-ebb4b7b7-da1d-490b-a54c-638dc97f68a9 tempest-TestStampPattern-620350536 None] attachment_update completed successfully. Sep 28 12:04:03 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-fad9b702-1552-4bbc-a1cf-04e867acc2bc req-b82f9251-4d89-4cda-8362-a6c7f0299137 tempest-TestStampPattern-620350536 None] Terminate volume connection completed successfully. Sep 28 12:04:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-fad9b702-1552-4bbc-a1cf-04e867acc2bc req-b82f9251-4d89-4cda-8362-a6c7f0299137 tempest-TestStampPattern-620350536 None] Deleting attachment 425c0200-fc86-48ad-ae35-431a55847e3c. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 12:04:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-258035b8-e387-416b-9f25-341be3de761b tempest-TestStampPattern-620350536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:04:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-258035b8-e387-416b-9f25-341be3de761b tempest-TestStampPattern-620350536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:04:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-258035b8-e387-416b-9f25-341be3de761b tempest-TestStampPattern-620350536 None] Creating offline snapshot d432a059-c8f2-4343-98d0-096d247a5172 of volume a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:04:04 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ab6564-d344-4da8-a1f8-be654231055f]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:04:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-258035b8-e387-416b-9f25-341be3de761b tempest-TestStampPattern-620350536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:04:04 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d Sep 28 12:04:04 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:04:04 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Sep 28 12:04:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-258035b8-e387-416b-9f25-341be3de761b tempest-TestStampPattern-620350536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d" returned: 0 in 0.351s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:04:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-258035b8-e387-416b-9f25-341be3de761b tempest-TestStampPattern-620350536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d.d432a059-c8f2-4343-98d0-096d247a5172 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:04:04 devstack sudo[106011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d.d432a059-c8f2-4343-98d0-096d247a5172 1G Sep 28 12:04:04 devstack sudo[106011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:04:04 devstack sudo[106011]: pam_unix(sudo:session): session closed for user root Sep 28 12:04:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-258035b8-e387-416b-9f25-341be3de761b tempest-TestStampPattern-620350536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d.d432a059-c8f2-4343-98d0-096d247a5172 1G" returned: 0 in 0.405s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:04:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-258035b8-e387-416b-9f25-341be3de761b tempest-TestStampPattern-620350536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d.d432a059-c8f2-4343-98d0-096d247a5172 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:04:04 devstack sudo[106016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d.d432a059-c8f2-4343-98d0-096d247a5172 Sep 28 12:04:04 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:04:05 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root Sep 28 12:04:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-258035b8-e387-416b-9f25-341be3de761b tempest-TestStampPattern-620350536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d.d432a059-c8f2-4343-98d0-096d247a5172" returned: 0 in 0.303s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:04:05 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-258035b8-e387-416b-9f25-341be3de761b tempest-TestStampPattern-620350536 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d.d432a059-c8f2-4343-98d0-096d247a5172 is being set with open permissions: ugo+rw Sep 28 12:04:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-258035b8-e387-416b-9f25-341be3de761b tempest-TestStampPattern-620350536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d.d432a059-c8f2-4343-98d0-096d247a5172 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:04:05 devstack sudo[106021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d.d432a059-c8f2-4343-98d0-096d247a5172 Sep 28 12:04:05 devstack sudo[106021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:04:05 devstack sudo[106021]: pam_unix(sudo:session): session closed for user root Sep 28 12:04:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-258035b8-e387-416b-9f25-341be3de761b tempest-TestStampPattern-620350536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d.d432a059-c8f2-4343-98d0-096d247a5172" returned: 0 in 0.239s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:04:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-258035b8-e387-416b-9f25-341be3de761b tempest-TestStampPattern-620350536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:04:05 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d.info Sep 28 12:04:05 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:04:05 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Sep 28 12:04:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-258035b8-e387-416b-9f25-341be3de761b tempest-TestStampPattern-620350536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d.info" returned: 0 in 0.238s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:04:05 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-258035b8-e387-416b-9f25-341be3de761b tempest-TestStampPattern-620350536 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d.info is being set with open permissions: ugo+rw Sep 28 12:04:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-258035b8-e387-416b-9f25-341be3de761b tempest-TestStampPattern-620350536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:04:05 devstack sudo[106027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d.info Sep 28 12:04:05 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:04:05 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root Sep 28 12:04:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-258035b8-e387-416b-9f25-341be3de761b tempest-TestStampPattern-620350536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d.info" returned: 0 in 0.231s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:04:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-258035b8-e387-416b-9f25-341be3de761b tempest-TestStampPattern-620350536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.863s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:04:05 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-258035b8-e387-416b-9f25-341be3de761b tempest-TestStampPattern-620350536 None] Create snapshot completed successfully Sep 28 12:04:12 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d1f1420-455f-4bd5-b091-f04725998b30 tempest-TestStampPattern-620350536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:04:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0d1f1420-455f-4bd5-b091-f04725998b30 tempest-TestStampPattern-620350536 None] Flow 'volume_create_manager' (2b970063-4a7c-458d-aa44-3668734ddd71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:04:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0d1f1420-455f-4bd5-b091-f04725998b30 tempest-TestStampPattern-620350536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a069e56e-82db-4ab4-87f1-c25df2f9b29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:04:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0d1f1420-455f-4bd5-b091-f04725998b30 tempest-TestStampPattern-620350536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a069e56e-82db-4ab4-87f1-c25df2f9b29f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:04:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1388861219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fe6f259-154f-4e1d-90bd-6c1f720eee05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='374930197a5f4a5690cb6e0187bf26ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:04:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d432a059-c8f2-4343-98d0-096d247a5172,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:04:13Z,use_quota=True,user_id='f2b7c47da73a4bac8f9506d39e4a92d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:04:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0d1f1420-455f-4bd5-b091-f04725998b30 tempest-TestStampPattern-620350536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64f5094a-9078-45cc-ae23-1c013d489bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:04:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0d1f1420-455f-4bd5-b091-f04725998b30 tempest-TestStampPattern-620350536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64f5094a-9078-45cc-ae23-1c013d489bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:04:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0d1f1420-455f-4bd5-b091-f04725998b30 tempest-TestStampPattern-620350536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8579e43-4ea2-47f4-93fd-94dfcb9f02bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:04:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0d1f1420-455f-4bd5-b091-f04725998b30 tempest-TestStampPattern-620350536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8579e43-4ea2-47f4-93fd-94dfcb9f02bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3fe6f259-154f-4e1d-90bd-6c1f720eee05', 'volume_name': 'volume-3fe6f259-154f-4e1d-90bd-6c1f720eee05', 'volume_size': 1, 'snapshot_id': 'd432a059-c8f2-4343-98d0-096d247a5172'}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:04:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0d1f1420-455f-4bd5-b091-f04725998b30 tempest-TestStampPattern-620350536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a24ce7d7-0487-4f6a-a51e-b66813e82d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:04:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0d1f1420-455f-4bd5-b091-f04725998b30 tempest-TestStampPattern-620350536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a24ce7d7-0487-4f6a-a51e-b66813e82d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:04:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0d1f1420-455f-4bd5-b091-f04725998b30 tempest-TestStampPattern-620350536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1632c6c0-c653-4787-915f-bf1f6db32cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:04:13 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-0d1f1420-455f-4bd5-b091-f04725998b30 tempest-TestStampPattern-620350536 None] Volume 3fe6f259-154f-4e1d-90bd-6c1f720eee05: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3fe6f259-154f-4e1d-90bd-6c1f720eee05', 'volume_size': 1, 'snapshot_id': 'd432a059-c8f2-4343-98d0-096d247a5172'} Sep 28 12:04:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0d1f1420-455f-4bd5-b091-f04725998b30 tempest-TestStampPattern-620350536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:04:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0d1f1420-455f-4bd5-b091-f04725998b30 tempest-TestStampPattern-620350536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:04:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0d1f1420-455f-4bd5-b091-f04725998b30 tempest-TestStampPattern-620350536 None] Acquiring lock "cinder-quobyte-d432a059-c8f2-4343-98d0-096d247a5172-3fe6f259-154f-4e1d-90bd-6c1f720eee05" by "_create_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:04:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0d1f1420-455f-4bd5-b091-f04725998b30 tempest-TestStampPattern-620350536 None] Lock "cinder-quobyte-d432a059-c8f2-4343-98d0-096d247a5172-3fe6f259-154f-4e1d-90bd-6c1f720eee05" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:04:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0d1f1420-455f-4bd5-b091-f04725998b30 tempest-TestStampPattern-620350536 None] Creating volume 3fe6f259-154f-4e1d-90bd-6c1f720eee05 from snapshot d432a059-c8f2-4343-98d0-096d247a5172 {{(pid=86916) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 12:04:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0d1f1420-455f-4bd5-b091-f04725998b30 tempest-TestStampPattern-620350536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:04:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0d1f1420-455f-4bd5-b091-f04725998b30 tempest-TestStampPattern-620350536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:04:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0d1f1420-455f-4bd5-b091-f04725998b30 tempest-TestStampPattern-620350536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:04:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0d1f1420-455f-4bd5-b091-f04725998b30 tempest-TestStampPattern-620350536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:04:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0d1f1420-455f-4bd5-b091-f04725998b30 tempest-TestStampPattern-620350536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:04:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0d1f1420-455f-4bd5-b091-f04725998b30 tempest-TestStampPattern-620350536 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:04:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0d1f1420-455f-4bd5-b091-f04725998b30 tempest-TestStampPattern-620350536 None] Acquiring lock "cinder-quobyte-3fe6f259-154f-4e1d-90bd-6c1f720eee05" by "_copy_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:04:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0d1f1420-455f-4bd5-b091-f04725998b30 tempest-TestStampPattern-620350536 None] Lock "cinder-quobyte-3fe6f259-154f-4e1d-90bd-6c1f720eee05" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:04:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0d1f1420-455f-4bd5-b091-f04725998b30 tempest-TestStampPattern-620350536 None] snapshot: d432a059-c8f2-4343-98d0-096d247a5172, volume: 3fe6f259-154f-4e1d-90bd-6c1f720eee05, {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 12:04:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0d1f1420-455f-4bd5-b091-f04725998b30 tempest-TestStampPattern-620350536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:04:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0d1f1420-455f-4bd5-b091-f04725998b30 tempest-TestStampPattern-620350536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:04:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0d1f1420-455f-4bd5-b091-f04725998b30 tempest-TestStampPattern-620350536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:04:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0d1f1420-455f-4bd5-b091-f04725998b30 tempest-TestStampPattern-620350536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:04:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0d1f1420-455f-4bd5-b091-f04725998b30 tempest-TestStampPattern-620350536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:04:13 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db14a09-84cd-4b79-b57a-b3e3699519d7]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:04:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0d1f1420-455f-4bd5-b091-f04725998b30 tempest-TestStampPattern-620350536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d.d432a059-c8f2-4343-98d0-096d247a5172 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:04:13 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d.d432a059-c8f2-4343-98d0-096d247a5172 Sep 28 12:04:13 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:04:13 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Sep 28 12:04:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0d1f1420-455f-4bd5-b091-f04725998b30 tempest-TestStampPattern-620350536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d.d432a059-c8f2-4343-98d0-096d247a5172" returned: 0 in 0.391s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:04:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-0d1f1420-455f-4bd5-b091-f04725998b30 tempest-TestStampPattern-620350536 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:04:13 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3023c93-f2c9-47e2-878b-dc593df84e97]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:04:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0d1f1420-455f-4bd5-b091-f04725998b30 tempest-TestStampPattern-620350536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:04:13 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d Sep 28 12:04:13 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:04:14 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Sep 28 12:04:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0d1f1420-455f-4bd5-b091-f04725998b30 tempest-TestStampPattern-620350536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d" returned: 0 in 0.408s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:04:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0d1f1420-455f-4bd5-b091-f04725998b30 tempest-TestStampPattern-620350536 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 12:04:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0d1f1420-455f-4bd5-b091-f04725998b30 tempest-TestStampPattern-620350536 None] Creating direct copy from snapshot {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 12:04:14 devstack cinder-volume[86916]: DEBUG cinder.utils [None req-0d1f1420-455f-4bd5-b091-f04725998b30 tempest-TestStampPattern-620350536 None] Path /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3fe6f259-154f-4e1d-90bd-6c1f720eee05 not found in is_blk_device check {{(pid=86916) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 12:04:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0d1f1420-455f-4bd5-b091-f04725998b30 tempest-TestStampPattern-620350536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3fe6f259-154f-4e1d-90bd-6c1f720eee05 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:04:14 devstack sudo[106118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3fe6f259-154f-4e1d-90bd-6c1f720eee05 Sep 28 12:04:14 devstack sudo[106118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:04:22 devstack sudo[106118]: pam_unix(sudo:session): session closed for user root Sep 28 12:04:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0d1f1420-455f-4bd5-b091-f04725998b30 tempest-TestStampPattern-620350536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3fe6f259-154f-4e1d-90bd-6c1f720eee05" returned: 0 in 8.180s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:04:22 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-0d1f1420-455f-4bd5-b091-f04725998b30 tempest-TestStampPattern-620350536 None] Image conversion details: src /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d, size 1024.00 MB, duration 8.18 sec, destination /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3fe6f259-154f-4e1d-90bd-6c1f720eee05 {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:04:22 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-0d1f1420-455f-4bd5-b091-f04725998b30 tempest-TestStampPattern-620350536 None] Converted 1024.00 MB image at 125.12 MB/s Sep 28 12:04:22 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-0d1f1420-455f-4bd5-b091-f04725998b30 tempest-TestStampPattern-620350536 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3fe6f259-154f-4e1d-90bd-6c1f720eee05 is being set with open permissions: ugo+rw Sep 28 12:04:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0d1f1420-455f-4bd5-b091-f04725998b30 tempest-TestStampPattern-620350536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3fe6f259-154f-4e1d-90bd-6c1f720eee05 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:04:22 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3fe6f259-154f-4e1d-90bd-6c1f720eee05 Sep 28 12:04:22 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:04:22 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Sep 28 12:04:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0d1f1420-455f-4bd5-b091-f04725998b30 tempest-TestStampPattern-620350536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3fe6f259-154f-4e1d-90bd-6c1f720eee05" returned: 0 in 0.294s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:04:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0d1f1420-455f-4bd5-b091-f04725998b30 tempest-TestStampPattern-620350536 None] Lock "cinder-quobyte-3fe6f259-154f-4e1d-90bd-6c1f720eee05" released by "_copy_volume_from_snapshot" :: held 9.396s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:04:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0d1f1420-455f-4bd5-b091-f04725998b30 tempest-TestStampPattern-620350536 None] Lock "cinder-quobyte-d432a059-c8f2-4343-98d0-096d247a5172-3fe6f259-154f-4e1d-90bd-6c1f720eee05" released by "_create_volume_from_snapshot" :: held 9.482s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:04:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0d1f1420-455f-4bd5-b091-f04725998b30 tempest-TestStampPattern-620350536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.499s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:04:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0d1f1420-455f-4bd5-b091-f04725998b30 tempest-TestStampPattern-620350536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1632c6c0-c653-4787-915f-bf1f6db32cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fe6f259-154f-4e1d-90bd-6c1f720eee05', 'volume_size': 1, 'snapshot_id': 'd432a059-c8f2-4343-98d0-096d247a5172'}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:04:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0d1f1420-455f-4bd5-b091-f04725998b30 tempest-TestStampPattern-620350536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b835aeb-6ada-4595-8bb0-4a3bd1e810f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:04:22 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-0d1f1420-455f-4bd5-b091-f04725998b30 tempest-TestStampPattern-620350536 None] Volume volume-3fe6f259-154f-4e1d-90bd-6c1f720eee05 (3fe6f259-154f-4e1d-90bd-6c1f720eee05): created successfully Sep 28 12:04:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0d1f1420-455f-4bd5-b091-f04725998b30 tempest-TestStampPattern-620350536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b835aeb-6ada-4595-8bb0-4a3bd1e810f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:04:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0d1f1420-455f-4bd5-b091-f04725998b30 tempest-TestStampPattern-620350536 None] Flow 'volume_create_manager' (2b970063-4a7c-458d-aa44-3668734ddd71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:04:22 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-0d1f1420-455f-4bd5-b091-f04725998b30 tempest-TestStampPattern-620350536 None] Created volume successfully. Sep 28 12:04:32 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=13,cinder:UPDATE=4,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:04:32 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=17,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:04:38 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:04:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:04:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:04:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:04:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:04:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:04:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:04:38 devstack sudo[106239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:04:38 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:04:38 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root Sep 28 12:04:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.252s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:04:38 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:04:38 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:04:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] thread count: 28 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:04:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] thread info: [<_MainThread(MainThread, started 135408582168704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:05:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-7a55b5be-13d0-4bcf-9ee0-d1b34e13feaf req-197885c1-a405-4794-a3cb-10198b7f160b tempest-TestStampPattern-620350536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:05:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-7a55b5be-13d0-4bcf-9ee0-d1b34e13feaf req-197885c1-a405-4794-a3cb-10198b7f160b tempest-TestStampPattern-620350536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:05:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-7a55b5be-13d0-4bcf-9ee0-d1b34e13feaf req-197885c1-a405-4794-a3cb-10198b7f160b tempest-TestStampPattern-620350536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:05:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-7a55b5be-13d0-4bcf-9ee0-d1b34e13feaf req-197885c1-a405-4794-a3cb-10198b7f160b tempest-TestStampPattern-620350536 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0', 'name': 'volume-3fe6f259-154f-4e1d-90bd-6c1f720eee05', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2494a264-bd33-41b3-89dd-10a590f107f7', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 12:05:04 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-7a55b5be-13d0-4bcf-9ee0-d1b34e13feaf req-197885c1-a405-4794-a3cb-10198b7f160b tempest-TestStampPattern-620350536 None] attachment_update completed successfully. Sep 28 12:05:07 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-72c985ef-a998-4966-bd6a-8528ca550ccb req-4a88538a-bcc7-4695-9640-80d8b6609e4c tempest-TestStampPattern-620350536 None] Terminate volume connection completed successfully. Sep 28 12:05:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-72c985ef-a998-4966-bd6a-8528ca550ccb req-4a88538a-bcc7-4695-9640-80d8b6609e4c tempest-TestStampPattern-620350536 None] Deleting attachment 2494a264-bd33-41b3-89dd-10a590f107f7. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 12:05:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1c19510c-6e58-4fed-bdcd-f468e76cc428 tempest-TestStampPattern-620350536 None] Acquiring lock "cinder-3fe6f259-154f-4e1d-90bd-6c1f720eee05-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:05:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1c19510c-6e58-4fed-bdcd-f468e76cc428 tempest-TestStampPattern-620350536 None] Lock "cinder-3fe6f259-154f-4e1d-90bd-6c1f720eee05-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:05:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1c19510c-6e58-4fed-bdcd-f468e76cc428 tempest-TestStampPattern-620350536 None] Acquiring lock "cinder-quobyte-3fe6f259-154f-4e1d-90bd-6c1f720eee05" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:05:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1c19510c-6e58-4fed-bdcd-f468e76cc428 tempest-TestStampPattern-620350536 None] Lock "cinder-quobyte-3fe6f259-154f-4e1d-90bd-6c1f720eee05" acquired by "delete_volume" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:05:12 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9514cd-be92-4af9-ac0a-635ad0cc5f5e]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:05:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1c19510c-6e58-4fed-bdcd-f468e76cc428 tempest-TestStampPattern-620350536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3fe6f259-154f-4e1d-90bd-6c1f720eee05 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:05:12 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3fe6f259-154f-4e1d-90bd-6c1f720eee05 Sep 28 12:05:12 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:05:12 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Sep 28 12:05:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1c19510c-6e58-4fed-bdcd-f468e76cc428 tempest-TestStampPattern-620350536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3fe6f259-154f-4e1d-90bd-6c1f720eee05" returned: 0 in 0.350s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:05:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1c19510c-6e58-4fed-bdcd-f468e76cc428 tempest-TestStampPattern-620350536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3fe6f259-154f-4e1d-90bd-6c1f720eee05 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:05:12 devstack sudo[106775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3fe6f259-154f-4e1d-90bd-6c1f720eee05 Sep 28 12:05:12 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:05:12 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root Sep 28 12:05:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1c19510c-6e58-4fed-bdcd-f468e76cc428 tempest-TestStampPattern-620350536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-3fe6f259-154f-4e1d-90bd-6c1f720eee05" returned: 0 in 0.237s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:05:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1c19510c-6e58-4fed-bdcd-f468e76cc428 tempest-TestStampPattern-620350536 None] Lock "cinder-quobyte-3fe6f259-154f-4e1d-90bd-6c1f720eee05" released by "delete_volume" :: held 0.634s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:05:12 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-1c19510c-6e58-4fed-bdcd-f468e76cc428 tempest-TestStampPattern-620350536 None] Created reservations ['cf19a0c1-3754-4b24-9cca-7a75d23a896b', '2f9131bf-2309-42e2-89d0-7a31d75ccf6c', '97f14dc4-0dc6-489d-85ac-b1ef9ca1577c', '8ecec640-64cb-4e4c-9fa4-506652250810'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:05:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1c19510c-6e58-4fed-bdcd-f468e76cc428 tempest-TestStampPattern-620350536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:05:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1c19510c-6e58-4fed-bdcd-f468e76cc428 tempest-TestStampPattern-620350536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:05:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1c19510c-6e58-4fed-bdcd-f468e76cc428 tempest-TestStampPattern-620350536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:05:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1c19510c-6e58-4fed-bdcd-f468e76cc428 tempest-TestStampPattern-620350536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:05:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1c19510c-6e58-4fed-bdcd-f468e76cc428 tempest-TestStampPattern-620350536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:05:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1c19510c-6e58-4fed-bdcd-f468e76cc428 tempest-TestStampPattern-620350536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:05:12 devstack sudo[106804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:05:12 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:05:13 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root Sep 28 12:05:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1c19510c-6e58-4fed-bdcd-f468e76cc428 tempest-TestStampPattern-620350536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.241s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:05:13 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-1c19510c-6e58-4fed-bdcd-f468e76cc428 tempest-TestStampPattern-620350536 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:05:13 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-1c19510c-6e58-4fed-bdcd-f468e76cc428 tempest-TestStampPattern-620350536 None] Deleted volume successfully. Sep 28 12:05:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1c19510c-6e58-4fed-bdcd-f468e76cc428 tempest-TestStampPattern-620350536 None] Lock "cinder-3fe6f259-154f-4e1d-90bd-6c1f720eee05-delete_volume" released by "delete_volume" :: held 1.087s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:05:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1069f656-20de-420d-be20-4ff62beef26c tempest-TestStampPattern-620350536 None] Acquiring lock "cinder-d432a059-c8f2-4343-98d0-096d247a5172-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:05:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1069f656-20de-420d-be20-4ff62beef26c tempest-TestStampPattern-620350536 None] Lock "cinder-d432a059-c8f2-4343-98d0-096d247a5172-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:05:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1069f656-20de-420d-be20-4ff62beef26c tempest-TestStampPattern-620350536 None] Acquiring lock "cinder-quobyte-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:05:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1069f656-20de-420d-be20-4ff62beef26c tempest-TestStampPattern-620350536 None] Lock "cinder-quobyte-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:05:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1069f656-20de-420d-be20-4ff62beef26c tempest-TestStampPattern-620350536 None] Acquiring lock "cinder-quobyte-d432a059-c8f2-4343-98d0-096d247a5172" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:05:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1069f656-20de-420d-be20-4ff62beef26c tempest-TestStampPattern-620350536 None] Lock "cinder-quobyte-d432a059-c8f2-4343-98d0-096d247a5172" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:05:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-1069f656-20de-420d-be20-4ff62beef26c tempest-TestStampPattern-620350536 None] Deleting offline snapshot d432a059-c8f2-4343-98d0-096d247a5172 of volume a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:05:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-1069f656-20de-420d-be20-4ff62beef26c tempest-TestStampPattern-620350536 None] snapshot_file for this snap is: volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d.d432a059-c8f2-4343-98d0-096d247a5172 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:05:13 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2902ffb-f46d-4623-b785-275dc1ee7bea]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:05:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1069f656-20de-420d-be20-4ff62beef26c tempest-TestStampPattern-620350536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d.d432a059-c8f2-4343-98d0-096d247a5172 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:05:13 devstack sudo[106807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d.d432a059-c8f2-4343-98d0-096d247a5172 Sep 28 12:05:13 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:05:13 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root Sep 28 12:05:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1069f656-20de-420d-be20-4ff62beef26c tempest-TestStampPattern-620350536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d.d432a059-c8f2-4343-98d0-096d247a5172" returned: 0 in 0.382s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:05:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-1069f656-20de-420d-be20-4ff62beef26c tempest-TestStampPattern-620350536 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:05:14 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[121fd3be-272e-4b17-a8e9-7b41d5a38d01]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:05:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1069f656-20de-420d-be20-4ff62beef26c tempest-TestStampPattern-620350536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:05:14 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d Sep 28 12:05:14 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:05:14 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Sep 28 12:05:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1069f656-20de-420d-be20-4ff62beef26c tempest-TestStampPattern-620350536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d" returned: 0 in 0.543s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:05:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1069f656-20de-420d-be20-4ff62beef26c tempest-TestStampPattern-620350536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d.d432a059-c8f2-4343-98d0-096d247a5172 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:05:14 devstack sudo[106824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d.d432a059-c8f2-4343-98d0-096d247a5172 Sep 28 12:05:14 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:05:14 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root Sep 28 12:05:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1069f656-20de-420d-be20-4ff62beef26c tempest-TestStampPattern-620350536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d.d432a059-c8f2-4343-98d0-096d247a5172" returned: 0 in 0.363s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:05:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1069f656-20de-420d-be20-4ff62beef26c tempest-TestStampPattern-620350536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d.d432a059-c8f2-4343-98d0-096d247a5172 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:05:14 devstack sudo[106831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d.d432a059-c8f2-4343-98d0-096d247a5172 Sep 28 12:05:14 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:05:15 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root Sep 28 12:05:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1069f656-20de-420d-be20-4ff62beef26c tempest-TestStampPattern-620350536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d.d432a059-c8f2-4343-98d0-096d247a5172" returned: 0 in 0.266s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:05:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1069f656-20de-420d-be20-4ff62beef26c tempest-TestStampPattern-620350536 None] Lock "cinder-quobyte-d432a059-c8f2-4343-98d0-096d247a5172" released by "_delete_snapshot" :: held 1.672s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:05:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1069f656-20de-420d-be20-4ff62beef26c tempest-TestStampPattern-620350536 None] Lock "cinder-quobyte-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d" released by "delete_snapshot" :: held 1.693s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:05:15 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-1069f656-20de-420d-be20-4ff62beef26c tempest-TestStampPattern-620350536 None] Created reservations ['b6a7ce83-01dc-4a59-8626-50b5c8a30612', '7ead351e-8ae3-4d02-80ba-2e3fe66f5fb1', '786a2fbf-8170-49a7-b1ad-a3f0a460aa5a', '5fc0f79f-3922-4f80-8595-990ca9d79dee'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:05:15 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-1069f656-20de-420d-be20-4ff62beef26c tempest-TestStampPattern-620350536 None] Delete snapshot completed successfully. Sep 28 12:05:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1069f656-20de-420d-be20-4ff62beef26c tempest-TestStampPattern-620350536 None] Lock "cinder-d432a059-c8f2-4343-98d0-096d247a5172-delete_snapshot" released by "delete_snapshot" :: held 1.830s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:05:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bb873f20-046b-4659-bfe9-d1e7dcdf4b1d tempest-TestStampPattern-620350536 None] Acquiring lock "cinder-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:05:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bb873f20-046b-4659-bfe9-d1e7dcdf4b1d tempest-TestStampPattern-620350536 None] Lock "cinder-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:05:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bb873f20-046b-4659-bfe9-d1e7dcdf4b1d tempest-TestStampPattern-620350536 None] Acquiring lock "cinder-quobyte-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:05:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bb873f20-046b-4659-bfe9-d1e7dcdf4b1d tempest-TestStampPattern-620350536 None] Lock "cinder-quobyte-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d" acquired by "delete_volume" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:05:19 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a057f7-1813-4f0a-ac5e-6a4811331ab5]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:05:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bb873f20-046b-4659-bfe9-d1e7dcdf4b1d tempest-TestStampPattern-620350536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:05:19 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d Sep 28 12:05:19 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:05:19 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Sep 28 12:05:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bb873f20-046b-4659-bfe9-d1e7dcdf4b1d tempest-TestStampPattern-620350536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d" returned: 0 in 0.384s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:05:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bb873f20-046b-4659-bfe9-d1e7dcdf4b1d tempest-TestStampPattern-620350536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:05:19 devstack sudo[106875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d Sep 28 12:05:19 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:05:19 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root Sep 28 12:05:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bb873f20-046b-4659-bfe9-d1e7dcdf4b1d tempest-TestStampPattern-620350536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d" returned: 0 in 0.244s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:05:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bb873f20-046b-4659-bfe9-d1e7dcdf4b1d tempest-TestStampPattern-620350536 None] Lock "cinder-quobyte-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d" released by "delete_volume" :: held 0.692s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:05:19 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-bb873f20-046b-4659-bfe9-d1e7dcdf4b1d tempest-TestStampPattern-620350536 None] Created reservations ['2c8284f3-6873-44d8-a4cc-6805bd6c7101', 'e2768694-804b-4df3-85fc-38e3aa080dd7', 'eb8786ed-1334-46a0-834f-10154a10e04c', '3898149b-74f2-46fc-9524-253fdefe4286'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:05:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bb873f20-046b-4659-bfe9-d1e7dcdf4b1d tempest-TestStampPattern-620350536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:05:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bb873f20-046b-4659-bfe9-d1e7dcdf4b1d tempest-TestStampPattern-620350536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:05:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bb873f20-046b-4659-bfe9-d1e7dcdf4b1d tempest-TestStampPattern-620350536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:05:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bb873f20-046b-4659-bfe9-d1e7dcdf4b1d tempest-TestStampPattern-620350536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:05:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bb873f20-046b-4659-bfe9-d1e7dcdf4b1d tempest-TestStampPattern-620350536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:05:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bb873f20-046b-4659-bfe9-d1e7dcdf4b1d tempest-TestStampPattern-620350536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:05:20 devstack sudo[106878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:05:20 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:05:20 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root Sep 28 12:05:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bb873f20-046b-4659-bfe9-d1e7dcdf4b1d tempest-TestStampPattern-620350536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.241s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:05:20 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-bb873f20-046b-4659-bfe9-d1e7dcdf4b1d tempest-TestStampPattern-620350536 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:05:20 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-bb873f20-046b-4659-bfe9-d1e7dcdf4b1d tempest-TestStampPattern-620350536 None] Deleted volume successfully. Sep 28 12:05:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bb873f20-046b-4659-bfe9-d1e7dcdf4b1d tempest-TestStampPattern-620350536 None] Lock "cinder-a3b9ebd0-c6fd-4d0c-a7f3-bddc4f014b5d-delete_volume" released by "delete_volume" :: held 1.154s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:05:30 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=24,cinder:UPDATE=26,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:05:30 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=22,cinder:UPDATE=20,cinder:INSERT=7,cinder:DELETE=1 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:05:33 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:05:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] Flow 'volume_create_manager' (deb5cf23-1ef8-42f4-a613-33ed04c94419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:05:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98dfdd6d-cc1f-4cf0-9589-9b038928130a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:05:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98dfdd6d-cc1f-4cf0-9589-9b038928130a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e319d94f-3502-4cb0-a97c-8a7fc49f72bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a63910e5ae4b43daa4cb612980317db4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:05:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:05:34Z,use_quota=True,user_id='8d9d495f4b294d8d8d666407d6c99591',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:05:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (127d0575-3673-428e-a0eb-d2c56356f712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:05:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (127d0575-3673-428e-a0eb-d2c56356f712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:05:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e3f43b0-e27a-43e3-846f-5acfde9c14c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:05:33 devstack cinder-volume[86916]: DEBUG cinder.image.glance [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] Creating Keystone auth plugin from conf {{(pid=86916) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 12:05:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e3f43b0-e27a-43e3-846f-5acfde9c14c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e319d94f-3502-4cb0-a97c-8a7fc49f72bd', 'volume_name': 'volume-e319d94f-3502-4cb0-a97c-8a7fc49f72bd', 'volume_size': 1, 'image_id': '79cfa681-b767-41fa-b678-04709d2a1c10', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/79cfa681-b767-41fa-b678-04709d2a1c10', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '788783a36f366b2865c11f2d49f32602', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a63910e5ae4b43daa4cb612980317db4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bc7194fb58af7e4d5318e2665daf18fe3dc5c6dcae4e4358c510df079430607e3f8393c1564c68a0935b6d64e6b585626dc9c63343a0b6c7bf728b5e27ba1f7b', 'id': '79cfa681-b767-41fa-b678-04709d2a1c10', 'created_at': datetime.datetime(2026, 9, 28, 10, 5, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 5, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/79cfa681-b767-41fa-b678-04709d2a1c10/file', 'properties': {}}, 'image_service': }' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:05:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc8679f8-2b78-47fc-94d4-f37fff3a8e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:05:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc8679f8-2b78-47fc-94d4-f37fff3a8e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:05:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8dca6ff-1321-4240-97f3-734da125a8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:05:33 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] Volume e319d94f-3502-4cb0-a97c-8a7fc49f72bd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e319d94f-3502-4cb0-a97c-8a7fc49f72bd', 'volume_size': 1, 'image_id': '79cfa681-b767-41fa-b678-04709d2a1c10', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/79cfa681-b767-41fa-b678-04709d2a1c10', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '788783a36f366b2865c11f2d49f32602', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a63910e5ae4b43daa4cb612980317db4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bc7194fb58af7e4d5318e2665daf18fe3dc5c6dcae4e4358c510df079430607e3f8393c1564c68a0935b6d64e6b585626dc9c63343a0b6c7bf728b5e27ba1f7b', 'id': '79cfa681-b767-41fa-b678-04709d2a1c10', 'created_at': datetime.datetime(2026, 9, 28, 10, 5, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 5, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/79cfa681-b767-41fa-b678-04709d2a1c10/file', 'properties': {}}, 'image_service': } Sep 28 12:05:33 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] Trying to clone e319d94f-3502-4cb0-a97c-8a7fc49f72bd from image 79cfa681-b767-41fa-b678-04709d2a1c10 at location (None, [{'url': 'file:///opt/stack/data/glance/images/79cfa681-b767-41fa-b678-04709d2a1c10', 'metadata': {}}]). {{(pid=86916) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 12:05:33 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_79cfa681-b767-41fa-b678-04709d2a1c10_o91pu5_edevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 12:05:33 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] Image download 0.00 MB at 0.00 MB/s Sep 28 12:05:34 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[9968c5e5-5c88-4265-8705-8900394b7eef]: (4, 'raw') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:05:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_79cfa681-b767-41fa-b678-04709d2a1c10_o91pu5_edevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:05:34 devstack sudo[106888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_79cfa681-b767-41fa-b678-04709d2a1c10_o91pu5_edevstack@QuobyteHD Sep 28 12:05:34 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:05:34 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root Sep 28 12:05:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_79cfa681-b767-41fa-b678-04709d2a1c10_o91pu5_edevstack@QuobyteHD" returned: 0 in 0.339s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:05:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79cfa681-b767-41fa-b678-04709d2a1c10_o91pu5_edevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:05:34 devstack sudo[106892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79cfa681-b767-41fa-b678-04709d2a1c10_o91pu5_edevstack@QuobyteHD Sep 28 12:05:34 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:05:34 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root Sep 28 12:05:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79cfa681-b767-41fa-b678-04709d2a1c10_o91pu5_edevstack@QuobyteHD" returned: 1 in 0.325s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:05:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79cfa681-b767-41fa-b678-04709d2a1c10_o91pu5_edevstack@QuobyteHD' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:05:34 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] Temporary image 79cfa681-b767-41fa-b678-04709d2a1c10 is fetched for user 8d9d495f4b294d8d8d666407d6c99591. {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 12:05:34 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1db91ae-b8b9-467e-9bab-9ee0da654f66]: (4, 'raw') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:05:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_79cfa681-b767-41fa-b678-04709d2a1c10_o91pu5_edevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:05:34 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_79cfa681-b767-41fa-b678-04709d2a1c10_o91pu5_edevstack@QuobyteHD Sep 28 12:05:34 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:05:35 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Sep 28 12:05:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_79cfa681-b767-41fa-b678-04709d2a1c10_o91pu5_edevstack@QuobyteHD" returned: 0 in 0.324s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:05:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79cfa681-b767-41fa-b678-04709d2a1c10_o91pu5_edevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:05:35 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79cfa681-b767-41fa-b678-04709d2a1c10_o91pu5_edevstack@QuobyteHD Sep 28 12:05:35 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:05:35 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Sep 28 12:05:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79cfa681-b767-41fa-b678-04709d2a1c10_o91pu5_edevstack@QuobyteHD" returned: 1 in 0.316s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:05:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79cfa681-b767-41fa-b678-04709d2a1c10_o91pu5_edevstack@QuobyteHD' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:05:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:05:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:05:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e319d94f-3502-4cb0-a97c-8a7fc49f72bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a63910e5ae4b43daa4cb612980317db4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:05:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:05:34Z,use_quota=True,user_id='8d9d495f4b294d8d8d666407d6c99591',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:05:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] Creating volume e319d94f-3502-4cb0-a97c-8a7fc49f72bd {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:05:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:05:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:05:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:05:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:05:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:05:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:05:35 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:05:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e319d94f-3502-4cb0-a97c-8a7fc49f72bd 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:05:35 devstack sudo[106906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e319d94f-3502-4cb0-a97c-8a7fc49f72bd 1073741824 Sep 28 12:05:35 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:05:35 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root Sep 28 12:05:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e319d94f-3502-4cb0-a97c-8a7fc49f72bd 1073741824" returned: 0 in 0.409s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:05:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e319d94f-3502-4cb0-a97c-8a7fc49f72bd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:05:35 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e319d94f-3502-4cb0-a97c-8a7fc49f72bd Sep 28 12:05:35 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:05:36 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Sep 28 12:05:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e319d94f-3502-4cb0-a97c-8a7fc49f72bd" returned: 0 in 0.248s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:05:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:05:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:05:36 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] Attempting download of 79cfa681-b767-41fa-b678-04709d2a1c10 ((None, [{'url': 'file:///opt/stack/data/glance/images/79cfa681-b767-41fa-b678-04709d2a1c10', 'metadata': {}}])) to volume e319d94f-3502-4cb0-a97c-8a7fc49f72bd. {{(pid=86916) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 12:05:36 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa1a5ba-9b21-4e6b-9238-a3ee2c94b2f3]: (4, 'raw') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:05:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_79cfa681-b767-41fa-b678-04709d2a1c10_a9ef8lcw {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:05:36 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_79cfa681-b767-41fa-b678-04709d2a1c10_a9ef8lcw Sep 28 12:05:36 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:05:36 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Sep 28 12:05:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_79cfa681-b767-41fa-b678-04709d2a1c10_a9ef8lcw" returned: 0 in 0.325s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:05:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79cfa681-b767-41fa-b678-04709d2a1c10_a9ef8lcw {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:05:36 devstack sudo[106918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79cfa681-b767-41fa-b678-04709d2a1c10_a9ef8lcw Sep 28 12:05:36 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:05:36 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root Sep 28 12:05:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79cfa681-b767-41fa-b678-04709d2a1c10_a9ef8lcw" returned: 1 in 0.318s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:05:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79cfa681-b767-41fa-b678-04709d2a1c10_a9ef8lcw' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:05:36 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d033cc-e11b-4830-8c00-82a5797c6a37]: (4, 'raw') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:05:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_79cfa681-b767-41fa-b678-04709d2a1c10_o91pu5_edevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:05:36 devstack sudo[106922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_79cfa681-b767-41fa-b678-04709d2a1c10_o91pu5_edevstack@QuobyteHD Sep 28 12:05:36 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:05:37 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root Sep 28 12:05:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_79cfa681-b767-41fa-b678-04709d2a1c10_o91pu5_edevstack@QuobyteHD" returned: 0 in 0.328s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:05:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79cfa681-b767-41fa-b678-04709d2a1c10_o91pu5_edevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:05:37 devstack sudo[106926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79cfa681-b767-41fa-b678-04709d2a1c10_o91pu5_edevstack@QuobyteHD Sep 28 12:05:37 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:05:37 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root Sep 28 12:05:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79cfa681-b767-41fa-b678-04709d2a1c10_o91pu5_edevstack@QuobyteHD" returned: 1 in 0.318s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:05:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79cfa681-b767-41fa-b678-04709d2a1c10_o91pu5_edevstack@QuobyteHD' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:05:37 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] 79cfa681-b767-41fa-b678-04709d2a1c10 was raw, converting to qcow2 {{(pid=86916) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 12:05:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_79cfa681-b767-41fa-b678-04709d2a1c10_o91pu5_edevstack@QuobyteHD /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e319d94f-3502-4cb0-a97c-8a7fc49f72bd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:05:37 devstack sudo[106931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_79cfa681-b767-41fa-b678-04709d2a1c10_o91pu5_edevstack@QuobyteHD /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e319d94f-3502-4cb0-a97c-8a7fc49f72bd Sep 28 12:05:37 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:05:37 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root Sep 28 12:05:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_79cfa681-b767-41fa-b678-04709d2a1c10_o91pu5_edevstack@QuobyteHD /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e319d94f-3502-4cb0-a97c-8a7fc49f72bd" returned: 0 in 0.453s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:05:37 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_79cfa681-b767-41fa-b678-04709d2a1c10_o91pu5_edevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e319d94f-3502-4cb0-a97c-8a7fc49f72bd {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:05:37 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 12:05:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e319d94f-3502-4cb0-a97c-8a7fc49f72bd 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:05:37 devstack sudo[106936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e319d94f-3502-4cb0-a97c-8a7fc49f72bd 1G Sep 28 12:05:37 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:05:38 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root Sep 28 12:05:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e319d94f-3502-4cb0-a97c-8a7fc49f72bd 1G" returned: 0 in 0.300s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:05:38 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] Downloaded image 79cfa681-b767-41fa-b678-04709d2a1c10 ((None, [{'url': 'file:///opt/stack/data/glance/images/79cfa681-b767-41fa-b678-04709d2a1c10', 'metadata': {}}])) to volume e319d94f-3502-4cb0-a97c-8a7fc49f72bd successfully. {{(pid=86916) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 12:05:38 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] Temporary image 79cfa681-b767-41fa-b678-04709d2a1c10 for user 8d9d495f4b294d8d8d666407d6c99591 is deleted. {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 12:05:38 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] Marking volume e319d94f-3502-4cb0-a97c-8a7fc49f72bd as bootable. {{(pid=86916) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 12:05:38 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] Copying metadata from image 79cfa681-b767-41fa-b678-04709d2a1c10 to e319d94f-3502-4cb0-a97c-8a7fc49f72bd. {{(pid=86916) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 12:05:38 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] Creating volume glance metadata for volume e319d94f-3502-4cb0-a97c-8a7fc49f72bd backed by image 79cfa681-b767-41fa-b678-04709d2a1c10 with: {'image_id': '79cfa681-b767-41fa-b678-04709d2a1c10', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '788783a36f366b2865c11f2d49f32602', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86916) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 12:05:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8dca6ff-1321-4240-97f3-734da125a8f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e319d94f-3502-4cb0-a97c-8a7fc49f72bd', 'volume_size': 1, 'image_id': '79cfa681-b767-41fa-b678-04709d2a1c10', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/79cfa681-b767-41fa-b678-04709d2a1c10', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '788783a36f366b2865c11f2d49f32602', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a63910e5ae4b43daa4cb612980317db4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bc7194fb58af7e4d5318e2665daf18fe3dc5c6dcae4e4358c510df079430607e3f8393c1564c68a0935b6d64e6b585626dc9c63343a0b6c7bf728b5e27ba1f7b', 'id': '79cfa681-b767-41fa-b678-04709d2a1c10', 'created_at': datetime.datetime(2026, 9, 28, 10, 5, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 5, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/79cfa681-b767-41fa-b678-04709d2a1c10/file', 'properties': {}}, 'image_service': }' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:05:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40915013-ed0d-40ca-b7c7-4b00057e39e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:05:38 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] Volume volume-e319d94f-3502-4cb0-a97c-8a7fc49f72bd (e319d94f-3502-4cb0-a97c-8a7fc49f72bd): created successfully Sep 28 12:05:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40915013-ed0d-40ca-b7c7-4b00057e39e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:05:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] Flow 'volume_create_manager' (deb5cf23-1ef8-42f4-a613-33ed04c94419) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:05:38 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-8a39da7e-20d8-4918-bd38-5b2aa1ada13b tempest-VolumeImageDependencyTests-1927557517 None] Created volume successfully. Sep 28 12:05:38 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:05:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:05:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:05:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:05:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:05:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:05:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:05:38 devstack sudo[106941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:05:38 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:05:38 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root Sep 28 12:05:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.244s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:05:38 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:05:38 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:05:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] thread count: 28 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:05:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] thread info: [<_MainThread(MainThread, started 135408582168704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:05:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-09b5f6d1-1dbb-4ec3-810a-659351a3fbe0 tempest-VolumeImageDependencyTests-1927557517 None] Acquiring lock "cinder-e319d94f-3502-4cb0-a97c-8a7fc49f72bd-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:05:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-09b5f6d1-1dbb-4ec3-810a-659351a3fbe0 tempest-VolumeImageDependencyTests-1927557517 None] Lock "cinder-e319d94f-3502-4cb0-a97c-8a7fc49f72bd-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:05:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-09b5f6d1-1dbb-4ec3-810a-659351a3fbe0 tempest-VolumeImageDependencyTests-1927557517 None] Acquiring lock "cinder-quobyte-e319d94f-3502-4cb0-a97c-8a7fc49f72bd" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:05:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-09b5f6d1-1dbb-4ec3-810a-659351a3fbe0 tempest-VolumeImageDependencyTests-1927557517 None] Lock "cinder-quobyte-e319d94f-3502-4cb0-a97c-8a7fc49f72bd" acquired by "delete_volume" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:05:39 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c2ef11-906a-42aa-ad6e-586b573dac76]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:05:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-09b5f6d1-1dbb-4ec3-810a-659351a3fbe0 tempest-VolumeImageDependencyTests-1927557517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e319d94f-3502-4cb0-a97c-8a7fc49f72bd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:05:39 devstack sudo[106944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e319d94f-3502-4cb0-a97c-8a7fc49f72bd Sep 28 12:05:39 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:05:39 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root Sep 28 12:05:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-09b5f6d1-1dbb-4ec3-810a-659351a3fbe0 tempest-VolumeImageDependencyTests-1927557517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e319d94f-3502-4cb0-a97c-8a7fc49f72bd" returned: 0 in 0.346s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:05:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-09b5f6d1-1dbb-4ec3-810a-659351a3fbe0 tempest-VolumeImageDependencyTests-1927557517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e319d94f-3502-4cb0-a97c-8a7fc49f72bd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:05:39 devstack sudo[106949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e319d94f-3502-4cb0-a97c-8a7fc49f72bd Sep 28 12:05:39 devstack sudo[106949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:05:39 devstack sudo[106949]: pam_unix(sudo:session): session closed for user root Sep 28 12:05:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-09b5f6d1-1dbb-4ec3-810a-659351a3fbe0 tempest-VolumeImageDependencyTests-1927557517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e319d94f-3502-4cb0-a97c-8a7fc49f72bd" returned: 0 in 0.231s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:05:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-09b5f6d1-1dbb-4ec3-810a-659351a3fbe0 tempest-VolumeImageDependencyTests-1927557517 None] Lock "cinder-quobyte-e319d94f-3502-4cb0-a97c-8a7fc49f72bd" released by "delete_volume" :: held 0.617s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:05:39 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-09b5f6d1-1dbb-4ec3-810a-659351a3fbe0 tempest-VolumeImageDependencyTests-1927557517 None] Created reservations ['2d43f04d-bdb5-4101-98ba-85297251f4a4', '19b043d9-77fc-4976-869e-6eadfd71cb9b', '1f1a0e25-528d-4cd4-a271-786ac8b7d96b', 'd2a8a0b9-d5fa-4f58-b53e-65d7eeb60b75'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:05:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-09b5f6d1-1dbb-4ec3-810a-659351a3fbe0 tempest-VolumeImageDependencyTests-1927557517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:05:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-09b5f6d1-1dbb-4ec3-810a-659351a3fbe0 tempest-VolumeImageDependencyTests-1927557517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:05:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-09b5f6d1-1dbb-4ec3-810a-659351a3fbe0 tempest-VolumeImageDependencyTests-1927557517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:05:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-09b5f6d1-1dbb-4ec3-810a-659351a3fbe0 tempest-VolumeImageDependencyTests-1927557517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:05:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-09b5f6d1-1dbb-4ec3-810a-659351a3fbe0 tempest-VolumeImageDependencyTests-1927557517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:05:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-09b5f6d1-1dbb-4ec3-810a-659351a3fbe0 tempest-VolumeImageDependencyTests-1927557517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:05:39 devstack sudo[106952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:05:39 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:05:40 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root Sep 28 12:05:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-09b5f6d1-1dbb-4ec3-810a-659351a3fbe0 tempest-VolumeImageDependencyTests-1927557517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.233s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:05:40 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-09b5f6d1-1dbb-4ec3-810a-659351a3fbe0 tempest-VolumeImageDependencyTests-1927557517 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:05:40 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-09b5f6d1-1dbb-4ec3-810a-659351a3fbe0 tempest-VolumeImageDependencyTests-1927557517 None] Deleted volume successfully. Sep 28 12:05:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-09b5f6d1-1dbb-4ec3-810a-659351a3fbe0 tempest-VolumeImageDependencyTests-1927557517 None] Lock "cinder-e319d94f-3502-4cb0-a97c-8a7fc49f72bd-delete_volume" released by "delete_volume" :: held 1.034s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:05:48 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe23973d-0500-459c-b619-168ba716abf4 tempest-ProjectReaderTests-795927524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:05:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fe23973d-0500-459c-b619-168ba716abf4 tempest-ProjectReaderTests-795927524 None] Flow 'volume_create_manager' (76b81d13-5c50-4719-b8b8-e99c6d930b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:05:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fe23973d-0500-459c-b619-168ba716abf4 tempest-ProjectReaderTests-795927524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f54939f-87fa-4546-ab04-121f3c8de9f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:05:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fe23973d-0500-459c-b619-168ba716abf4 tempest-ProjectReaderTests-795927524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f54939f-87fa-4546-ab04-121f3c8de9f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:05:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1583993121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d25c7de4-b57b-4e2f-b73c-aeb080bb05fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99c3ba97de3e457499730dbec247dff4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:05:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:05:48Z,use_quota=True,user_id='a48eb9a25e3b4796b61d2a249a329726',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:05:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fe23973d-0500-459c-b619-168ba716abf4 tempest-ProjectReaderTests-795927524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4d957f9-dc1c-4163-a6c8-6fcf75ccb0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:05:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fe23973d-0500-459c-b619-168ba716abf4 tempest-ProjectReaderTests-795927524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4d957f9-dc1c-4163-a6c8-6fcf75ccb0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:05:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fe23973d-0500-459c-b619-168ba716abf4 tempest-ProjectReaderTests-795927524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2c0903c-0fb4-4119-ba25-bea6e6b93693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:05:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fe23973d-0500-459c-b619-168ba716abf4 tempest-ProjectReaderTests-795927524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2c0903c-0fb4-4119-ba25-bea6e6b93693) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd25c7de4-b57b-4e2f-b73c-aeb080bb05fd', 'volume_name': 'volume-d25c7de4-b57b-4e2f-b73c-aeb080bb05fd', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:05:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fe23973d-0500-459c-b619-168ba716abf4 tempest-ProjectReaderTests-795927524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f01b113d-afac-457e-8dfb-d816140f4158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:05:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fe23973d-0500-459c-b619-168ba716abf4 tempest-ProjectReaderTests-795927524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f01b113d-afac-457e-8dfb-d816140f4158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:05:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fe23973d-0500-459c-b619-168ba716abf4 tempest-ProjectReaderTests-795927524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f64868e6-de4c-404a-abe2-a242edeb9530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:05:48 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-fe23973d-0500-459c-b619-168ba716abf4 tempest-ProjectReaderTests-795927524 None] Volume d25c7de4-b57b-4e2f-b73c-aeb080bb05fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d25c7de4-b57b-4e2f-b73c-aeb080bb05fd', 'volume_size': 1} Sep 28 12:05:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fe23973d-0500-459c-b619-168ba716abf4 tempest-ProjectReaderTests-795927524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:05:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fe23973d-0500-459c-b619-168ba716abf4 tempest-ProjectReaderTests-795927524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:05:48 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-fe23973d-0500-459c-b619-168ba716abf4 tempest-ProjectReaderTests-795927524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:05:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1583993121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d25c7de4-b57b-4e2f-b73c-aeb080bb05fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99c3ba97de3e457499730dbec247dff4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:05:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:05:48Z,use_quota=True,user_id='a48eb9a25e3b4796b61d2a249a329726',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:05:48 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-fe23973d-0500-459c-b619-168ba716abf4 tempest-ProjectReaderTests-795927524 None] Creating volume d25c7de4-b57b-4e2f-b73c-aeb080bb05fd {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:05:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fe23973d-0500-459c-b619-168ba716abf4 tempest-ProjectReaderTests-795927524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:05:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fe23973d-0500-459c-b619-168ba716abf4 tempest-ProjectReaderTests-795927524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:05:48 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-fe23973d-0500-459c-b619-168ba716abf4 tempest-ProjectReaderTests-795927524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:05:48 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-fe23973d-0500-459c-b619-168ba716abf4 tempest-ProjectReaderTests-795927524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:05:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fe23973d-0500-459c-b619-168ba716abf4 tempest-ProjectReaderTests-795927524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:05:48 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-fe23973d-0500-459c-b619-168ba716abf4 tempest-ProjectReaderTests-795927524 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:05:48 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-fe23973d-0500-459c-b619-168ba716abf4 tempest-ProjectReaderTests-795927524 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:05:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fe23973d-0500-459c-b619-168ba716abf4 tempest-ProjectReaderTests-795927524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d25c7de4-b57b-4e2f-b73c-aeb080bb05fd 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:05:48 devstack sudo[106956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d25c7de4-b57b-4e2f-b73c-aeb080bb05fd 1073741824 Sep 28 12:05:48 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:05:48 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root Sep 28 12:05:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fe23973d-0500-459c-b619-168ba716abf4 tempest-ProjectReaderTests-795927524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d25c7de4-b57b-4e2f-b73c-aeb080bb05fd 1073741824" returned: 0 in 0.393s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:05:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fe23973d-0500-459c-b619-168ba716abf4 tempest-ProjectReaderTests-795927524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d25c7de4-b57b-4e2f-b73c-aeb080bb05fd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:05:48 devstack sudo[106962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d25c7de4-b57b-4e2f-b73c-aeb080bb05fd Sep 28 12:05:48 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:05:48 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root Sep 28 12:05:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fe23973d-0500-459c-b619-168ba716abf4 tempest-ProjectReaderTests-795927524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d25c7de4-b57b-4e2f-b73c-aeb080bb05fd" returned: 0 in 0.233s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:05:48 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-fe23973d-0500-459c-b619-168ba716abf4 tempest-ProjectReaderTests-795927524 None] <== create_volume: return (669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:05:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fe23973d-0500-459c-b619-168ba716abf4 tempest-ProjectReaderTests-795927524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.671s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:05:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fe23973d-0500-459c-b619-168ba716abf4 tempest-ProjectReaderTests-795927524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f64868e6-de4c-404a-abe2-a242edeb9530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d25c7de4-b57b-4e2f-b73c-aeb080bb05fd', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:05:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fe23973d-0500-459c-b619-168ba716abf4 tempest-ProjectReaderTests-795927524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6ea2d69-79f8-4693-b018-177d35176616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:05:48 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-fe23973d-0500-459c-b619-168ba716abf4 tempest-ProjectReaderTests-795927524 None] Volume volume-d25c7de4-b57b-4e2f-b73c-aeb080bb05fd (d25c7de4-b57b-4e2f-b73c-aeb080bb05fd): created successfully Sep 28 12:05:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fe23973d-0500-459c-b619-168ba716abf4 tempest-ProjectReaderTests-795927524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6ea2d69-79f8-4693-b018-177d35176616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:05:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fe23973d-0500-459c-b619-168ba716abf4 tempest-ProjectReaderTests-795927524 None] Flow 'volume_create_manager' (76b81d13-5c50-4719-b8b8-e99c6d930b0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:05:48 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-fe23973d-0500-459c-b619-168ba716abf4 tempest-ProjectReaderTests-795927524 None] Created volume successfully. Sep 28 12:05:49 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-85c82984-2376-4d1a-b82e-07d887c93584 tempest-ProjectReaderTests-795927524 None] Acquiring lock "cinder-d25c7de4-b57b-4e2f-b73c-aeb080bb05fd-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:05:49 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-85c82984-2376-4d1a-b82e-07d887c93584 tempest-ProjectReaderTests-795927524 None] Lock "cinder-d25c7de4-b57b-4e2f-b73c-aeb080bb05fd-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:05:49 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-85c82984-2376-4d1a-b82e-07d887c93584 tempest-ProjectReaderTests-795927524 None] Acquiring lock "cinder-quobyte-d25c7de4-b57b-4e2f-b73c-aeb080bb05fd" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:05:49 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-85c82984-2376-4d1a-b82e-07d887c93584 tempest-ProjectReaderTests-795927524 None] Lock "cinder-quobyte-d25c7de4-b57b-4e2f-b73c-aeb080bb05fd" acquired by "delete_volume" :: waited 0.013s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:05:49 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfea8b87-6deb-42fe-94f5-2d0d47a39c13]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:05:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-85c82984-2376-4d1a-b82e-07d887c93584 tempest-ProjectReaderTests-795927524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d25c7de4-b57b-4e2f-b73c-aeb080bb05fd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:05:49 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d25c7de4-b57b-4e2f-b73c-aeb080bb05fd Sep 28 12:05:49 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:05:49 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Sep 28 12:05:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-85c82984-2376-4d1a-b82e-07d887c93584 tempest-ProjectReaderTests-795927524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d25c7de4-b57b-4e2f-b73c-aeb080bb05fd" returned: 0 in 0.341s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:05:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-85c82984-2376-4d1a-b82e-07d887c93584 tempest-ProjectReaderTests-795927524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d25c7de4-b57b-4e2f-b73c-aeb080bb05fd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:05:49 devstack sudo[106970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d25c7de4-b57b-4e2f-b73c-aeb080bb05fd Sep 28 12:05:49 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:05:49 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root Sep 28 12:05:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-85c82984-2376-4d1a-b82e-07d887c93584 tempest-ProjectReaderTests-795927524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d25c7de4-b57b-4e2f-b73c-aeb080bb05fd" returned: 0 in 0.236s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:05:49 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-85c82984-2376-4d1a-b82e-07d887c93584 tempest-ProjectReaderTests-795927524 None] Lock "cinder-quobyte-d25c7de4-b57b-4e2f-b73c-aeb080bb05fd" released by "delete_volume" :: held 0.616s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:05:49 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-85c82984-2376-4d1a-b82e-07d887c93584 tempest-ProjectReaderTests-795927524 None] Created reservations ['5066bed6-9726-4b1e-b5bd-458a471eaea9', '4cf7c5b1-80c3-4b40-8219-7fa9c63a720f', '33e564dc-1c1b-43d3-922d-4ff39c5d6964', '97669040-d76a-4620-8b47-3c8666bbe4f1'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:05:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-85c82984-2376-4d1a-b82e-07d887c93584 tempest-ProjectReaderTests-795927524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:05:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-85c82984-2376-4d1a-b82e-07d887c93584 tempest-ProjectReaderTests-795927524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:05:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-85c82984-2376-4d1a-b82e-07d887c93584 tempest-ProjectReaderTests-795927524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:05:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-85c82984-2376-4d1a-b82e-07d887c93584 tempest-ProjectReaderTests-795927524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:05:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-85c82984-2376-4d1a-b82e-07d887c93584 tempest-ProjectReaderTests-795927524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:05:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-85c82984-2376-4d1a-b82e-07d887c93584 tempest-ProjectReaderTests-795927524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:05:50 devstack sudo[106973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:05:50 devstack sudo[106973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:05:50 devstack sudo[106973]: pam_unix(sudo:session): session closed for user root Sep 28 12:05:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-85c82984-2376-4d1a-b82e-07d887c93584 tempest-ProjectReaderTests-795927524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.255s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:05:50 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-85c82984-2376-4d1a-b82e-07d887c93584 tempest-ProjectReaderTests-795927524 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:05:50 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-85c82984-2376-4d1a-b82e-07d887c93584 tempest-ProjectReaderTests-795927524 None] Deleted volume successfully. Sep 28 12:05:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-85c82984-2376-4d1a-b82e-07d887c93584 tempest-ProjectReaderTests-795927524 None] Lock "cinder-d25c7de4-b57b-4e2f-b73c-aeb080bb05fd-delete_volume" released by "delete_volume" :: held 1.061s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:05:50 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ab41d51-83bd-46ce-9f9d-cd5573c63cfe tempest-ProjectReaderTests-795927524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:05:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4ab41d51-83bd-46ce-9f9d-cd5573c63cfe tempest-ProjectReaderTests-795927524 None] Flow 'volume_create_manager' (0c282a4a-c55d-4b40-ba68-c76f9aae145e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:05:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4ab41d51-83bd-46ce-9f9d-cd5573c63cfe tempest-ProjectReaderTests-795927524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15b4abd9-591b-44c0-a2c1-145bced5701a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:05:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4ab41d51-83bd-46ce-9f9d-cd5573c63cfe tempest-ProjectReaderTests-795927524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15b4abd9-591b-44c0-a2c1-145bced5701a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:05:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-26873475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=757e78ec-2691-492e-bb11-f3c8539b67b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99c3ba97de3e457499730dbec247dff4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:05:51Z,use_quota=True,user_id='a48eb9a25e3b4796b61d2a249a329726',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:05:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4ab41d51-83bd-46ce-9f9d-cd5573c63cfe tempest-ProjectReaderTests-795927524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58dadeb6-560f-4116-a97f-7937f24e2fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:05:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4ab41d51-83bd-46ce-9f9d-cd5573c63cfe tempest-ProjectReaderTests-795927524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58dadeb6-560f-4116-a97f-7937f24e2fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:05:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4ab41d51-83bd-46ce-9f9d-cd5573c63cfe tempest-ProjectReaderTests-795927524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03708eab-7a2d-46af-9a30-8133604f16d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:05:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4ab41d51-83bd-46ce-9f9d-cd5573c63cfe tempest-ProjectReaderTests-795927524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03708eab-7a2d-46af-9a30-8133604f16d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '757e78ec-2691-492e-bb11-f3c8539b67b8', 'volume_name': 'volume-757e78ec-2691-492e-bb11-f3c8539b67b8', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:05:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4ab41d51-83bd-46ce-9f9d-cd5573c63cfe tempest-ProjectReaderTests-795927524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd010930-33b0-4e72-a15a-2c94a3c1c9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:05:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4ab41d51-83bd-46ce-9f9d-cd5573c63cfe tempest-ProjectReaderTests-795927524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd010930-33b0-4e72-a15a-2c94a3c1c9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:05:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4ab41d51-83bd-46ce-9f9d-cd5573c63cfe tempest-ProjectReaderTests-795927524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e49758e5-0cc5-4ee3-ba54-8714e735db8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:05:50 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-4ab41d51-83bd-46ce-9f9d-cd5573c63cfe tempest-ProjectReaderTests-795927524 None] Volume 757e78ec-2691-492e-bb11-f3c8539b67b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-757e78ec-2691-492e-bb11-f3c8539b67b8', 'volume_size': 1} Sep 28 12:05:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4ab41d51-83bd-46ce-9f9d-cd5573c63cfe tempest-ProjectReaderTests-795927524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:05:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4ab41d51-83bd-46ce-9f9d-cd5573c63cfe tempest-ProjectReaderTests-795927524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:05:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4ab41d51-83bd-46ce-9f9d-cd5573c63cfe tempest-ProjectReaderTests-795927524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:05:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-26873475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=757e78ec-2691-492e-bb11-f3c8539b67b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99c3ba97de3e457499730dbec247dff4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:05:51Z,use_quota=True,user_id='a48eb9a25e3b4796b61d2a249a329726',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:05:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-4ab41d51-83bd-46ce-9f9d-cd5573c63cfe tempest-ProjectReaderTests-795927524 None] Creating volume 757e78ec-2691-492e-bb11-f3c8539b67b8 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:05:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4ab41d51-83bd-46ce-9f9d-cd5573c63cfe tempest-ProjectReaderTests-795927524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:05:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4ab41d51-83bd-46ce-9f9d-cd5573c63cfe tempest-ProjectReaderTests-795927524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:05:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4ab41d51-83bd-46ce-9f9d-cd5573c63cfe tempest-ProjectReaderTests-795927524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:05:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4ab41d51-83bd-46ce-9f9d-cd5573c63cfe tempest-ProjectReaderTests-795927524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:05:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4ab41d51-83bd-46ce-9f9d-cd5573c63cfe tempest-ProjectReaderTests-795927524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:05:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4ab41d51-83bd-46ce-9f9d-cd5573c63cfe tempest-ProjectReaderTests-795927524 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:05:50 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-4ab41d51-83bd-46ce-9f9d-cd5573c63cfe tempest-ProjectReaderTests-795927524 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:05:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4ab41d51-83bd-46ce-9f9d-cd5573c63cfe tempest-ProjectReaderTests-795927524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-757e78ec-2691-492e-bb11-f3c8539b67b8 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:05:50 devstack sudo[106977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-757e78ec-2691-492e-bb11-f3c8539b67b8 1073741824 Sep 28 12:05:50 devstack sudo[106977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:05:51 devstack sudo[106977]: pam_unix(sudo:session): session closed for user root Sep 28 12:05:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4ab41d51-83bd-46ce-9f9d-cd5573c63cfe tempest-ProjectReaderTests-795927524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-757e78ec-2691-492e-bb11-f3c8539b67b8 1073741824" returned: 0 in 0.419s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:05:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4ab41d51-83bd-46ce-9f9d-cd5573c63cfe tempest-ProjectReaderTests-795927524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-757e78ec-2691-492e-bb11-f3c8539b67b8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:05:51 devstack sudo[106983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-757e78ec-2691-492e-bb11-f3c8539b67b8 Sep 28 12:05:51 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:05:51 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root Sep 28 12:05:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4ab41d51-83bd-46ce-9f9d-cd5573c63cfe tempest-ProjectReaderTests-795927524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-757e78ec-2691-492e-bb11-f3c8539b67b8" returned: 0 in 0.248s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:05:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4ab41d51-83bd-46ce-9f9d-cd5573c63cfe tempest-ProjectReaderTests-795927524 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:05:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4ab41d51-83bd-46ce-9f9d-cd5573c63cfe tempest-ProjectReaderTests-795927524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:05:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4ab41d51-83bd-46ce-9f9d-cd5573c63cfe tempest-ProjectReaderTests-795927524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e49758e5-0cc5-4ee3-ba54-8714e735db8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-757e78ec-2691-492e-bb11-f3c8539b67b8', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:05:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4ab41d51-83bd-46ce-9f9d-cd5573c63cfe tempest-ProjectReaderTests-795927524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7418223-b5c7-4754-b074-0fea3f375e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:05:51 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-4ab41d51-83bd-46ce-9f9d-cd5573c63cfe tempest-ProjectReaderTests-795927524 None] Volume volume-757e78ec-2691-492e-bb11-f3c8539b67b8 (757e78ec-2691-492e-bb11-f3c8539b67b8): created successfully Sep 28 12:05:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4ab41d51-83bd-46ce-9f9d-cd5573c63cfe tempest-ProjectReaderTests-795927524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7418223-b5c7-4754-b074-0fea3f375e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:05:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4ab41d51-83bd-46ce-9f9d-cd5573c63cfe tempest-ProjectReaderTests-795927524 None] Flow 'volume_create_manager' (0c282a4a-c55d-4b40-ba68-c76f9aae145e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:05:51 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-4ab41d51-83bd-46ce-9f9d-cd5573c63cfe tempest-ProjectReaderTests-795927524 None] Created volume successfully. Sep 28 12:05:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9a95ac05-a1b1-4ac5-b157-3c5ed546b02e tempest-ProjectReaderTests-795927524 None] Acquiring lock "cinder-757e78ec-2691-492e-bb11-f3c8539b67b8-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:05:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9a95ac05-a1b1-4ac5-b157-3c5ed546b02e tempest-ProjectReaderTests-795927524 None] Lock "cinder-757e78ec-2691-492e-bb11-f3c8539b67b8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:05:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9a95ac05-a1b1-4ac5-b157-3c5ed546b02e tempest-ProjectReaderTests-795927524 None] Acquiring lock "cinder-quobyte-757e78ec-2691-492e-bb11-f3c8539b67b8" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:05:52 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9a95ac05-a1b1-4ac5-b157-3c5ed546b02e tempest-ProjectReaderTests-795927524 None] Lock "cinder-quobyte-757e78ec-2691-492e-bb11-f3c8539b67b8" acquired by "delete_volume" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:05:52 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[35580fdc-4b4f-4e88-8211-f5ab3eec7343]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:05:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9a95ac05-a1b1-4ac5-b157-3c5ed546b02e tempest-ProjectReaderTests-795927524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-757e78ec-2691-492e-bb11-f3c8539b67b8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:05:52 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-757e78ec-2691-492e-bb11-f3c8539b67b8 Sep 28 12:05:52 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:05:52 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Sep 28 12:05:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9a95ac05-a1b1-4ac5-b157-3c5ed546b02e tempest-ProjectReaderTests-795927524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-757e78ec-2691-492e-bb11-f3c8539b67b8" returned: 0 in 0.356s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:05:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9a95ac05-a1b1-4ac5-b157-3c5ed546b02e tempest-ProjectReaderTests-795927524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-757e78ec-2691-492e-bb11-f3c8539b67b8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:05:52 devstack sudo[106991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-757e78ec-2691-492e-bb11-f3c8539b67b8 Sep 28 12:05:52 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:05:52 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root Sep 28 12:05:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9a95ac05-a1b1-4ac5-b157-3c5ed546b02e tempest-ProjectReaderTests-795927524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-757e78ec-2691-492e-bb11-f3c8539b67b8" returned: 0 in 0.230s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:05:52 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9a95ac05-a1b1-4ac5-b157-3c5ed546b02e tempest-ProjectReaderTests-795927524 None] Lock "cinder-quobyte-757e78ec-2691-492e-bb11-f3c8539b67b8" released by "delete_volume" :: held 0.626s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:05:52 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-9a95ac05-a1b1-4ac5-b157-3c5ed546b02e tempest-ProjectReaderTests-795927524 None] Created reservations ['73c5455a-9135-42e3-a967-4090e2860bdf', 'aa4c0684-d537-4e2b-bae0-73952c5df61d', '0443a1f1-4139-4161-8e5b-1ec097848434', 'cb97d0e9-a633-4b61-9ad4-890e0a8e5b0c'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:05:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9a95ac05-a1b1-4ac5-b157-3c5ed546b02e tempest-ProjectReaderTests-795927524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:05:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9a95ac05-a1b1-4ac5-b157-3c5ed546b02e tempest-ProjectReaderTests-795927524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:05:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9a95ac05-a1b1-4ac5-b157-3c5ed546b02e tempest-ProjectReaderTests-795927524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:05:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9a95ac05-a1b1-4ac5-b157-3c5ed546b02e tempest-ProjectReaderTests-795927524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:05:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9a95ac05-a1b1-4ac5-b157-3c5ed546b02e tempest-ProjectReaderTests-795927524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:05:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9a95ac05-a1b1-4ac5-b157-3c5ed546b02e tempest-ProjectReaderTests-795927524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:05:52 devstack sudo[106994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:05:52 devstack sudo[106994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:05:52 devstack sudo[106994]: pam_unix(sudo:session): session closed for user root Sep 28 12:05:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9a95ac05-a1b1-4ac5-b157-3c5ed546b02e tempest-ProjectReaderTests-795927524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.236s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:05:52 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-9a95ac05-a1b1-4ac5-b157-3c5ed546b02e tempest-ProjectReaderTests-795927524 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:05:52 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-9a95ac05-a1b1-4ac5-b157-3c5ed546b02e tempest-ProjectReaderTests-795927524 None] Deleted volume successfully. Sep 28 12:05:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9a95ac05-a1b1-4ac5-b157-3c5ed546b02e tempest-ProjectReaderTests-795927524 None] Lock "cinder-757e78ec-2691-492e-bb11-f3c8539b67b8-delete_volume" released by "delete_volume" :: held 1.059s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:05:53 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-3583e010-cbf5-40f4-8a17-8487210fbaa0 tempest-ProjectReaderTests-795927524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:05:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3583e010-cbf5-40f4-8a17-8487210fbaa0 tempest-ProjectReaderTests-795927524 None] Flow 'volume_create_manager' (f199c37c-ed28-4785-8e27-ab8fa3838815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:05:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3583e010-cbf5-40f4-8a17-8487210fbaa0 tempest-ProjectReaderTests-795927524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56bff4f5-ede5-4e8c-a489-2dd27250d9f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:05:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3583e010-cbf5-40f4-8a17-8487210fbaa0 tempest-ProjectReaderTests-795927524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56bff4f5-ede5-4e8c-a489-2dd27250d9f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:05:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1295038901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad4802aa-c1ec-4e8f-a38e-24bffc7935b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99c3ba97de3e457499730dbec247dff4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:05:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:05:53Z,use_quota=True,user_id='a48eb9a25e3b4796b61d2a249a329726',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:05:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3583e010-cbf5-40f4-8a17-8487210fbaa0 tempest-ProjectReaderTests-795927524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c8f78cd-742c-41c2-b771-eedae724a3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:05:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3583e010-cbf5-40f4-8a17-8487210fbaa0 tempest-ProjectReaderTests-795927524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c8f78cd-742c-41c2-b771-eedae724a3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:05:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3583e010-cbf5-40f4-8a17-8487210fbaa0 tempest-ProjectReaderTests-795927524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d21c4c1-5458-4071-89ac-165c35dff759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:05:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3583e010-cbf5-40f4-8a17-8487210fbaa0 tempest-ProjectReaderTests-795927524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d21c4c1-5458-4071-89ac-165c35dff759) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad4802aa-c1ec-4e8f-a38e-24bffc7935b8', 'volume_name': 'volume-ad4802aa-c1ec-4e8f-a38e-24bffc7935b8', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:05:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3583e010-cbf5-40f4-8a17-8487210fbaa0 tempest-ProjectReaderTests-795927524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3867c37-48d0-4433-a3a8-458d2b4f3593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:05:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3583e010-cbf5-40f4-8a17-8487210fbaa0 tempest-ProjectReaderTests-795927524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3867c37-48d0-4433-a3a8-458d2b4f3593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:05:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3583e010-cbf5-40f4-8a17-8487210fbaa0 tempest-ProjectReaderTests-795927524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (113bce5b-4e29-494c-8d90-ed842e952014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:05:53 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-3583e010-cbf5-40f4-8a17-8487210fbaa0 tempest-ProjectReaderTests-795927524 None] Volume ad4802aa-c1ec-4e8f-a38e-24bffc7935b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad4802aa-c1ec-4e8f-a38e-24bffc7935b8', 'volume_size': 1} Sep 28 12:05:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3583e010-cbf5-40f4-8a17-8487210fbaa0 tempest-ProjectReaderTests-795927524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:05:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3583e010-cbf5-40f4-8a17-8487210fbaa0 tempest-ProjectReaderTests-795927524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:05:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3583e010-cbf5-40f4-8a17-8487210fbaa0 tempest-ProjectReaderTests-795927524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:05:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1295038901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad4802aa-c1ec-4e8f-a38e-24bffc7935b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99c3ba97de3e457499730dbec247dff4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:05:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:05:53Z,use_quota=True,user_id='a48eb9a25e3b4796b61d2a249a329726',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:05:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-3583e010-cbf5-40f4-8a17-8487210fbaa0 tempest-ProjectReaderTests-795927524 None] Creating volume ad4802aa-c1ec-4e8f-a38e-24bffc7935b8 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:05:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3583e010-cbf5-40f4-8a17-8487210fbaa0 tempest-ProjectReaderTests-795927524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:05:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3583e010-cbf5-40f4-8a17-8487210fbaa0 tempest-ProjectReaderTests-795927524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:05:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3583e010-cbf5-40f4-8a17-8487210fbaa0 tempest-ProjectReaderTests-795927524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:05:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3583e010-cbf5-40f4-8a17-8487210fbaa0 tempest-ProjectReaderTests-795927524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:05:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3583e010-cbf5-40f4-8a17-8487210fbaa0 tempest-ProjectReaderTests-795927524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:05:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3583e010-cbf5-40f4-8a17-8487210fbaa0 tempest-ProjectReaderTests-795927524 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:05:53 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-3583e010-cbf5-40f4-8a17-8487210fbaa0 tempest-ProjectReaderTests-795927524 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:05:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3583e010-cbf5-40f4-8a17-8487210fbaa0 tempest-ProjectReaderTests-795927524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ad4802aa-c1ec-4e8f-a38e-24bffc7935b8 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:05:53 devstack sudo[106998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ad4802aa-c1ec-4e8f-a38e-24bffc7935b8 1073741824 Sep 28 12:05:53 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:05:54 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root Sep 28 12:05:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3583e010-cbf5-40f4-8a17-8487210fbaa0 tempest-ProjectReaderTests-795927524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ad4802aa-c1ec-4e8f-a38e-24bffc7935b8 1073741824" returned: 0 in 0.402s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:05:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3583e010-cbf5-40f4-8a17-8487210fbaa0 tempest-ProjectReaderTests-795927524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ad4802aa-c1ec-4e8f-a38e-24bffc7935b8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:05:54 devstack sudo[107003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ad4802aa-c1ec-4e8f-a38e-24bffc7935b8 Sep 28 12:05:54 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:05:54 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root Sep 28 12:05:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3583e010-cbf5-40f4-8a17-8487210fbaa0 tempest-ProjectReaderTests-795927524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ad4802aa-c1ec-4e8f-a38e-24bffc7935b8" returned: 0 in 0.243s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:05:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3583e010-cbf5-40f4-8a17-8487210fbaa0 tempest-ProjectReaderTests-795927524 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:05:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3583e010-cbf5-40f4-8a17-8487210fbaa0 tempest-ProjectReaderTests-795927524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:05:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3583e010-cbf5-40f4-8a17-8487210fbaa0 tempest-ProjectReaderTests-795927524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (113bce5b-4e29-494c-8d90-ed842e952014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad4802aa-c1ec-4e8f-a38e-24bffc7935b8', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:05:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3583e010-cbf5-40f4-8a17-8487210fbaa0 tempest-ProjectReaderTests-795927524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba94ba4c-edfd-493b-b70e-db1032c97b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:05:54 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-3583e010-cbf5-40f4-8a17-8487210fbaa0 tempest-ProjectReaderTests-795927524 None] Volume volume-ad4802aa-c1ec-4e8f-a38e-24bffc7935b8 (ad4802aa-c1ec-4e8f-a38e-24bffc7935b8): created successfully Sep 28 12:05:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3583e010-cbf5-40f4-8a17-8487210fbaa0 tempest-ProjectReaderTests-795927524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba94ba4c-edfd-493b-b70e-db1032c97b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:05:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3583e010-cbf5-40f4-8a17-8487210fbaa0 tempest-ProjectReaderTests-795927524 None] Flow 'volume_create_manager' (f199c37c-ed28-4785-8e27-ab8fa3838815) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:05:54 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-3583e010-cbf5-40f4-8a17-8487210fbaa0 tempest-ProjectReaderTests-795927524 None] Created volume successfully. Sep 28 12:05:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-567d2b5e-f57e-430c-959a-9f348eaff3da tempest-ProjectReaderTests-795927524 None] Acquiring lock "cinder-ad4802aa-c1ec-4e8f-a38e-24bffc7935b8-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:05:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-567d2b5e-f57e-430c-959a-9f348eaff3da tempest-ProjectReaderTests-795927524 None] Lock "cinder-ad4802aa-c1ec-4e8f-a38e-24bffc7935b8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:05:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-567d2b5e-f57e-430c-959a-9f348eaff3da tempest-ProjectReaderTests-795927524 None] Acquiring lock "cinder-quobyte-ad4802aa-c1ec-4e8f-a38e-24bffc7935b8" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:05:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-567d2b5e-f57e-430c-959a-9f348eaff3da tempest-ProjectReaderTests-795927524 None] Lock "cinder-quobyte-ad4802aa-c1ec-4e8f-a38e-24bffc7935b8" acquired by "delete_volume" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:05:55 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[60cf83a7-27f7-49a5-9aa3-499b6dd14786]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:05:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-567d2b5e-f57e-430c-959a-9f348eaff3da tempest-ProjectReaderTests-795927524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ad4802aa-c1ec-4e8f-a38e-24bffc7935b8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:05:55 devstack sudo[107006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ad4802aa-c1ec-4e8f-a38e-24bffc7935b8 Sep 28 12:05:55 devstack sudo[107006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:05:56 devstack sudo[107006]: pam_unix(sudo:session): session closed for user root Sep 28 12:05:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-567d2b5e-f57e-430c-959a-9f348eaff3da tempest-ProjectReaderTests-795927524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ad4802aa-c1ec-4e8f-a38e-24bffc7935b8" returned: 0 in 0.356s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:05:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-567d2b5e-f57e-430c-959a-9f348eaff3da tempest-ProjectReaderTests-795927524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ad4802aa-c1ec-4e8f-a38e-24bffc7935b8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:05:56 devstack sudo[107013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ad4802aa-c1ec-4e8f-a38e-24bffc7935b8 Sep 28 12:05:56 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:05:56 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root Sep 28 12:05:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-567d2b5e-f57e-430c-959a-9f348eaff3da tempest-ProjectReaderTests-795927524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-ad4802aa-c1ec-4e8f-a38e-24bffc7935b8" returned: 0 in 0.250s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:05:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-567d2b5e-f57e-430c-959a-9f348eaff3da tempest-ProjectReaderTests-795927524 None] Lock "cinder-quobyte-ad4802aa-c1ec-4e8f-a38e-24bffc7935b8" released by "delete_volume" :: held 0.645s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:05:56 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-567d2b5e-f57e-430c-959a-9f348eaff3da tempest-ProjectReaderTests-795927524 None] Created reservations ['8846ab58-d9d9-4065-9de6-2e0a0aacf9a2', '1c86d828-c372-4c86-929b-eb3c40f342ce', '7f41f73d-c249-4154-8f03-c24621f12d49', '0c5e4643-1a19-4255-9c32-dafded16d53c'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:05:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-567d2b5e-f57e-430c-959a-9f348eaff3da tempest-ProjectReaderTests-795927524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:05:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-567d2b5e-f57e-430c-959a-9f348eaff3da tempest-ProjectReaderTests-795927524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:05:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-567d2b5e-f57e-430c-959a-9f348eaff3da tempest-ProjectReaderTests-795927524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:05:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-567d2b5e-f57e-430c-959a-9f348eaff3da tempest-ProjectReaderTests-795927524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:05:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-567d2b5e-f57e-430c-959a-9f348eaff3da tempest-ProjectReaderTests-795927524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:05:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-567d2b5e-f57e-430c-959a-9f348eaff3da tempest-ProjectReaderTests-795927524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:05:56 devstack sudo[107016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:05:56 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:05:56 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root Sep 28 12:05:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-567d2b5e-f57e-430c-959a-9f348eaff3da tempest-ProjectReaderTests-795927524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.254s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:05:56 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-567d2b5e-f57e-430c-959a-9f348eaff3da tempest-ProjectReaderTests-795927524 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:05:56 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-567d2b5e-f57e-430c-959a-9f348eaff3da tempest-ProjectReaderTests-795927524 None] Deleted volume successfully. Sep 28 12:05:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-567d2b5e-f57e-430c-959a-9f348eaff3da tempest-ProjectReaderTests-795927524 None] Lock "cinder-ad4802aa-c1ec-4e8f-a38e-24bffc7935b8-delete_volume" released by "delete_volume" :: held 1.095s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:05:57 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-7210b32f-084f-4e6c-a97a-061a2c1f862d tempest-ProjectReaderTests-795927524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:05:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7210b32f-084f-4e6c-a97a-061a2c1f862d tempest-ProjectReaderTests-795927524 None] Flow 'volume_create_manager' (aa0b1b61-9aa5-4fdc-a421-b09bc4ad31b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:05:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7210b32f-084f-4e6c-a97a-061a2c1f862d tempest-ProjectReaderTests-795927524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ee947ac-5f6a-4adc-9011-94f6eea421f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:05:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7210b32f-084f-4e6c-a97a-061a2c1f862d tempest-ProjectReaderTests-795927524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ee947ac-5f6a-4adc-9011-94f6eea421f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2068625668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6c6d2f5-a30f-40ee-805a-369157f37190,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99c3ba97de3e457499730dbec247dff4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:05:57Z,use_quota=True,user_id='a48eb9a25e3b4796b61d2a249a329726',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:05:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7210b32f-084f-4e6c-a97a-061a2c1f862d tempest-ProjectReaderTests-795927524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b9c2000-4e0a-4bd9-8490-9548f2d853f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:05:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7210b32f-084f-4e6c-a97a-061a2c1f862d tempest-ProjectReaderTests-795927524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b9c2000-4e0a-4bd9-8490-9548f2d853f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:05:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7210b32f-084f-4e6c-a97a-061a2c1f862d tempest-ProjectReaderTests-795927524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (186f84f3-1696-4825-a674-0c5ecc396808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:05:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7210b32f-084f-4e6c-a97a-061a2c1f862d tempest-ProjectReaderTests-795927524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (186f84f3-1696-4825-a674-0c5ecc396808) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6c6d2f5-a30f-40ee-805a-369157f37190', 'volume_name': 'volume-a6c6d2f5-a30f-40ee-805a-369157f37190', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:05:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7210b32f-084f-4e6c-a97a-061a2c1f862d tempest-ProjectReaderTests-795927524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f69c35b6-7351-4e1d-a110-91012523be70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:05:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7210b32f-084f-4e6c-a97a-061a2c1f862d tempest-ProjectReaderTests-795927524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f69c35b6-7351-4e1d-a110-91012523be70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:05:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7210b32f-084f-4e6c-a97a-061a2c1f862d tempest-ProjectReaderTests-795927524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dc3457f-3a7e-45f4-a8d7-1c7efedd13e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:05:57 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-7210b32f-084f-4e6c-a97a-061a2c1f862d tempest-ProjectReaderTests-795927524 None] Volume a6c6d2f5-a30f-40ee-805a-369157f37190: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6c6d2f5-a30f-40ee-805a-369157f37190', 'volume_size': 1} Sep 28 12:05:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7210b32f-084f-4e6c-a97a-061a2c1f862d tempest-ProjectReaderTests-795927524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:05:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7210b32f-084f-4e6c-a97a-061a2c1f862d tempest-ProjectReaderTests-795927524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:05:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7210b32f-084f-4e6c-a97a-061a2c1f862d tempest-ProjectReaderTests-795927524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2068625668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6c6d2f5-a30f-40ee-805a-369157f37190,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99c3ba97de3e457499730dbec247dff4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:05:57Z,use_quota=True,user_id='a48eb9a25e3b4796b61d2a249a329726',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:05:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-7210b32f-084f-4e6c-a97a-061a2c1f862d tempest-ProjectReaderTests-795927524 None] Creating volume a6c6d2f5-a30f-40ee-805a-369157f37190 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:05:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7210b32f-084f-4e6c-a97a-061a2c1f862d tempest-ProjectReaderTests-795927524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:05:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7210b32f-084f-4e6c-a97a-061a2c1f862d tempest-ProjectReaderTests-795927524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:05:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7210b32f-084f-4e6c-a97a-061a2c1f862d tempest-ProjectReaderTests-795927524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:05:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7210b32f-084f-4e6c-a97a-061a2c1f862d tempest-ProjectReaderTests-795927524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:05:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7210b32f-084f-4e6c-a97a-061a2c1f862d tempest-ProjectReaderTests-795927524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:05:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7210b32f-084f-4e6c-a97a-061a2c1f862d tempest-ProjectReaderTests-795927524 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:05:57 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-7210b32f-084f-4e6c-a97a-061a2c1f862d tempest-ProjectReaderTests-795927524 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:05:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7210b32f-084f-4e6c-a97a-061a2c1f862d tempest-ProjectReaderTests-795927524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a6c6d2f5-a30f-40ee-805a-369157f37190 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:05:57 devstack sudo[107019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a6c6d2f5-a30f-40ee-805a-369157f37190 1073741824 Sep 28 12:05:57 devstack sudo[107019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:05:57 devstack sudo[107019]: pam_unix(sudo:session): session closed for user root Sep 28 12:05:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7210b32f-084f-4e6c-a97a-061a2c1f862d tempest-ProjectReaderTests-795927524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a6c6d2f5-a30f-40ee-805a-369157f37190 1073741824" returned: 0 in 0.410s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:05:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7210b32f-084f-4e6c-a97a-061a2c1f862d tempest-ProjectReaderTests-795927524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a6c6d2f5-a30f-40ee-805a-369157f37190 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:05:57 devstack sudo[107024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a6c6d2f5-a30f-40ee-805a-369157f37190 Sep 28 12:05:57 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:05:58 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root Sep 28 12:05:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7210b32f-084f-4e6c-a97a-061a2c1f862d tempest-ProjectReaderTests-795927524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a6c6d2f5-a30f-40ee-805a-369157f37190" returned: 0 in 0.261s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:05:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7210b32f-084f-4e6c-a97a-061a2c1f862d tempest-ProjectReaderTests-795927524 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:05:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7210b32f-084f-4e6c-a97a-061a2c1f862d tempest-ProjectReaderTests-795927524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:05:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7210b32f-084f-4e6c-a97a-061a2c1f862d tempest-ProjectReaderTests-795927524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dc3457f-3a7e-45f4-a8d7-1c7efedd13e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6c6d2f5-a30f-40ee-805a-369157f37190', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:05:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7210b32f-084f-4e6c-a97a-061a2c1f862d tempest-ProjectReaderTests-795927524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db8fe7f3-9642-490e-978b-6325d1fe450f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:05:58 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-7210b32f-084f-4e6c-a97a-061a2c1f862d tempest-ProjectReaderTests-795927524 None] Volume volume-a6c6d2f5-a30f-40ee-805a-369157f37190 (a6c6d2f5-a30f-40ee-805a-369157f37190): created successfully Sep 28 12:05:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7210b32f-084f-4e6c-a97a-061a2c1f862d tempest-ProjectReaderTests-795927524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db8fe7f3-9642-490e-978b-6325d1fe450f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:05:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7210b32f-084f-4e6c-a97a-061a2c1f862d tempest-ProjectReaderTests-795927524 None] Flow 'volume_create_manager' (aa0b1b61-9aa5-4fdc-a421-b09bc4ad31b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:05:58 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-7210b32f-084f-4e6c-a97a-061a2c1f862d tempest-ProjectReaderTests-795927524 None] Created volume successfully. Sep 28 12:05:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d21e064d-d7d1-4e4e-9975-263236eae51b tempest-ProjectReaderTests-795927524 None] Acquiring lock "cinder-a6c6d2f5-a30f-40ee-805a-369157f37190-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:05:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d21e064d-d7d1-4e4e-9975-263236eae51b tempest-ProjectReaderTests-795927524 None] Lock "cinder-a6c6d2f5-a30f-40ee-805a-369157f37190-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:05:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d21e064d-d7d1-4e4e-9975-263236eae51b tempest-ProjectReaderTests-795927524 None] Acquiring lock "cinder-quobyte-a6c6d2f5-a30f-40ee-805a-369157f37190" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:05:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d21e064d-d7d1-4e4e-9975-263236eae51b tempest-ProjectReaderTests-795927524 None] Lock "cinder-quobyte-a6c6d2f5-a30f-40ee-805a-369157f37190" acquired by "delete_volume" :: waited 0.013s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:05:58 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d014542-7af7-43f9-b345-fb7727db140e]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:05:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d21e064d-d7d1-4e4e-9975-263236eae51b tempest-ProjectReaderTests-795927524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a6c6d2f5-a30f-40ee-805a-369157f37190 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:05:58 devstack sudo[107027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a6c6d2f5-a30f-40ee-805a-369157f37190 Sep 28 12:05:58 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:05:58 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root Sep 28 12:05:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d21e064d-d7d1-4e4e-9975-263236eae51b tempest-ProjectReaderTests-795927524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a6c6d2f5-a30f-40ee-805a-369157f37190" returned: 0 in 0.364s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:05:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d21e064d-d7d1-4e4e-9975-263236eae51b tempest-ProjectReaderTests-795927524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a6c6d2f5-a30f-40ee-805a-369157f37190 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:05:58 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a6c6d2f5-a30f-40ee-805a-369157f37190 Sep 28 12:05:58 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:05:58 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Sep 28 12:05:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d21e064d-d7d1-4e4e-9975-263236eae51b tempest-ProjectReaderTests-795927524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a6c6d2f5-a30f-40ee-805a-369157f37190" returned: 0 in 0.245s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:05:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d21e064d-d7d1-4e4e-9975-263236eae51b tempest-ProjectReaderTests-795927524 None] Lock "cinder-quobyte-a6c6d2f5-a30f-40ee-805a-369157f37190" released by "delete_volume" :: held 0.654s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:05:59 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-d21e064d-d7d1-4e4e-9975-263236eae51b tempest-ProjectReaderTests-795927524 None] Created reservations ['56e823d0-470c-402c-9e17-544953cd60ba', '1969fe1e-fb86-42e3-b01b-f6e2111de510', 'b46ae4fd-d3f8-4173-aa83-dbd1aacc8bb2', '369925db-7daa-48dd-9c4d-2fa8f8e1688a'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:05:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d21e064d-d7d1-4e4e-9975-263236eae51b tempest-ProjectReaderTests-795927524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:05:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d21e064d-d7d1-4e4e-9975-263236eae51b tempest-ProjectReaderTests-795927524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:05:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d21e064d-d7d1-4e4e-9975-263236eae51b tempest-ProjectReaderTests-795927524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:05:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d21e064d-d7d1-4e4e-9975-263236eae51b tempest-ProjectReaderTests-795927524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:05:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d21e064d-d7d1-4e4e-9975-263236eae51b tempest-ProjectReaderTests-795927524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:05:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d21e064d-d7d1-4e4e-9975-263236eae51b tempest-ProjectReaderTests-795927524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:05:59 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:05:59 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:05:59 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Sep 28 12:05:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d21e064d-d7d1-4e4e-9975-263236eae51b tempest-ProjectReaderTests-795927524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.258s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:05:59 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-d21e064d-d7d1-4e4e-9975-263236eae51b tempest-ProjectReaderTests-795927524 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:05:59 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-d21e064d-d7d1-4e4e-9975-263236eae51b tempest-ProjectReaderTests-795927524 None] Deleted volume successfully. Sep 28 12:05:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d21e064d-d7d1-4e4e-9975-263236eae51b tempest-ProjectReaderTests-795927524 None] Lock "cinder-a6c6d2f5-a30f-40ee-805a-369157f37190-delete_volume" released by "delete_volume" :: held 1.113s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:06:11 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d9a49a2-a8da-4619-a885-67a077b77d61 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:06:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2d9a49a2-a8da-4619-a885-67a077b77d61 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Flow 'volume_create_manager' (c2e919ba-1e78-4508-b66c-0c11e4060700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:06:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2d9a49a2-a8da-4619-a885-67a077b77d61 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6479f14-fb0a-4900-9d57-fad2fac15607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2d9a49a2-a8da-4619-a885-67a077b77d61 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6479f14-fb0a-4900-9d57-fad2fac15607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1850153732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec95a230f7ef4894b205462f8a9a17c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:06:11Z,use_quota=True,user_id='42fad2f83c79410abd63e30982c043ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2d9a49a2-a8da-4619-a885-67a077b77d61 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12926710-e309-4f0d-b4ea-79ff5eaa14bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2d9a49a2-a8da-4619-a885-67a077b77d61 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12926710-e309-4f0d-b4ea-79ff5eaa14bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2d9a49a2-a8da-4619-a885-67a077b77d61 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (262b36d4-08fd-4860-b5a5-f3ad0334cc02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2d9a49a2-a8da-4619-a885-67a077b77d61 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (262b36d4-08fd-4860-b5a5-f3ad0334cc02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e', 'volume_name': 'volume-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2d9a49a2-a8da-4619-a885-67a077b77d61 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfff249c-15f0-4eb5-99ec-190f500ca68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2d9a49a2-a8da-4619-a885-67a077b77d61 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfff249c-15f0-4eb5-99ec-190f500ca68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2d9a49a2-a8da-4619-a885-67a077b77d61 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0637b40-0426-4270-bd46-6d6f34a38bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:11 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-2d9a49a2-a8da-4619-a885-67a077b77d61 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Volume 4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e', 'volume_size': 1} Sep 28 12:06:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2d9a49a2-a8da-4619-a885-67a077b77d61 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2d9a49a2-a8da-4619-a885-67a077b77d61 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2d9a49a2-a8da-4619-a885-67a077b77d61 tempest-CreateVolumesFromSnapshotTest-1799284639 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1850153732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec95a230f7ef4894b205462f8a9a17c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:06:11Z,use_quota=True,user_id='42fad2f83c79410abd63e30982c043ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:06:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-2d9a49a2-a8da-4619-a885-67a077b77d61 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Creating volume 4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:06:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2d9a49a2-a8da-4619-a885-67a077b77d61 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2d9a49a2-a8da-4619-a885-67a077b77d61 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2d9a49a2-a8da-4619-a885-67a077b77d61 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:06:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2d9a49a2-a8da-4619-a885-67a077b77d61 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:06:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2d9a49a2-a8da-4619-a885-67a077b77d61 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2d9a49a2-a8da-4619-a885-67a077b77d61 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:06:11 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-2d9a49a2-a8da-4619-a885-67a077b77d61 tempest-CreateVolumesFromSnapshotTest-1799284639 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:06:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2d9a49a2-a8da-4619-a885-67a077b77d61 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:11 devstack sudo[107077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e 1073741824 Sep 28 12:06:11 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:11 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-3276d041-049e-4e14-854d-cd5c55170248 tempest-CreateVolumesFromImageTest-1278365810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:06:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3276d041-049e-4e14-854d-cd5c55170248 tempest-CreateVolumesFromImageTest-1278365810 None] Flow 'volume_create_manager' (2938304b-1148-4408-be10-6551873c1b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:06:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3276d041-049e-4e14-854d-cd5c55170248 tempest-CreateVolumesFromImageTest-1278365810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (964cc5f3-b406-4c08-9b4a-cb9beae8be24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3276d041-049e-4e14-854d-cd5c55170248 tempest-CreateVolumesFromImageTest-1278365810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (964cc5f3-b406-4c08-9b4a-cb9beae8be24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2123676027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e655a6cc-b600-4e96-99f2-b504b48ac660,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db18cace411b422785a7759602725be1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:06:12Z,use_quota=True,user_id='6052dac0df50490b97fab8ad57e21860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3276d041-049e-4e14-854d-cd5c55170248 tempest-CreateVolumesFromImageTest-1278365810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44efaab7-8500-4ec0-b7a5-506c903a7cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3276d041-049e-4e14-854d-cd5c55170248 tempest-CreateVolumesFromImageTest-1278365810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44efaab7-8500-4ec0-b7a5-506c903a7cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3276d041-049e-4e14-854d-cd5c55170248 tempest-CreateVolumesFromImageTest-1278365810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16b4e9f3-f040-4d3e-83ec-3b4095bb2d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3276d041-049e-4e14-854d-cd5c55170248 tempest-CreateVolumesFromImageTest-1278365810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16b4e9f3-f040-4d3e-83ec-3b4095bb2d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e655a6cc-b600-4e96-99f2-b504b48ac660', 'volume_name': 'volume-e655a6cc-b600-4e96-99f2-b504b48ac660', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3276d041-049e-4e14-854d-cd5c55170248 tempest-CreateVolumesFromImageTest-1278365810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f1a2085-6e84-4a50-a4d0-ad2830a40781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3276d041-049e-4e14-854d-cd5c55170248 tempest-CreateVolumesFromImageTest-1278365810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f1a2085-6e84-4a50-a4d0-ad2830a40781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3276d041-049e-4e14-854d-cd5c55170248 tempest-CreateVolumesFromImageTest-1278365810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae4ecced-9e8c-416a-96df-d4a14ec68d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:11 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-3276d041-049e-4e14-854d-cd5c55170248 tempest-CreateVolumesFromImageTest-1278365810 None] Volume e655a6cc-b600-4e96-99f2-b504b48ac660: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e655a6cc-b600-4e96-99f2-b504b48ac660', 'volume_size': 1} Sep 28 12:06:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3276d041-049e-4e14-854d-cd5c55170248 tempest-CreateVolumesFromImageTest-1278365810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:12 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-77fc48e9-4029-4dc0-9092-f6c69c7c1e2a tempest-CreateVolumesFromImageTest-1278365810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:06:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-77fc48e9-4029-4dc0-9092-f6c69c7c1e2a tempest-CreateVolumesFromImageTest-1278365810 None] Flow 'volume_create_manager' (3ea26718-9069-40ec-8b6f-808d0f1faf26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:06:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-77fc48e9-4029-4dc0-9092-f6c69c7c1e2a tempest-CreateVolumesFromImageTest-1278365810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f25100b1-dc53-49b3-ba26-e113d6c75725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-77fc48e9-4029-4dc0-9092-f6c69c7c1e2a tempest-CreateVolumesFromImageTest-1278365810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f25100b1-dc53-49b3-ba26-e113d6c75725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-365148915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4ccc56d-a67a-4e92-ba11-82f9e165b6b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db18cace411b422785a7759602725be1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:06:12Z,use_quota=True,user_id='6052dac0df50490b97fab8ad57e21860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-77fc48e9-4029-4dc0-9092-f6c69c7c1e2a tempest-CreateVolumesFromImageTest-1278365810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9971d48-a5d8-401d-b67a-4403c1873a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-77fc48e9-4029-4dc0-9092-f6c69c7c1e2a tempest-CreateVolumesFromImageTest-1278365810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9971d48-a5d8-401d-b67a-4403c1873a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-77fc48e9-4029-4dc0-9092-f6c69c7c1e2a tempest-CreateVolumesFromImageTest-1278365810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e970d270-8938-4daa-a719-42744cfbdaf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-77fc48e9-4029-4dc0-9092-f6c69c7c1e2a tempest-CreateVolumesFromImageTest-1278365810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e970d270-8938-4daa-a719-42744cfbdaf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4ccc56d-a67a-4e92-ba11-82f9e165b6b9', 'volume_name': 'volume-e4ccc56d-a67a-4e92-ba11-82f9e165b6b9', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-77fc48e9-4029-4dc0-9092-f6c69c7c1e2a tempest-CreateVolumesFromImageTest-1278365810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e79d701-4376-4a3d-9a63-ebde3cab0140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-77fc48e9-4029-4dc0-9092-f6c69c7c1e2a tempest-CreateVolumesFromImageTest-1278365810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e79d701-4376-4a3d-9a63-ebde3cab0140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-77fc48e9-4029-4dc0-9092-f6c69c7c1e2a tempest-CreateVolumesFromImageTest-1278365810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8ac907f-630e-4fcb-8813-04f37ee8f977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:12 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-77fc48e9-4029-4dc0-9092-f6c69c7c1e2a tempest-CreateVolumesFromImageTest-1278365810 None] Volume e4ccc56d-a67a-4e92-ba11-82f9e165b6b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4ccc56d-a67a-4e92-ba11-82f9e165b6b9', 'volume_size': 1} Sep 28 12:06:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-77fc48e9-4029-4dc0-9092-f6c69c7c1e2a tempest-CreateVolumesFromImageTest-1278365810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:12 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2d9a49a2-a8da-4619-a885-67a077b77d61 tempest-CreateVolumesFromSnapshotTest-1799284639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e 1073741824" returned: 0 in 0.720s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2d9a49a2-a8da-4619-a885-67a077b77d61 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:12 devstack sudo[107083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e Sep 28 12:06:12 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:12 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-df6c965c-40dd-4042-875e-10e0a6cdd0fa tempest-CreateVolumesFromImageTest-1278365810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:06:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-df6c965c-40dd-4042-875e-10e0a6cdd0fa tempest-CreateVolumesFromImageTest-1278365810 None] Flow 'volume_create_manager' (99c5a833-ad14-47fa-a66c-97f2ecbc9549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:06:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-df6c965c-40dd-4042-875e-10e0a6cdd0fa tempest-CreateVolumesFromImageTest-1278365810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60f821f0-674d-411b-a167-2e98faa154b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-df6c965c-40dd-4042-875e-10e0a6cdd0fa tempest-CreateVolumesFromImageTest-1278365810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60f821f0-674d-411b-a167-2e98faa154b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2054122367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fadfa7e1-758d-497e-bc2a-fac769e4c7b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db18cace411b422785a7759602725be1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:06:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:06:13Z,use_quota=True,user_id='6052dac0df50490b97fab8ad57e21860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-df6c965c-40dd-4042-875e-10e0a6cdd0fa tempest-CreateVolumesFromImageTest-1278365810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9db5733f-c18a-40d6-9781-d69a60ae31ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-df6c965c-40dd-4042-875e-10e0a6cdd0fa tempest-CreateVolumesFromImageTest-1278365810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9db5733f-c18a-40d6-9781-d69a60ae31ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-df6c965c-40dd-4042-875e-10e0a6cdd0fa tempest-CreateVolumesFromImageTest-1278365810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0420f7c5-9d8f-409b-a58e-1605f58fd7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-df6c965c-40dd-4042-875e-10e0a6cdd0fa tempest-CreateVolumesFromImageTest-1278365810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0420f7c5-9d8f-409b-a58e-1605f58fd7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fadfa7e1-758d-497e-bc2a-fac769e4c7b6', 'volume_name': 'volume-fadfa7e1-758d-497e-bc2a-fac769e4c7b6', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:12 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-df6c965c-40dd-4042-875e-10e0a6cdd0fa tempest-CreateVolumesFromImageTest-1278365810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94a3d363-cddc-4749-8784-0ccbf126d39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-df6c965c-40dd-4042-875e-10e0a6cdd0fa tempest-CreateVolumesFromImageTest-1278365810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94a3d363-cddc-4749-8784-0ccbf126d39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-df6c965c-40dd-4042-875e-10e0a6cdd0fa tempest-CreateVolumesFromImageTest-1278365810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ed1fd68-dac8-46ae-8d0e-18acf5cbaf96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:12 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-df6c965c-40dd-4042-875e-10e0a6cdd0fa tempest-CreateVolumesFromImageTest-1278365810 None] Volume fadfa7e1-758d-497e-bc2a-fac769e4c7b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fadfa7e1-758d-497e-bc2a-fac769e4c7b6', 'volume_size': 1} Sep 28 12:06:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-df6c965c-40dd-4042-875e-10e0a6cdd0fa tempest-CreateVolumesFromImageTest-1278365810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2d9a49a2-a8da-4619-a885-67a077b77d61 tempest-CreateVolumesFromSnapshotTest-1799284639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e" returned: 0 in 0.391s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2d9a49a2-a8da-4619-a885-67a077b77d61 tempest-CreateVolumesFromSnapshotTest-1799284639 None] <== create_volume: return (1172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:06:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2d9a49a2-a8da-4619-a885-67a077b77d61 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3276d041-049e-4e14-854d-cd5c55170248 tempest-CreateVolumesFromImageTest-1278365810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.995s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3276d041-049e-4e14-854d-cd5c55170248 tempest-CreateVolumesFromImageTest-1278365810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2123676027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e655a6cc-b600-4e96-99f2-b504b48ac660,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db18cace411b422785a7759602725be1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:06:12Z,use_quota=True,user_id='6052dac0df50490b97fab8ad57e21860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:06:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-3276d041-049e-4e14-854d-cd5c55170248 tempest-CreateVolumesFromImageTest-1278365810 None] Creating volume e655a6cc-b600-4e96-99f2-b504b48ac660 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:06:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3276d041-049e-4e14-854d-cd5c55170248 tempest-CreateVolumesFromImageTest-1278365810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3276d041-049e-4e14-854d-cd5c55170248 tempest-CreateVolumesFromImageTest-1278365810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3276d041-049e-4e14-854d-cd5c55170248 tempest-CreateVolumesFromImageTest-1278365810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:06:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3276d041-049e-4e14-854d-cd5c55170248 tempest-CreateVolumesFromImageTest-1278365810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:06:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3276d041-049e-4e14-854d-cd5c55170248 tempest-CreateVolumesFromImageTest-1278365810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3276d041-049e-4e14-854d-cd5c55170248 tempest-CreateVolumesFromImageTest-1278365810 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:06:12 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-3276d041-049e-4e14-854d-cd5c55170248 tempest-CreateVolumesFromImageTest-1278365810 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:06:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3276d041-049e-4e14-854d-cd5c55170248 tempest-CreateVolumesFromImageTest-1278365810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e655a6cc-b600-4e96-99f2-b504b48ac660 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2d9a49a2-a8da-4619-a885-67a077b77d61 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0637b40-0426-4270-bd46-6d6f34a38bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:13 devstack sudo[107100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e655a6cc-b600-4e96-99f2-b504b48ac660 1073741824 Sep 28 12:06:13 devstack sudo[107100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2d9a49a2-a8da-4619-a885-67a077b77d61 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aec8f830-c6a8-4a3b-a46f-38ddaefd8524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:13 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-2d9a49a2-a8da-4619-a885-67a077b77d61 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Volume volume-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e (4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e): created successfully Sep 28 12:06:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2d9a49a2-a8da-4619-a885-67a077b77d61 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aec8f830-c6a8-4a3b-a46f-38ddaefd8524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2d9a49a2-a8da-4619-a885-67a077b77d61 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Flow 'volume_create_manager' (c2e919ba-1e78-4508-b66c-0c11e4060700) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:06:13 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-2d9a49a2-a8da-4619-a885-67a077b77d61 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Created volume successfully. Sep 28 12:06:13 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-24491c07-a358-497d-9ae1-2b8697b35455 tempest-CreateVolumesFromImageTest-1278365810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:06:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-24491c07-a358-497d-9ae1-2b8697b35455 tempest-CreateVolumesFromImageTest-1278365810 None] Flow 'volume_create_manager' (c12f2048-d66b-421e-abc4-f2f9e031c46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:06:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-24491c07-a358-497d-9ae1-2b8697b35455 tempest-CreateVolumesFromImageTest-1278365810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f78fb2e-5417-49a2-9a83-a91948c55349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-24491c07-a358-497d-9ae1-2b8697b35455 tempest-CreateVolumesFromImageTest-1278365810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f78fb2e-5417-49a2-9a83-a91948c55349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:06:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-77918389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2483b8f4-fdbb-45ac-b54f-8f7ffa85febf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db18cace411b422785a7759602725be1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:06:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:06:13Z,use_quota=True,user_id='6052dac0df50490b97fab8ad57e21860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-24491c07-a358-497d-9ae1-2b8697b35455 tempest-CreateVolumesFromImageTest-1278365810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c76e05c5-86c7-4ec2-8cc0-1c5d27afba40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-24491c07-a358-497d-9ae1-2b8697b35455 tempest-CreateVolumesFromImageTest-1278365810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c76e05c5-86c7-4ec2-8cc0-1c5d27afba40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-24491c07-a358-497d-9ae1-2b8697b35455 tempest-CreateVolumesFromImageTest-1278365810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14bd48e6-a2f6-40d6-bb01-ff24f021bafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-24491c07-a358-497d-9ae1-2b8697b35455 tempest-CreateVolumesFromImageTest-1278365810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14bd48e6-a2f6-40d6-bb01-ff24f021bafd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2483b8f4-fdbb-45ac-b54f-8f7ffa85febf', 'volume_name': 'volume-2483b8f4-fdbb-45ac-b54f-8f7ffa85febf', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-24491c07-a358-497d-9ae1-2b8697b35455 tempest-CreateVolumesFromImageTest-1278365810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (617aa4ce-9636-4ad3-bad1-801f2440a99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-24491c07-a358-497d-9ae1-2b8697b35455 tempest-CreateVolumesFromImageTest-1278365810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (617aa4ce-9636-4ad3-bad1-801f2440a99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-24491c07-a358-497d-9ae1-2b8697b35455 tempest-CreateVolumesFromImageTest-1278365810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1176cf3d-9972-4c9a-be12-659b468dc011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:13 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-24491c07-a358-497d-9ae1-2b8697b35455 tempest-CreateVolumesFromImageTest-1278365810 None] Volume 2483b8f4-fdbb-45ac-b54f-8f7ffa85febf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2483b8f4-fdbb-45ac-b54f-8f7ffa85febf', 'volume_size': 1} Sep 28 12:06:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-24491c07-a358-497d-9ae1-2b8697b35455 tempest-CreateVolumesFromImageTest-1278365810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:13 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-022c93c5-0a49-4a08-aa08-2d3df8d9b2a0 tempest-CreateVolumesFromImageTest-1278365810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:06:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-022c93c5-0a49-4a08-aa08-2d3df8d9b2a0 tempest-CreateVolumesFromImageTest-1278365810 None] Flow 'volume_create_manager' (6d99a3fa-b8ba-4a93-b370-39eda17f6eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:06:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-022c93c5-0a49-4a08-aa08-2d3df8d9b2a0 tempest-CreateVolumesFromImageTest-1278365810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e45e0f5e-672b-4b85-abb7-b5ca65a4dcb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-022c93c5-0a49-4a08-aa08-2d3df8d9b2a0 tempest-CreateVolumesFromImageTest-1278365810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e45e0f5e-672b-4b85-abb7-b5ca65a4dcb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:06:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1018175286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3763c06-0a1a-4200-a1ff-f9aa8e7ea7a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db18cace411b422785a7759602725be1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:06:14Z,use_quota=True,user_id='6052dac0df50490b97fab8ad57e21860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-022c93c5-0a49-4a08-aa08-2d3df8d9b2a0 tempest-CreateVolumesFromImageTest-1278365810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (356ed525-15c4-4e84-8670-5dfb8748426f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-022c93c5-0a49-4a08-aa08-2d3df8d9b2a0 tempest-CreateVolumesFromImageTest-1278365810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (356ed525-15c4-4e84-8670-5dfb8748426f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-022c93c5-0a49-4a08-aa08-2d3df8d9b2a0 tempest-CreateVolumesFromImageTest-1278365810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed119872-932d-41cf-a331-fb1ed3d9f590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-022c93c5-0a49-4a08-aa08-2d3df8d9b2a0 tempest-CreateVolumesFromImageTest-1278365810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed119872-932d-41cf-a331-fb1ed3d9f590) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3763c06-0a1a-4200-a1ff-f9aa8e7ea7a2', 'volume_name': 'volume-e3763c06-0a1a-4200-a1ff-f9aa8e7ea7a2', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-022c93c5-0a49-4a08-aa08-2d3df8d9b2a0 tempest-CreateVolumesFromImageTest-1278365810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61008165-d39b-44f7-a213-c844b15ddaa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-022c93c5-0a49-4a08-aa08-2d3df8d9b2a0 tempest-CreateVolumesFromImageTest-1278365810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61008165-d39b-44f7-a213-c844b15ddaa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-022c93c5-0a49-4a08-aa08-2d3df8d9b2a0 tempest-CreateVolumesFromImageTest-1278365810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e8f2d60-b07e-4ae6-a6d4-d7992c5b57b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:13 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-022c93c5-0a49-4a08-aa08-2d3df8d9b2a0 tempest-CreateVolumesFromImageTest-1278365810 None] Volume e3763c06-0a1a-4200-a1ff-f9aa8e7ea7a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3763c06-0a1a-4200-a1ff-f9aa8e7ea7a2', 'volume_size': 1} Sep 28 12:06:13 devstack sudo[107100]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-022c93c5-0a49-4a08-aa08-2d3df8d9b2a0 tempest-CreateVolumesFromImageTest-1278365810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3276d041-049e-4e14-854d-cd5c55170248 tempest-CreateVolumesFromImageTest-1278365810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e655a6cc-b600-4e96-99f2-b504b48ac660 1073741824" returned: 0 in 0.957s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-51e2ce8a-fe7b-470d-a98b-3889673721ad tempest-CreateVolumesFromSnapshotTest-1799284639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3276d041-049e-4e14-854d-cd5c55170248 tempest-CreateVolumesFromImageTest-1278365810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e655a6cc-b600-4e96-99f2-b504b48ac660 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:13 devstack sudo[107128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e655a6cc-b600-4e96-99f2-b504b48ac660 Sep 28 12:06:14 devstack sudo[107128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:14 devstack sudo[107128]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3276d041-049e-4e14-854d-cd5c55170248 tempest-CreateVolumesFromImageTest-1278365810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e655a6cc-b600-4e96-99f2-b504b48ac660" returned: 0 in 0.283s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3276d041-049e-4e14-854d-cd5c55170248 tempest-CreateVolumesFromImageTest-1278365810 None] <== create_volume: return (1318ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:06:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3276d041-049e-4e14-854d-cd5c55170248 tempest-CreateVolumesFromImageTest-1278365810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.323s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-77fc48e9-4029-4dc0-9092-f6c69c7c1e2a tempest-CreateVolumesFromImageTest-1278365810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.984s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-77fc48e9-4029-4dc0-9092-f6c69c7c1e2a tempest-CreateVolumesFromImageTest-1278365810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-365148915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4ccc56d-a67a-4e92-ba11-82f9e165b6b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db18cace411b422785a7759602725be1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:06:12Z,use_quota=True,user_id='6052dac0df50490b97fab8ad57e21860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:06:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-77fc48e9-4029-4dc0-9092-f6c69c7c1e2a tempest-CreateVolumesFromImageTest-1278365810 None] Creating volume e4ccc56d-a67a-4e92-ba11-82f9e165b6b9 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:06:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-77fc48e9-4029-4dc0-9092-f6c69c7c1e2a tempest-CreateVolumesFromImageTest-1278365810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-77fc48e9-4029-4dc0-9092-f6c69c7c1e2a tempest-CreateVolumesFromImageTest-1278365810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-77fc48e9-4029-4dc0-9092-f6c69c7c1e2a tempest-CreateVolumesFromImageTest-1278365810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:06:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-77fc48e9-4029-4dc0-9092-f6c69c7c1e2a tempest-CreateVolumesFromImageTest-1278365810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:06:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-77fc48e9-4029-4dc0-9092-f6c69c7c1e2a tempest-CreateVolumesFromImageTest-1278365810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-77fc48e9-4029-4dc0-9092-f6c69c7c1e2a tempest-CreateVolumesFromImageTest-1278365810 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:06:14 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-77fc48e9-4029-4dc0-9092-f6c69c7c1e2a tempest-CreateVolumesFromImageTest-1278365810 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:06:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-77fc48e9-4029-4dc0-9092-f6c69c7c1e2a tempest-CreateVolumesFromImageTest-1278365810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e4ccc56d-a67a-4e92-ba11-82f9e165b6b9 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3276d041-049e-4e14-854d-cd5c55170248 tempest-CreateVolumesFromImageTest-1278365810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae4ecced-9e8c-416a-96df-d4a14ec68d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e655a6cc-b600-4e96-99f2-b504b48ac660', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:14 devstack sudo[107131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e4ccc56d-a67a-4e92-ba11-82f9e165b6b9 1073741824 Sep 28 12:06:14 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3276d041-049e-4e14-854d-cd5c55170248 tempest-CreateVolumesFromImageTest-1278365810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22dcb2e9-a23c-452e-ad86-6bdb6a77425b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:14 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-3276d041-049e-4e14-854d-cd5c55170248 tempest-CreateVolumesFromImageTest-1278365810 None] Volume volume-e655a6cc-b600-4e96-99f2-b504b48ac660 (e655a6cc-b600-4e96-99f2-b504b48ac660): created successfully Sep 28 12:06:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3276d041-049e-4e14-854d-cd5c55170248 tempest-CreateVolumesFromImageTest-1278365810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22dcb2e9-a23c-452e-ad86-6bdb6a77425b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3276d041-049e-4e14-854d-cd5c55170248 tempest-CreateVolumesFromImageTest-1278365810 None] Flow 'volume_create_manager' (2938304b-1148-4408-be10-6551873c1b04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:06:14 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-3276d041-049e-4e14-854d-cd5c55170248 tempest-CreateVolumesFromImageTest-1278365810 None] Created volume successfully. Sep 28 12:06:14 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-77fc48e9-4029-4dc0-9092-f6c69c7c1e2a tempest-CreateVolumesFromImageTest-1278365810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e4ccc56d-a67a-4e92-ba11-82f9e165b6b9 1073741824" returned: 0 in 0.507s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-77fc48e9-4029-4dc0-9092-f6c69c7c1e2a tempest-CreateVolumesFromImageTest-1278365810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e4ccc56d-a67a-4e92-ba11-82f9e165b6b9 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:14 devstack sudo[107137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e4ccc56d-a67a-4e92-ba11-82f9e165b6b9 Sep 28 12:06:14 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:15 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-77fc48e9-4029-4dc0-9092-f6c69c7c1e2a tempest-CreateVolumesFromImageTest-1278365810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e4ccc56d-a67a-4e92-ba11-82f9e165b6b9" returned: 0 in 0.312s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-77fc48e9-4029-4dc0-9092-f6c69c7c1e2a tempest-CreateVolumesFromImageTest-1278365810 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:06:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-77fc48e9-4029-4dc0-9092-f6c69c7c1e2a tempest-CreateVolumesFromImageTest-1278365810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-df6c965c-40dd-4042-875e-10e0a6cdd0fa tempest-CreateVolumesFromImageTest-1278365810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.220s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-df6c965c-40dd-4042-875e-10e0a6cdd0fa tempest-CreateVolumesFromImageTest-1278365810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2054122367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fadfa7e1-758d-497e-bc2a-fac769e4c7b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db18cace411b422785a7759602725be1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:06:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:06:13Z,use_quota=True,user_id='6052dac0df50490b97fab8ad57e21860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:06:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-df6c965c-40dd-4042-875e-10e0a6cdd0fa tempest-CreateVolumesFromImageTest-1278365810 None] Creating volume fadfa7e1-758d-497e-bc2a-fac769e4c7b6 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:06:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-df6c965c-40dd-4042-875e-10e0a6cdd0fa tempest-CreateVolumesFromImageTest-1278365810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-df6c965c-40dd-4042-875e-10e0a6cdd0fa tempest-CreateVolumesFromImageTest-1278365810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-df6c965c-40dd-4042-875e-10e0a6cdd0fa tempest-CreateVolumesFromImageTest-1278365810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:06:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-df6c965c-40dd-4042-875e-10e0a6cdd0fa tempest-CreateVolumesFromImageTest-1278365810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:06:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-df6c965c-40dd-4042-875e-10e0a6cdd0fa tempest-CreateVolumesFromImageTest-1278365810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-df6c965c-40dd-4042-875e-10e0a6cdd0fa tempest-CreateVolumesFromImageTest-1278365810 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:06:15 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-df6c965c-40dd-4042-875e-10e0a6cdd0fa tempest-CreateVolumesFromImageTest-1278365810 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:06:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-df6c965c-40dd-4042-875e-10e0a6cdd0fa tempest-CreateVolumesFromImageTest-1278365810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-fadfa7e1-758d-497e-bc2a-fac769e4c7b6 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-77fc48e9-4029-4dc0-9092-f6c69c7c1e2a tempest-CreateVolumesFromImageTest-1278365810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8ac907f-630e-4fcb-8813-04f37ee8f977) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4ccc56d-a67a-4e92-ba11-82f9e165b6b9', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:15 devstack sudo[107140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-fadfa7e1-758d-497e-bc2a-fac769e4c7b6 1073741824 Sep 28 12:06:15 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-77fc48e9-4029-4dc0-9092-f6c69c7c1e2a tempest-CreateVolumesFromImageTest-1278365810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b90982b5-3a64-4477-9163-f84285066fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:15 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-77fc48e9-4029-4dc0-9092-f6c69c7c1e2a tempest-CreateVolumesFromImageTest-1278365810 None] Volume volume-e4ccc56d-a67a-4e92-ba11-82f9e165b6b9 (e4ccc56d-a67a-4e92-ba11-82f9e165b6b9): created successfully Sep 28 12:06:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-77fc48e9-4029-4dc0-9092-f6c69c7c1e2a tempest-CreateVolumesFromImageTest-1278365810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b90982b5-3a64-4477-9163-f84285066fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-77fc48e9-4029-4dc0-9092-f6c69c7c1e2a tempest-CreateVolumesFromImageTest-1278365810 None] Flow 'volume_create_manager' (3ea26718-9069-40ec-8b6f-808d0f1faf26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:06:15 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-77fc48e9-4029-4dc0-9092-f6c69c7c1e2a tempest-CreateVolumesFromImageTest-1278365810 None] Created volume successfully. Sep 28 12:06:15 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-df6c965c-40dd-4042-875e-10e0a6cdd0fa tempest-CreateVolumesFromImageTest-1278365810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-fadfa7e1-758d-497e-bc2a-fac769e4c7b6 1073741824" returned: 0 in 0.686s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-df6c965c-40dd-4042-875e-10e0a6cdd0fa tempest-CreateVolumesFromImageTest-1278365810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-fadfa7e1-758d-497e-bc2a-fac769e4c7b6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:15 devstack sudo[107148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-fadfa7e1-758d-497e-bc2a-fac769e4c7b6 Sep 28 12:06:15 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:16 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-df6c965c-40dd-4042-875e-10e0a6cdd0fa tempest-CreateVolumesFromImageTest-1278365810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-fadfa7e1-758d-497e-bc2a-fac769e4c7b6" returned: 0 in 0.264s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-df6c965c-40dd-4042-875e-10e0a6cdd0fa tempest-CreateVolumesFromImageTest-1278365810 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:06:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-df6c965c-40dd-4042-875e-10e0a6cdd0fa tempest-CreateVolumesFromImageTest-1278365810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-24491c07-a358-497d-9ae1-2b8697b35455 tempest-CreateVolumesFromImageTest-1278365810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.706s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-24491c07-a358-497d-9ae1-2b8697b35455 tempest-CreateVolumesFromImageTest-1278365810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:06:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-77918389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2483b8f4-fdbb-45ac-b54f-8f7ffa85febf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db18cace411b422785a7759602725be1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:06:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:06:13Z,use_quota=True,user_id='6052dac0df50490b97fab8ad57e21860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:06:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-24491c07-a358-497d-9ae1-2b8697b35455 tempest-CreateVolumesFromImageTest-1278365810 None] Creating volume 2483b8f4-fdbb-45ac-b54f-8f7ffa85febf {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:06:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-24491c07-a358-497d-9ae1-2b8697b35455 tempest-CreateVolumesFromImageTest-1278365810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-24491c07-a358-497d-9ae1-2b8697b35455 tempest-CreateVolumesFromImageTest-1278365810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-24491c07-a358-497d-9ae1-2b8697b35455 tempest-CreateVolumesFromImageTest-1278365810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:06:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-24491c07-a358-497d-9ae1-2b8697b35455 tempest-CreateVolumesFromImageTest-1278365810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:06:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-24491c07-a358-497d-9ae1-2b8697b35455 tempest-CreateVolumesFromImageTest-1278365810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-24491c07-a358-497d-9ae1-2b8697b35455 tempest-CreateVolumesFromImageTest-1278365810 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:06:16 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-24491c07-a358-497d-9ae1-2b8697b35455 tempest-CreateVolumesFromImageTest-1278365810 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:06:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-24491c07-a358-497d-9ae1-2b8697b35455 tempest-CreateVolumesFromImageTest-1278365810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2483b8f4-fdbb-45ac-b54f-8f7ffa85febf 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-df6c965c-40dd-4042-875e-10e0a6cdd0fa tempest-CreateVolumesFromImageTest-1278365810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ed1fd68-dac8-46ae-8d0e-18acf5cbaf96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fadfa7e1-758d-497e-bc2a-fac769e4c7b6', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:16 devstack sudo[107151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2483b8f4-fdbb-45ac-b54f-8f7ffa85febf 1073741824 Sep 28 12:06:16 devstack sudo[107151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-df6c965c-40dd-4042-875e-10e0a6cdd0fa tempest-CreateVolumesFromImageTest-1278365810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ab02141-c353-4dd1-ad30-b2c4aba649be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:16 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-df6c965c-40dd-4042-875e-10e0a6cdd0fa tempest-CreateVolumesFromImageTest-1278365810 None] Volume volume-fadfa7e1-758d-497e-bc2a-fac769e4c7b6 (fadfa7e1-758d-497e-bc2a-fac769e4c7b6): created successfully Sep 28 12:06:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-df6c965c-40dd-4042-875e-10e0a6cdd0fa tempest-CreateVolumesFromImageTest-1278365810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ab02141-c353-4dd1-ad30-b2c4aba649be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-df6c965c-40dd-4042-875e-10e0a6cdd0fa tempest-CreateVolumesFromImageTest-1278365810 None] Flow 'volume_create_manager' (99c5a833-ad14-47fa-a66c-97f2ecbc9549) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:06:16 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-df6c965c-40dd-4042-875e-10e0a6cdd0fa tempest-CreateVolumesFromImageTest-1278365810 None] Created volume successfully. Sep 28 12:06:16 devstack sudo[107151]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-24491c07-a358-497d-9ae1-2b8697b35455 tempest-CreateVolumesFromImageTest-1278365810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2483b8f4-fdbb-45ac-b54f-8f7ffa85febf 1073741824" returned: 0 in 0.570s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-24491c07-a358-497d-9ae1-2b8697b35455 tempest-CreateVolumesFromImageTest-1278365810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2483b8f4-fdbb-45ac-b54f-8f7ffa85febf {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:16 devstack sudo[107164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2483b8f4-fdbb-45ac-b54f-8f7ffa85febf Sep 28 12:06:16 devstack sudo[107164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:17 devstack sudo[107164]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-24491c07-a358-497d-9ae1-2b8697b35455 tempest-CreateVolumesFromImageTest-1278365810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2483b8f4-fdbb-45ac-b54f-8f7ffa85febf" returned: 0 in 0.291s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-24491c07-a358-497d-9ae1-2b8697b35455 tempest-CreateVolumesFromImageTest-1278365810 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:06:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-24491c07-a358-497d-9ae1-2b8697b35455 tempest-CreateVolumesFromImageTest-1278365810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-022c93c5-0a49-4a08-aa08-2d3df8d9b2a0 tempest-CreateVolumesFromImageTest-1278365810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.202s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-022c93c5-0a49-4a08-aa08-2d3df8d9b2a0 tempest-CreateVolumesFromImageTest-1278365810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:06:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1018175286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3763c06-0a1a-4200-a1ff-f9aa8e7ea7a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db18cace411b422785a7759602725be1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:06:14Z,use_quota=True,user_id='6052dac0df50490b97fab8ad57e21860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:06:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-022c93c5-0a49-4a08-aa08-2d3df8d9b2a0 tempest-CreateVolumesFromImageTest-1278365810 None] Creating volume e3763c06-0a1a-4200-a1ff-f9aa8e7ea7a2 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:06:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-022c93c5-0a49-4a08-aa08-2d3df8d9b2a0 tempest-CreateVolumesFromImageTest-1278365810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-022c93c5-0a49-4a08-aa08-2d3df8d9b2a0 tempest-CreateVolumesFromImageTest-1278365810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-022c93c5-0a49-4a08-aa08-2d3df8d9b2a0 tempest-CreateVolumesFromImageTest-1278365810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:06:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-022c93c5-0a49-4a08-aa08-2d3df8d9b2a0 tempest-CreateVolumesFromImageTest-1278365810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:06:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-022c93c5-0a49-4a08-aa08-2d3df8d9b2a0 tempest-CreateVolumesFromImageTest-1278365810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-022c93c5-0a49-4a08-aa08-2d3df8d9b2a0 tempest-CreateVolumesFromImageTest-1278365810 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:06:17 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-022c93c5-0a49-4a08-aa08-2d3df8d9b2a0 tempest-CreateVolumesFromImageTest-1278365810 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:06:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-022c93c5-0a49-4a08-aa08-2d3df8d9b2a0 tempest-CreateVolumesFromImageTest-1278365810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e3763c06-0a1a-4200-a1ff-f9aa8e7ea7a2 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-24491c07-a358-497d-9ae1-2b8697b35455 tempest-CreateVolumesFromImageTest-1278365810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1176cf3d-9972-4c9a-be12-659b468dc011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2483b8f4-fdbb-45ac-b54f-8f7ffa85febf', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:17 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e3763c06-0a1a-4200-a1ff-f9aa8e7ea7a2 1073741824 Sep 28 12:06:17 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-24491c07-a358-497d-9ae1-2b8697b35455 tempest-CreateVolumesFromImageTest-1278365810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f8c2447-6aa3-40af-b604-ced22f17d750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:17 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-24491c07-a358-497d-9ae1-2b8697b35455 tempest-CreateVolumesFromImageTest-1278365810 None] Volume volume-2483b8f4-fdbb-45ac-b54f-8f7ffa85febf (2483b8f4-fdbb-45ac-b54f-8f7ffa85febf): created successfully Sep 28 12:06:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-24491c07-a358-497d-9ae1-2b8697b35455 tempest-CreateVolumesFromImageTest-1278365810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f8c2447-6aa3-40af-b604-ced22f17d750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-24491c07-a358-497d-9ae1-2b8697b35455 tempest-CreateVolumesFromImageTest-1278365810 None] Flow 'volume_create_manager' (c12f2048-d66b-421e-abc4-f2f9e031c46d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:06:17 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-24491c07-a358-497d-9ae1-2b8697b35455 tempest-CreateVolumesFromImageTest-1278365810 None] Created volume successfully. Sep 28 12:06:17 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:06:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Flow 'volume_create_manager' (66647723-7da8-48a9-9da7-b5a368b6da36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:06:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dc952b4-c55d-4e2b-8550-ccd2a5e24442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dc952b4-c55d-4e2b-8550-ccd2a5e24442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:06:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=437d0068-b3f5-405e-9284-30fcb790b60a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1185589cbe31440eb6c30f2196135636',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:06:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:06:18Z,use_quota=True,user_id='caaf8cc5008d4da889944db8a9c95809',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ffb1672e-e272-4c5c-bd71-c1362054c964),volume_type_id=ffb1672e-e272-4c5c-bd71-c1362054c964)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32359b7c-856a-401c-91fd-ad4b42bf68c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32359b7c-856a-401c-91fd-ad4b42bf68c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e74ea1f-0cae-4478-a5f4-757e1e891ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:17 devstack cinder-volume[86916]: DEBUG cinder.image.glance [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Creating Keystone auth plugin from conf {{(pid=86916) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 12:06:17 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-022c93c5-0a49-4a08-aa08-2d3df8d9b2a0 tempest-CreateVolumesFromImageTest-1278365810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e3763c06-0a1a-4200-a1ff-f9aa8e7ea7a2 1073741824" returned: 0 in 0.599s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-022c93c5-0a49-4a08-aa08-2d3df8d9b2a0 tempest-CreateVolumesFromImageTest-1278365810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e3763c06-0a1a-4200-a1ff-f9aa8e7ea7a2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:17 devstack sudo[107173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e3763c06-0a1a-4200-a1ff-f9aa8e7ea7a2 Sep 28 12:06:17 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e74ea1f-0cae-4478-a5f4-757e1e891ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '437d0068-b3f5-405e-9284-30fcb790b60a', 'volume_name': 'volume-437d0068-b3f5-405e-9284-30fcb790b60a', 'volume_size': 1, 'image_id': '95bd6a1e-5e6e-4592-a71e-b8530542c810', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/95bd6a1e-5e6e-4592-a71e-b8530542c810', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '54dace5069aef0aa05d82dc490e8a733', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1185589cbe31440eb6c30f2196135636', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7c378a03e0e616a699d7107f361ce445357f9d703e1284f54a5bc7fff0527f397c7936003c1977dd1e6ff1eca6f65d1081e5389ed593ff8f64d70a8d0cdbf723', 'id': '95bd6a1e-5e6e-4592-a71e-b8530542c810', 'created_at': datetime.datetime(2026, 9, 28, 10, 6, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 6, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/95bd6a1e-5e6e-4592-a71e-b8530542c810/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66be0a51-0f73-4cd4-928b-97b0adfab0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66be0a51-0f73-4cd4-928b-97b0adfab0aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c401379-38af-43f7-8bfd-bf50e995e8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:18 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Volume 437d0068-b3f5-405e-9284-30fcb790b60a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-437d0068-b3f5-405e-9284-30fcb790b60a', 'volume_size': 1, 'image_id': '95bd6a1e-5e6e-4592-a71e-b8530542c810', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/95bd6a1e-5e6e-4592-a71e-b8530542c810', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '54dace5069aef0aa05d82dc490e8a733', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1185589cbe31440eb6c30f2196135636', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7c378a03e0e616a699d7107f361ce445357f9d703e1284f54a5bc7fff0527f397c7936003c1977dd1e6ff1eca6f65d1081e5389ed593ff8f64d70a8d0cdbf723', 'id': '95bd6a1e-5e6e-4592-a71e-b8530542c810', 'created_at': datetime.datetime(2026, 9, 28, 10, 6, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 6, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/95bd6a1e-5e6e-4592-a71e-b8530542c810/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 28 12:06:18 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Trying to clone 437d0068-b3f5-405e-9284-30fcb790b60a from image 95bd6a1e-5e6e-4592-a71e-b8530542c810 at location (None, [{'url': 'file:///opt/stack/data/glance/images/95bd6a1e-5e6e-4592-a71e-b8530542c810', 'metadata': {}}]). {{(pid=86916) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 12:06:18 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-022c93c5-0a49-4a08-aa08-2d3df8d9b2a0 tempest-CreateVolumesFromImageTest-1278365810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e3763c06-0a1a-4200-a1ff-f9aa8e7ea7a2" returned: 0 in 0.330s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-022c93c5-0a49-4a08-aa08-2d3df8d9b2a0 tempest-CreateVolumesFromImageTest-1278365810 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:06:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-022c93c5-0a49-4a08-aa08-2d3df8d9b2a0 tempest-CreateVolumesFromImageTest-1278365810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-51e2ce8a-fe7b-470d-a98b-3889673721ad tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.128s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-022c93c5-0a49-4a08-aa08-2d3df8d9b2a0 tempest-CreateVolumesFromImageTest-1278365810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e8f2d60-b07e-4ae6-a6d4-d7992c5b57b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3763c06-0a1a-4200-a1ff-f9aa8e7ea7a2', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-022c93c5-0a49-4a08-aa08-2d3df8d9b2a0 tempest-CreateVolumesFromImageTest-1278365810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5fdfd8a-eaaa-4966-92a1-9459ee51d240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-51e2ce8a-fe7b-470d-a98b-3889673721ad tempest-CreateVolumesFromSnapshotTest-1799284639 None] Creating offline snapshot a2f5cc6f-c397-49b6-a7ea-67bb624d70df of volume 4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:06:18 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-022c93c5-0a49-4a08-aa08-2d3df8d9b2a0 tempest-CreateVolumesFromImageTest-1278365810 None] Volume volume-e3763c06-0a1a-4200-a1ff-f9aa8e7ea7a2 (e3763c06-0a1a-4200-a1ff-f9aa8e7ea7a2): created successfully Sep 28 12:06:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-022c93c5-0a49-4a08-aa08-2d3df8d9b2a0 tempest-CreateVolumesFromImageTest-1278365810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5fdfd8a-eaaa-4966-92a1-9459ee51d240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-022c93c5-0a49-4a08-aa08-2d3df8d9b2a0 tempest-CreateVolumesFromImageTest-1278365810 None] Flow 'volume_create_manager' (6d99a3fa-b8ba-4a93-b370-39eda17f6eb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:06:18 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72f8d8c-3e83-47e7-945f-ef463e036058]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:06:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-51e2ce8a-fe7b-470d-a98b-3889673721ad tempest-CreateVolumesFromSnapshotTest-1799284639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:18 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-022c93c5-0a49-4a08-aa08-2d3df8d9b2a0 tempest-CreateVolumesFromImageTest-1278365810 None] Created volume successfully. Sep 28 12:06:18 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_95bd6a1e-5e6e-4592-a71e-b8530542c810_vy06uawidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 12:06:18 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Image download 0.00 MB at 0.00 MB/s Sep 28 12:06:18 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd71f59-a8f5-4cf2-841c-d99b0a4df4e4]: (4, 'raw') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:06:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_95bd6a1e-5e6e-4592-a71e-b8530542c810_vy06uawidevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:18 devstack sudo[107176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e Sep 28 12:06:18 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:18 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_95bd6a1e-5e6e-4592-a71e-b8530542c810_vy06uawidevstack@QuobyteHD Sep 28 12:06:18 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:18 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b24aa54-224c-41e2-ab2f-9537cfec5ee5 tempest-ProjectMemberTests-1312558137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:06:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2b24aa54-224c-41e2-ab2f-9537cfec5ee5 tempest-ProjectMemberTests-1312558137 None] Flow 'volume_create_manager' (2c953355-9377-4189-b0dc-6fcb25128fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:06:18 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:18 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2b24aa54-224c-41e2-ab2f-9537cfec5ee5 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b82badd6-0894-4e76-bbc9-583b84243b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_95bd6a1e-5e6e-4592-a71e-b8530542c810_vy06uawidevstack@QuobyteHD" returned: 0 in 0.362s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-51e2ce8a-fe7b-470d-a98b-3889673721ad tempest-CreateVolumesFromSnapshotTest-1799284639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e" returned: 0 in 0.464s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_95bd6a1e-5e6e-4592-a71e-b8530542c810_vy06uawidevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-51e2ce8a-fe7b-470d-a98b-3889673721ad tempest-CreateVolumesFromSnapshotTest-1799284639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e.a2f5cc6f-c397-49b6-a7ea-67bb624d70df 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2b24aa54-224c-41e2-ab2f-9537cfec5ee5 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b82badd6-0894-4e76-bbc9-583b84243b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:06:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1327708520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cf94d6a-7beb-4cdf-92ed-76f753c469b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba606417eb184510b6154fa1a28dce16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:06:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:06:19Z,use_quota=True,user_id='bb30da770afa465f8162e7779a473226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:18 devstack sudo[107186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e.a2f5cc6f-c397-49b6-a7ea-67bb624d70df 1G Sep 28 12:06:18 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2b24aa54-224c-41e2-ab2f-9537cfec5ee5 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19a0c3e9-86e6-45e5-8161-1a6f0048e54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2b24aa54-224c-41e2-ab2f-9537cfec5ee5 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19a0c3e9-86e6-45e5-8161-1a6f0048e54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2b24aa54-224c-41e2-ab2f-9537cfec5ee5 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93cb6efc-1695-44c3-ba34-886ea316a83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2b24aa54-224c-41e2-ab2f-9537cfec5ee5 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93cb6efc-1695-44c3-ba34-886ea316a83c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cf94d6a-7beb-4cdf-92ed-76f753c469b4', 'volume_name': 'volume-4cf94d6a-7beb-4cdf-92ed-76f753c469b4', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2b24aa54-224c-41e2-ab2f-9537cfec5ee5 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f079b6a-e37b-4fff-9e10-69e922cd3265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2b24aa54-224c-41e2-ab2f-9537cfec5ee5 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f079b6a-e37b-4fff-9e10-69e922cd3265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2b24aa54-224c-41e2-ab2f-9537cfec5ee5 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b0d2772-af0f-459c-ab90-7f723b6ef62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:18 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-2b24aa54-224c-41e2-ab2f-9537cfec5ee5 tempest-ProjectMemberTests-1312558137 None] Volume 4cf94d6a-7beb-4cdf-92ed-76f753c469b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cf94d6a-7beb-4cdf-92ed-76f753c469b4', 'volume_size': 1} Sep 28 12:06:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2b24aa54-224c-41e2-ab2f-9537cfec5ee5 tempest-ProjectMemberTests-1312558137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:18 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_95bd6a1e-5e6e-4592-a71e-b8530542c810_vy06uawidevstack@QuobyteHD Sep 28 12:06:18 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:18 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_95bd6a1e-5e6e-4592-a71e-b8530542c810_vy06uawidevstack@QuobyteHD" returned: 1 in 0.328s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_95bd6a1e-5e6e-4592-a71e-b8530542c810_vy06uawidevstack@QuobyteHD' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:06:18 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Temporary image 95bd6a1e-5e6e-4592-a71e-b8530542c810 is fetched for user caaf8cc5008d4da889944db8a9c95809. {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 12:06:19 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c26c02-efe4-4de7-b0c1-a45191ce7381]: (4, 'raw') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:06:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_95bd6a1e-5e6e-4592-a71e-b8530542c810_vy06uawidevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:19 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-51e2ce8a-fe7b-470d-a98b-3889673721ad tempest-CreateVolumesFromSnapshotTest-1799284639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e.a2f5cc6f-c397-49b6-a7ea-67bb624d70df 1G" returned: 0 in 0.438s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-51e2ce8a-fe7b-470d-a98b-3889673721ad tempest-CreateVolumesFromSnapshotTest-1799284639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e.a2f5cc6f-c397-49b6-a7ea-67bb624d70df {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:19 devstack sudo[107196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e.a2f5cc6f-c397-49b6-a7ea-67bb624d70df Sep 28 12:06:19 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:19 devstack sudo[107195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_95bd6a1e-5e6e-4592-a71e-b8530542c810_vy06uawidevstack@QuobyteHD Sep 28 12:06:19 devstack sudo[107195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-00235f9e-712d-4b91-be6b-64555267fd99 tempest-CreateVolumesFromImageTest-1278365810 None] Acquiring lock "cinder-e3763c06-0a1a-4200-a1ff-f9aa8e7ea7a2-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:06:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-00235f9e-712d-4b91-be6b-64555267fd99 tempest-CreateVolumesFromImageTest-1278365810 None] Lock "cinder-e3763c06-0a1a-4200-a1ff-f9aa8e7ea7a2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:06:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-00235f9e-712d-4b91-be6b-64555267fd99 tempest-CreateVolumesFromImageTest-1278365810 None] Acquiring lock "cinder-quobyte-e3763c06-0a1a-4200-a1ff-f9aa8e7ea7a2" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:06:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-00235f9e-712d-4b91-be6b-64555267fd99 tempest-CreateVolumesFromImageTest-1278365810 None] Lock "cinder-quobyte-e3763c06-0a1a-4200-a1ff-f9aa8e7ea7a2" acquired by "delete_volume" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:06:19 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f86d2a-436b-4318-979c-2733ec70f821]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:06:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00235f9e-712d-4b91-be6b-64555267fd99 tempest-CreateVolumesFromImageTest-1278365810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e3763c06-0a1a-4200-a1ff-f9aa8e7ea7a2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:19 devstack sudo[107195]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_95bd6a1e-5e6e-4592-a71e-b8530542c810_vy06uawidevstack@QuobyteHD" returned: 0 in 0.375s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_95bd6a1e-5e6e-4592-a71e-b8530542c810_vy06uawidevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:19 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-51e2ce8a-fe7b-470d-a98b-3889673721ad tempest-CreateVolumesFromSnapshotTest-1799284639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e.a2f5cc6f-c397-49b6-a7ea-67bb624d70df" returned: 0 in 0.360s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:19 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-51e2ce8a-fe7b-470d-a98b-3889673721ad tempest-CreateVolumesFromSnapshotTest-1799284639 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e.a2f5cc6f-c397-49b6-a7ea-67bb624d70df is being set with open permissions: ugo+rw Sep 28 12:06:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-51e2ce8a-fe7b-470d-a98b-3889673721ad tempest-CreateVolumesFromSnapshotTest-1799284639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e.a2f5cc6f-c397-49b6-a7ea-67bb624d70df {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:19 devstack sudo[107206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e.a2f5cc6f-c397-49b6-a7ea-67bb624d70df Sep 28 12:06:19 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:19 devstack sudo[107201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e3763c06-0a1a-4200-a1ff-f9aa8e7ea7a2 Sep 28 12:06:19 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:19 devstack sudo[107205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_95bd6a1e-5e6e-4592-a71e-b8530542c810_vy06uawidevstack@QuobyteHD Sep 28 12:06:19 devstack sudo[107205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:19 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-51e2ce8a-fe7b-470d-a98b-3889673721ad tempest-CreateVolumesFromSnapshotTest-1799284639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e.a2f5cc6f-c397-49b6-a7ea-67bb624d70df" returned: 0 in 0.305s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:19 devstack sudo[107205]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_95bd6a1e-5e6e-4592-a71e-b8530542c810_vy06uawidevstack@QuobyteHD" returned: 1 in 0.368s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_95bd6a1e-5e6e-4592-a71e-b8530542c810_vy06uawidevstack@QuobyteHD' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:06:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-51e2ce8a-fe7b-470d-a98b-3889673721ad tempest-CreateVolumesFromSnapshotTest-1799284639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:19 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00235f9e-712d-4b91-be6b-64555267fd99 tempest-CreateVolumesFromImageTest-1278365810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e3763c06-0a1a-4200-a1ff-f9aa8e7ea7a2" returned: 0 in 0.442s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00235f9e-712d-4b91-be6b-64555267fd99 tempest-CreateVolumesFromImageTest-1278365810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e3763c06-0a1a-4200-a1ff-f9aa8e7ea7a2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:19 devstack sudo[107217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e.info Sep 28 12:06:19 devstack sudo[107217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:19 devstack sudo[107218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e3763c06-0a1a-4200-a1ff-f9aa8e7ea7a2 Sep 28 12:06:19 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:20 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00235f9e-712d-4b91-be6b-64555267fd99 tempest-CreateVolumesFromImageTest-1278365810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e3763c06-0a1a-4200-a1ff-f9aa8e7ea7a2" returned: 0 in 0.272s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:20 devstack sudo[107217]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-51e2ce8a-fe7b-470d-a98b-3889673721ad tempest-CreateVolumesFromSnapshotTest-1799284639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e.info" returned: 0 in 0.295s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:20 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-51e2ce8a-fe7b-470d-a98b-3889673721ad tempest-CreateVolumesFromSnapshotTest-1799284639 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e.info is being set with open permissions: ugo+rw Sep 28 12:06:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-51e2ce8a-fe7b-470d-a98b-3889673721ad tempest-CreateVolumesFromSnapshotTest-1799284639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-00235f9e-712d-4b91-be6b-64555267fd99 tempest-CreateVolumesFromImageTest-1278365810 None] Lock "cinder-quobyte-e3763c06-0a1a-4200-a1ff-f9aa8e7ea7a2" released by "delete_volume" :: held 0.776s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:06:20 devstack sudo[107223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e.info Sep 28 12:06:20 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:20 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-00235f9e-712d-4b91-be6b-64555267fd99 tempest-CreateVolumesFromImageTest-1278365810 None] Created reservations ['647824d8-f62b-403d-89f0-14766f1f3983', '2fb5a67f-b6a3-42ca-bdc7-f8956f4a407b', 'd3e63e66-a37b-4ef3-8dd4-3a09164feef2', 'a0ca3441-b9a2-4e72-bfda-73b36a63d8ce'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:06:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00235f9e-712d-4b91-be6b-64555267fd99 tempest-CreateVolumesFromImageTest-1278365810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00235f9e-712d-4b91-be6b-64555267fd99 tempest-CreateVolumesFromImageTest-1278365810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00235f9e-712d-4b91-be6b-64555267fd99 tempest-CreateVolumesFromImageTest-1278365810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:06:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00235f9e-712d-4b91-be6b-64555267fd99 tempest-CreateVolumesFromImageTest-1278365810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:06:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00235f9e-712d-4b91-be6b-64555267fd99 tempest-CreateVolumesFromImageTest-1278365810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00235f9e-712d-4b91-be6b-64555267fd99 tempest-CreateVolumesFromImageTest-1278365810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:20 devstack sudo[107225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:06:20 devstack sudo[107225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:20 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-51e2ce8a-fe7b-470d-a98b-3889673721ad tempest-CreateVolumesFromSnapshotTest-1799284639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e.info" returned: 0 in 0.288s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-51e2ce8a-fe7b-470d-a98b-3889673721ad tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.320s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2b24aa54-224c-41e2-ab2f-9537cfec5ee5 tempest-ProjectMemberTests-1312558137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.709s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2b24aa54-224c-41e2-ab2f-9537cfec5ee5 tempest-ProjectMemberTests-1312558137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:06:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1327708520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cf94d6a-7beb-4cdf-92ed-76f753c469b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba606417eb184510b6154fa1a28dce16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:06:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:06:19Z,use_quota=True,user_id='bb30da770afa465f8162e7779a473226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:06:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-2b24aa54-224c-41e2-ab2f-9537cfec5ee5 tempest-ProjectMemberTests-1312558137 None] Creating volume 4cf94d6a-7beb-4cdf-92ed-76f753c469b4 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:06:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2b24aa54-224c-41e2-ab2f-9537cfec5ee5 tempest-ProjectMemberTests-1312558137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2b24aa54-224c-41e2-ab2f-9537cfec5ee5 tempest-ProjectMemberTests-1312558137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2b24aa54-224c-41e2-ab2f-9537cfec5ee5 tempest-ProjectMemberTests-1312558137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:06:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2b24aa54-224c-41e2-ab2f-9537cfec5ee5 tempest-ProjectMemberTests-1312558137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:06:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2b24aa54-224c-41e2-ab2f-9537cfec5ee5 tempest-ProjectMemberTests-1312558137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2b24aa54-224c-41e2-ab2f-9537cfec5ee5 tempest-ProjectMemberTests-1312558137 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:06:20 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-2b24aa54-224c-41e2-ab2f-9537cfec5ee5 tempest-ProjectMemberTests-1312558137 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:06:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2b24aa54-224c-41e2-ab2f-9537cfec5ee5 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4cf94d6a-7beb-4cdf-92ed-76f753c469b4 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-891334fe-4896-4e06-8ac8-36babd5a41aa tempest-CreateVolumesFromImageTest-1278365810 None] Acquiring lock "cinder-2483b8f4-fdbb-45ac-b54f-8f7ffa85febf-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:06:20 devstack sudo[107229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4cf94d6a-7beb-4cdf-92ed-76f753c469b4 1073741824 Sep 28 12:06:20 devstack sudo[107229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-891334fe-4896-4e06-8ac8-36babd5a41aa tempest-CreateVolumesFromImageTest-1278365810 None] Lock "cinder-2483b8f4-fdbb-45ac-b54f-8f7ffa85febf-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:06:20 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-51e2ce8a-fe7b-470d-a98b-3889673721ad tempest-CreateVolumesFromSnapshotTest-1799284639 None] Create snapshot completed successfully Sep 28 12:06:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-891334fe-4896-4e06-8ac8-36babd5a41aa tempest-CreateVolumesFromImageTest-1278365810 None] Acquiring lock "cinder-quobyte-2483b8f4-fdbb-45ac-b54f-8f7ffa85febf" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:06:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-891334fe-4896-4e06-8ac8-36babd5a41aa tempest-CreateVolumesFromImageTest-1278365810 None] Lock "cinder-quobyte-2483b8f4-fdbb-45ac-b54f-8f7ffa85febf" acquired by "delete_volume" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:06:20 devstack sudo[107225]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00235f9e-712d-4b91-be6b-64555267fd99 tempest-CreateVolumesFromImageTest-1278365810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.313s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:20 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-00235f9e-712d-4b91-be6b-64555267fd99 tempest-CreateVolumesFromImageTest-1278365810 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:06:20 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-00235f9e-712d-4b91-be6b-64555267fd99 tempest-CreateVolumesFromImageTest-1278365810 None] Deleted volume successfully. Sep 28 12:06:20 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ebe2afb-7b31-4463-92cf-d486dc3071c9]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:06:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-891334fe-4896-4e06-8ac8-36babd5a41aa tempest-CreateVolumesFromImageTest-1278365810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2483b8f4-fdbb-45ac-b54f-8f7ffa85febf {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-00235f9e-712d-4b91-be6b-64555267fd99 tempest-CreateVolumesFromImageTest-1278365810 None] Lock "cinder-e3763c06-0a1a-4200-a1ff-f9aa8e7ea7a2-delete_volume" released by "delete_volume" :: held 1.345s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:06:20 devstack sudo[107232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2483b8f4-fdbb-45ac-b54f-8f7ffa85febf Sep 28 12:06:20 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:20 devstack sudo[107229]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2b24aa54-224c-41e2-ab2f-9537cfec5ee5 tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4cf94d6a-7beb-4cdf-92ed-76f753c469b4 1073741824" returned: 0 in 0.526s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2b24aa54-224c-41e2-ab2f-9537cfec5ee5 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4cf94d6a-7beb-4cdf-92ed-76f753c469b4 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:21 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-891334fe-4896-4e06-8ac8-36babd5a41aa tempest-CreateVolumesFromImageTest-1278365810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2483b8f4-fdbb-45ac-b54f-8f7ffa85febf" returned: 0 in 0.420s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-891334fe-4896-4e06-8ac8-36babd5a41aa tempest-CreateVolumesFromImageTest-1278365810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2483b8f4-fdbb-45ac-b54f-8f7ffa85febf {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:21 devstack sudo[107240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4cf94d6a-7beb-4cdf-92ed-76f753c469b4 Sep 28 12:06:21 devstack sudo[107240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:21 devstack sudo[107242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2483b8f4-fdbb-45ac-b54f-8f7ffa85febf Sep 28 12:06:21 devstack sudo[107242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:21 devstack sudo[107242]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-891334fe-4896-4e06-8ac8-36babd5a41aa tempest-CreateVolumesFromImageTest-1278365810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2483b8f4-fdbb-45ac-b54f-8f7ffa85febf" returned: 0 in 0.255s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:21 devstack sudo[107240]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2b24aa54-224c-41e2-ab2f-9537cfec5ee5 tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4cf94d6a-7beb-4cdf-92ed-76f753c469b4" returned: 0 in 0.290s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2b24aa54-224c-41e2-ab2f-9537cfec5ee5 tempest-ProjectMemberTests-1312558137 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:06:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2b24aa54-224c-41e2-ab2f-9537cfec5ee5 tempest-ProjectMemberTests-1312558137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-891334fe-4896-4e06-8ac8-36babd5a41aa tempest-CreateVolumesFromImageTest-1278365810 None] Lock "cinder-quobyte-2483b8f4-fdbb-45ac-b54f-8f7ffa85febf" released by "delete_volume" :: held 0.750s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:06:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.509s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:06:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=437d0068-b3f5-405e-9284-30fcb790b60a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1185589cbe31440eb6c30f2196135636',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:06:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:06:18Z,use_quota=True,user_id='caaf8cc5008d4da889944db8a9c95809',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ffb1672e-e272-4c5c-bd71-c1362054c964),volume_type_id=ffb1672e-e272-4c5c-bd71-c1362054c964)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:06:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Creating volume 437d0068-b3f5-405e-9284-30fcb790b60a {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:06:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:06:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:06:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:06:21 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:06:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-437d0068-b3f5-405e-9284-30fcb790b60a 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2b24aa54-224c-41e2-ab2f-9537cfec5ee5 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b0d2772-af0f-459c-ab90-7f723b6ef62f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cf94d6a-7beb-4cdf-92ed-76f753c469b4', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2b24aa54-224c-41e2-ab2f-9537cfec5ee5 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81f5aac1-cd93-41b9-b984-0fc0ff964243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:21 devstack sudo[107246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-437d0068-b3f5-405e-9284-30fcb790b60a 1073741824 Sep 28 12:06:21 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:21 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-2b24aa54-224c-41e2-ab2f-9537cfec5ee5 tempest-ProjectMemberTests-1312558137 None] Volume volume-4cf94d6a-7beb-4cdf-92ed-76f753c469b4 (4cf94d6a-7beb-4cdf-92ed-76f753c469b4): created successfully Sep 28 12:06:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2b24aa54-224c-41e2-ab2f-9537cfec5ee5 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81f5aac1-cd93-41b9-b984-0fc0ff964243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2b24aa54-224c-41e2-ab2f-9537cfec5ee5 tempest-ProjectMemberTests-1312558137 None] Flow 'volume_create_manager' (2c953355-9377-4189-b0dc-6fcb25128fc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:06:21 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-2b24aa54-224c-41e2-ab2f-9537cfec5ee5 tempest-ProjectMemberTests-1312558137 None] Created volume successfully. Sep 28 12:06:21 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-891334fe-4896-4e06-8ac8-36babd5a41aa tempest-CreateVolumesFromImageTest-1278365810 None] Created reservations ['eaecee12-1bc0-4ac6-8c37-ae88ea48786f', 'd0f38d66-b495-495b-a1e3-17cb07d090c9', '17395786-5914-4ab0-90af-b1438745ad42', '2fa678b3-b60f-421c-a966-716634870b5c'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:06:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-891334fe-4896-4e06-8ac8-36babd5a41aa tempest-CreateVolumesFromImageTest-1278365810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-891334fe-4896-4e06-8ac8-36babd5a41aa tempest-CreateVolumesFromImageTest-1278365810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-891334fe-4896-4e06-8ac8-36babd5a41aa tempest-CreateVolumesFromImageTest-1278365810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:06:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-891334fe-4896-4e06-8ac8-36babd5a41aa tempest-CreateVolumesFromImageTest-1278365810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:06:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-891334fe-4896-4e06-8ac8-36babd5a41aa tempest-CreateVolumesFromImageTest-1278365810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-891334fe-4896-4e06-8ac8-36babd5a41aa tempest-CreateVolumesFromImageTest-1278365810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:21 devstack sudo[107248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:06:21 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-33ac5fa2-d0a2-46f1-9102-8d4a8cc1d476 tempest-CreateVolumesFromImageTest-1278365810 None] Acquiring lock "cinder-fadfa7e1-758d-497e-bc2a-fac769e4c7b6-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:06:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-33ac5fa2-d0a2-46f1-9102-8d4a8cc1d476 tempest-CreateVolumesFromImageTest-1278365810 None] Lock "cinder-fadfa7e1-758d-497e-bc2a-fac769e4c7b6-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:06:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-33ac5fa2-d0a2-46f1-9102-8d4a8cc1d476 tempest-CreateVolumesFromImageTest-1278365810 None] Acquiring lock "cinder-quobyte-fadfa7e1-758d-497e-bc2a-fac769e4c7b6" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:06:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-33ac5fa2-d0a2-46f1-9102-8d4a8cc1d476 tempest-CreateVolumesFromImageTest-1278365810 None] Lock "cinder-quobyte-fadfa7e1-758d-497e-bc2a-fac769e4c7b6" acquired by "delete_volume" :: waited 0.032s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:06:21 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a1b3ec-aa90-4a97-aab4-d020e02ba142]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:06:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-33ac5fa2-d0a2-46f1-9102-8d4a8cc1d476 tempest-CreateVolumesFromImageTest-1278365810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-fadfa7e1-758d-497e-bc2a-fac769e4c7b6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:21 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-891334fe-4896-4e06-8ac8-36babd5a41aa tempest-CreateVolumesFromImageTest-1278365810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.429s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:21 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-891334fe-4896-4e06-8ac8-36babd5a41aa tempest-CreateVolumesFromImageTest-1278365810 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:06:21 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-891334fe-4896-4e06-8ac8-36babd5a41aa tempest-CreateVolumesFromImageTest-1278365810 None] Deleted volume successfully. Sep 28 12:06:21 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fd840b1-ba0c-4309-92c9-4784ba6912eb tempest-CreateVolumesFromSnapshotTest-1799284639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:06:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4fd840b1-ba0c-4309-92c9-4784ba6912eb tempest-CreateVolumesFromSnapshotTest-1799284639 None] Flow 'volume_create_manager' (05ba05ca-654a-4358-a33e-c7b581fd859a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:06:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4fd840b1-ba0c-4309-92c9-4784ba6912eb tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1fbf7ed-0849-4211-8b38-fc55c31044f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:21 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-437d0068-b3f5-405e-9284-30fcb790b60a 1073741824" returned: 0 in 0.702s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4fd840b1-ba0c-4309-92c9-4784ba6912eb tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1fbf7ed-0849-4211-8b38-fc55c31044f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:06:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1696322822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b406d0c7-be83-4a5b-bf4c-1f17cd291b1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec95a230f7ef4894b205462f8a9a17c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:06:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:06:22Z,use_quota=True,user_id='42fad2f83c79410abd63e30982c043ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4fd840b1-ba0c-4309-92c9-4784ba6912eb tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b48a636-a9e6-4c0d-b514-4200398d9745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4fd840b1-ba0c-4309-92c9-4784ba6912eb tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b48a636-a9e6-4c0d-b514-4200398d9745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:22 devstack sudo[107255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-fadfa7e1-758d-497e-bc2a-fac769e4c7b6 Sep 28 12:06:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4fd840b1-ba0c-4309-92c9-4784ba6912eb tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (653276f2-1888-40ea-a608-a7a8e442bc34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:22 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4fd840b1-ba0c-4309-92c9-4784ba6912eb tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (653276f2-1888-40ea-a608-a7a8e442bc34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b406d0c7-be83-4a5b-bf4c-1f17cd291b1a', 'volume_name': 'volume-b406d0c7-be83-4a5b-bf4c-1f17cd291b1a', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4fd840b1-ba0c-4309-92c9-4784ba6912eb tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86485acc-f8f3-47ec-b398-1a47d00ac107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4fd840b1-ba0c-4309-92c9-4784ba6912eb tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86485acc-f8f3-47ec-b398-1a47d00ac107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4fd840b1-ba0c-4309-92c9-4784ba6912eb tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b5574b2-3c93-461f-9f8c-1f6cf716c016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:22 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-4fd840b1-ba0c-4309-92c9-4784ba6912eb tempest-CreateVolumesFromSnapshotTest-1799284639 None] Volume b406d0c7-be83-4a5b-bf4c-1f17cd291b1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b406d0c7-be83-4a5b-bf4c-1f17cd291b1a', 'volume_size': 1} Sep 28 12:06:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4fd840b1-ba0c-4309-92c9-4784ba6912eb tempest-CreateVolumesFromSnapshotTest-1799284639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-891334fe-4896-4e06-8ac8-36babd5a41aa tempest-CreateVolumesFromImageTest-1278365810 None] Lock "cinder-2483b8f4-fdbb-45ac-b54f-8f7ffa85febf-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:06:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-437d0068-b3f5-405e-9284-30fcb790b60a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:22 devstack sudo[107257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-437d0068-b3f5-405e-9284-30fcb790b60a Sep 28 12:06:22 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:22 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-33ac5fa2-d0a2-46f1-9102-8d4a8cc1d476 tempest-CreateVolumesFromImageTest-1278365810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-fadfa7e1-758d-497e-bc2a-fac769e4c7b6" returned: 0 in 0.632s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-33ac5fa2-d0a2-46f1-9102-8d4a8cc1d476 tempest-CreateVolumesFromImageTest-1278365810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-fadfa7e1-758d-497e-bc2a-fac769e4c7b6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:22 devstack sudo[107263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-fadfa7e1-758d-497e-bc2a-fac769e4c7b6 Sep 28 12:06:22 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:22 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-437d0068-b3f5-405e-9284-30fcb790b60a" returned: 0 in 0.382s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] <== create_volume: return (1228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:06:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.231s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4fd840b1-ba0c-4309-92c9-4784ba6912eb tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.445s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4fd840b1-ba0c-4309-92c9-4784ba6912eb tempest-CreateVolumesFromSnapshotTest-1799284639 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:06:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1696322822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b406d0c7-be83-4a5b-bf4c-1f17cd291b1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec95a230f7ef4894b205462f8a9a17c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:06:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:06:22Z,use_quota=True,user_id='42fad2f83c79410abd63e30982c043ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:06:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-4fd840b1-ba0c-4309-92c9-4784ba6912eb tempest-CreateVolumesFromSnapshotTest-1799284639 None] Creating volume b406d0c7-be83-4a5b-bf4c-1f17cd291b1a {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:06:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4fd840b1-ba0c-4309-92c9-4784ba6912eb tempest-CreateVolumesFromSnapshotTest-1799284639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4fd840b1-ba0c-4309-92c9-4784ba6912eb tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4fd840b1-ba0c-4309-92c9-4784ba6912eb tempest-CreateVolumesFromSnapshotTest-1799284639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:06:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4fd840b1-ba0c-4309-92c9-4784ba6912eb tempest-CreateVolumesFromSnapshotTest-1799284639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:06:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4fd840b1-ba0c-4309-92c9-4784ba6912eb tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4fd840b1-ba0c-4309-92c9-4784ba6912eb tempest-CreateVolumesFromSnapshotTest-1799284639 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:06:22 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-4fd840b1-ba0c-4309-92c9-4784ba6912eb tempest-CreateVolumesFromSnapshotTest-1799284639 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:06:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4fd840b1-ba0c-4309-92c9-4784ba6912eb tempest-CreateVolumesFromSnapshotTest-1799284639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b406d0c7-be83-4a5b-bf4c-1f17cd291b1a 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:22 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b406d0c7-be83-4a5b-bf4c-1f17cd291b1a 1073741824 Sep 28 12:06:22 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:22 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Attempting download of 95bd6a1e-5e6e-4592-a71e-b8530542c810 ((None, [{'url': 'file:///opt/stack/data/glance/images/95bd6a1e-5e6e-4592-a71e-b8530542c810', 'metadata': {}}])) to volume 437d0068-b3f5-405e-9284-30fcb790b60a. {{(pid=86916) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 12:06:22 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[135ac35f-ab41-426a-b2b4-4cf533383c48]: (4, 'raw') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:06:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_95bd6a1e-5e6e-4592-a71e-b8530542c810_fgul9lpk {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:22 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-4406b902-db1e-4f60-b5df-efb62dc3a9b3 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:06:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4406b902-db1e-4f60-b5df-efb62dc3a9b3 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Flow 'volume_create_manager' (73aeb467-06a9-49b1-a288-bb09b4a53e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:06:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4406b902-db1e-4f60-b5df-efb62dc3a9b3 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38bb209c-93b0-478c-b1a6-2db9a5159ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:22 devstack sudo[107267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_95bd6a1e-5e6e-4592-a71e-b8530542c810_fgul9lpk Sep 28 12:06:22 devstack sudo[107267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4406b902-db1e-4f60-b5df-efb62dc3a9b3 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38bb209c-93b0-478c-b1a6-2db9a5159ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:06:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-604436668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b64e70c3-79bf-4f35-9d9f-586472bc0f08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec95a230f7ef4894b205462f8a9a17c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:06:23Z,use_quota=True,user_id='42fad2f83c79410abd63e30982c043ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4406b902-db1e-4f60-b5df-efb62dc3a9b3 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c33cc983-2f23-454b-af28-c851b9711539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4406b902-db1e-4f60-b5df-efb62dc3a9b3 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c33cc983-2f23-454b-af28-c851b9711539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4406b902-db1e-4f60-b5df-efb62dc3a9b3 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60e7336a-ec84-44da-b9d9-b2ecf4eb9c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4406b902-db1e-4f60-b5df-efb62dc3a9b3 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60e7336a-ec84-44da-b9d9-b2ecf4eb9c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b64e70c3-79bf-4f35-9d9f-586472bc0f08', 'volume_name': 'volume-b64e70c3-79bf-4f35-9d9f-586472bc0f08', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:22 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4406b902-db1e-4f60-b5df-efb62dc3a9b3 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac08f9cb-613c-4d7b-9e3b-f3d239ccc4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4406b902-db1e-4f60-b5df-efb62dc3a9b3 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac08f9cb-613c-4d7b-9e3b-f3d239ccc4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4406b902-db1e-4f60-b5df-efb62dc3a9b3 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50cb0031-2f46-473b-9a81-98de6e04eee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:23 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-4406b902-db1e-4f60-b5df-efb62dc3a9b3 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Volume b64e70c3-79bf-4f35-9d9f-586472bc0f08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b64e70c3-79bf-4f35-9d9f-586472bc0f08', 'volume_size': 1} Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4406b902-db1e-4f60-b5df-efb62dc3a9b3 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4ade5bde-9fea-4dc2-919d-c5ef5bb079e9 tempest-ProjectMemberTests-1312558137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-33ac5fa2-d0a2-46f1-9102-8d4a8cc1d476 tempest-CreateVolumesFromImageTest-1278365810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-fadfa7e1-758d-497e-bc2a-fac769e4c7b6" returned: 0 in 0.547s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-33ac5fa2-d0a2-46f1-9102-8d4a8cc1d476 tempest-CreateVolumesFromImageTest-1278365810 None] Lock "cinder-quobyte-fadfa7e1-758d-497e-bc2a-fac769e4c7b6" released by "delete_volume" :: held 1.250s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:06:23 devstack sudo[107267]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_95bd6a1e-5e6e-4592-a71e-b8530542c810_fgul9lpk" returned: 0 in 0.432s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_95bd6a1e-5e6e-4592-a71e-b8530542c810_fgul9lpk {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-33ac5fa2-d0a2-46f1-9102-8d4a8cc1d476 tempest-CreateVolumesFromImageTest-1278365810 None] Created reservations ['428e04a9-9364-4f9e-ba97-bccd948228ca', 'c1d398dd-bc50-46f5-bf6a-f715fca712fa', 'b6539b69-cea7-495f-94eb-ccf4aca2a452', '1cfb398f-c495-4f75-8aa8-6f52f48a7e8b'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-c90d0bf6-af74-4386-ba9f-ef4ebda2bd26 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c90d0bf6-af74-4386-ba9f-ef4ebda2bd26 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Flow 'volume_create_manager' (80190c4d-7d26-4fd6-a9ca-6e555cb1e95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c90d0bf6-af74-4386-ba9f-ef4ebda2bd26 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53f79127-ecb2-49eb-9b59-880cea6fb7f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:23 devstack sudo[107276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_95bd6a1e-5e6e-4592-a71e-b8530542c810_fgul9lpk Sep 28 12:06:23 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:23 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4fd840b1-ba0c-4309-92c9-4784ba6912eb tempest-CreateVolumesFromSnapshotTest-1799284639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b406d0c7-be83-4a5b-bf4c-1f17cd291b1a 1073741824" returned: 0 in 0.730s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c90d0bf6-af74-4386-ba9f-ef4ebda2bd26 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53f79127-ecb2-49eb-9b59-880cea6fb7f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:06:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-446918777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15e460c3-4fc8-477f-a58d-8732532776a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec95a230f7ef4894b205462f8a9a17c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:06:23Z,use_quota=True,user_id='42fad2f83c79410abd63e30982c043ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c90d0bf6-af74-4386-ba9f-ef4ebda2bd26 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac6e637a-db9f-4b1a-a23b-8245d6f5e87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c90d0bf6-af74-4386-ba9f-ef4ebda2bd26 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac6e637a-db9f-4b1a-a23b-8245d6f5e87f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c90d0bf6-af74-4386-ba9f-ef4ebda2bd26 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36128d66-e5fc-4ba5-9802-2af4ad367fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c90d0bf6-af74-4386-ba9f-ef4ebda2bd26 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36128d66-e5fc-4ba5-9802-2af4ad367fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15e460c3-4fc8-477f-a58d-8732532776a0', 'volume_name': 'volume-15e460c3-4fc8-477f-a58d-8732532776a0', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c90d0bf6-af74-4386-ba9f-ef4ebda2bd26 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38ec1997-9351-4365-9310-8cbfdcfcd627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c90d0bf6-af74-4386-ba9f-ef4ebda2bd26 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38ec1997-9351-4365-9310-8cbfdcfcd627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c90d0bf6-af74-4386-ba9f-ef4ebda2bd26 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48cdd68b-70e6-4c93-a2a4-ead7841dd78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:23 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-c90d0bf6-af74-4386-ba9f-ef4ebda2bd26 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Volume 15e460c3-4fc8-477f-a58d-8732532776a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15e460c3-4fc8-477f-a58d-8732532776a0', 'volume_size': 1} Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c90d0bf6-af74-4386-ba9f-ef4ebda2bd26 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-33ac5fa2-d0a2-46f1-9102-8d4a8cc1d476 tempest-CreateVolumesFromImageTest-1278365810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-33ac5fa2-d0a2-46f1-9102-8d4a8cc1d476 tempest-CreateVolumesFromImageTest-1278365810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-33ac5fa2-d0a2-46f1-9102-8d4a8cc1d476 tempest-CreateVolumesFromImageTest-1278365810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-33ac5fa2-d0a2-46f1-9102-8d4a8cc1d476 tempest-CreateVolumesFromImageTest-1278365810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-33ac5fa2-d0a2-46f1-9102-8d4a8cc1d476 tempest-CreateVolumesFromImageTest-1278365810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-33ac5fa2-d0a2-46f1-9102-8d4a8cc1d476 tempest-CreateVolumesFromImageTest-1278365810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:23 devstack sudo[107278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4fd840b1-ba0c-4309-92c9-4784ba6912eb tempest-CreateVolumesFromSnapshotTest-1799284639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b406d0c7-be83-4a5b-bf4c-1f17cd291b1a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:23 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:23 devstack sudo[107280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b406d0c7-be83-4a5b-bf4c-1f17cd291b1a Sep 28 12:06:23 devstack sudo[107280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:23 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_95bd6a1e-5e6e-4592-a71e-b8530542c810_fgul9lpk" returned: 1 in 0.444s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_95bd6a1e-5e6e-4592-a71e-b8530542c810_fgul9lpk' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a0a73f-0db0-4cff-a720-daace567e2c4]: (4, 'raw') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_95bd6a1e-5e6e-4592-a71e-b8530542c810_vy06uawidevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:23 devstack sudo[107284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_95bd6a1e-5e6e-4592-a71e-b8530542c810_vy06uawidevstack@QuobyteHD Sep 28 12:06:23 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-68fc6aa7-07e3-49b2-9766-51facda9cf5d tempest-CreateVolumesFromSnapshotTest-1799284639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-68fc6aa7-07e3-49b2-9766-51facda9cf5d tempest-CreateVolumesFromSnapshotTest-1799284639 None] Flow 'volume_create_manager' (d5b08e63-adcc-4599-b86c-61b9fbc81e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:06:23 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-68fc6aa7-07e3-49b2-9766-51facda9cf5d tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (905bbef9-a4f1-4831-b391-429cb2b147be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-33ac5fa2-d0a2-46f1-9102-8d4a8cc1d476 tempest-CreateVolumesFromImageTest-1278365810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.411s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-33ac5fa2-d0a2-46f1-9102-8d4a8cc1d476 tempest-CreateVolumesFromImageTest-1278365810 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:06:23 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-33ac5fa2-d0a2-46f1-9102-8d4a8cc1d476 tempest-CreateVolumesFromImageTest-1278365810 None] Deleted volume successfully. Sep 28 12:06:23 devstack sudo[107280]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-68fc6aa7-07e3-49b2-9766-51facda9cf5d tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (905bbef9-a4f1-4831-b391-429cb2b147be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:06:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-443814020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61c9da72-d102-40bb-b2ff-666ef675c19c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec95a230f7ef4894b205462f8a9a17c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:06:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:06:24Z,use_quota=True,user_id='42fad2f83c79410abd63e30982c043ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-68fc6aa7-07e3-49b2-9766-51facda9cf5d tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0aa7e359-8bf9-4811-b63a-9f8892daa103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-68fc6aa7-07e3-49b2-9766-51facda9cf5d tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0aa7e359-8bf9-4811-b63a-9f8892daa103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-68fc6aa7-07e3-49b2-9766-51facda9cf5d tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d24a02e3-e397-4873-a3c5-7872c9cd6152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-68fc6aa7-07e3-49b2-9766-51facda9cf5d tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d24a02e3-e397-4873-a3c5-7872c9cd6152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61c9da72-d102-40bb-b2ff-666ef675c19c', 'volume_name': 'volume-61c9da72-d102-40bb-b2ff-666ef675c19c', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-68fc6aa7-07e3-49b2-9766-51facda9cf5d tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d949792-0689-4a30-b821-afda274d23b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-68fc6aa7-07e3-49b2-9766-51facda9cf5d tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d949792-0689-4a30-b821-afda274d23b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-68fc6aa7-07e3-49b2-9766-51facda9cf5d tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acbcf00a-7fda-45a8-af09-5cec8c187561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:23 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-68fc6aa7-07e3-49b2-9766-51facda9cf5d tempest-CreateVolumesFromSnapshotTest-1799284639 None] Volume 61c9da72-d102-40bb-b2ff-666ef675c19c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61c9da72-d102-40bb-b2ff-666ef675c19c', 'volume_size': 1} Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-68fc6aa7-07e3-49b2-9766-51facda9cf5d tempest-CreateVolumesFromSnapshotTest-1799284639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4fd840b1-ba0c-4309-92c9-4784ba6912eb tempest-CreateVolumesFromSnapshotTest-1799284639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b406d0c7-be83-4a5b-bf4c-1f17cd291b1a" returned: 0 in 0.445s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4fd840b1-ba0c-4309-92c9-4784ba6912eb tempest-CreateVolumesFromSnapshotTest-1799284639 None] <== create_volume: return (1296ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4fd840b1-ba0c-4309-92c9-4784ba6912eb tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.299s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4406b902-db1e-4f60-b5df-efb62dc3a9b3 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.831s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4406b902-db1e-4f60-b5df-efb62dc3a9b3 tempest-CreateVolumesFromSnapshotTest-1799284639 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:06:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-604436668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b64e70c3-79bf-4f35-9d9f-586472bc0f08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec95a230f7ef4894b205462f8a9a17c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:06:23Z,use_quota=True,user_id='42fad2f83c79410abd63e30982c043ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-4406b902-db1e-4f60-b5df-efb62dc3a9b3 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Creating volume b64e70c3-79bf-4f35-9d9f-586472bc0f08 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4406b902-db1e-4f60-b5df-efb62dc3a9b3 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4406b902-db1e-4f60-b5df-efb62dc3a9b3 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4406b902-db1e-4f60-b5df-efb62dc3a9b3 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4406b902-db1e-4f60-b5df-efb62dc3a9b3 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4406b902-db1e-4f60-b5df-efb62dc3a9b3 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4406b902-db1e-4f60-b5df-efb62dc3a9b3 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:06:23 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-4406b902-db1e-4f60-b5df-efb62dc3a9b3 tempest-CreateVolumesFromSnapshotTest-1799284639 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4406b902-db1e-4f60-b5df-efb62dc3a9b3 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b64e70c3-79bf-4f35-9d9f-586472bc0f08 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4fd840b1-ba0c-4309-92c9-4784ba6912eb tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b5574b2-3c93-461f-9f8c-1f6cf716c016) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b406d0c7-be83-4a5b-bf4c-1f17cd291b1a', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4fd840b1-ba0c-4309-92c9-4784ba6912eb tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (053b00c3-dbb4-4cd9-897e-84a17641200a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-33ac5fa2-d0a2-46f1-9102-8d4a8cc1d476 tempest-CreateVolumesFromImageTest-1278365810 None] Lock "cinder-fadfa7e1-758d-497e-bc2a-fac769e4c7b6-delete_volume" released by "delete_volume" :: held 2.231s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:06:23 devstack sudo[107288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b64e70c3-79bf-4f35-9d9f-586472bc0f08 1073741824 Sep 28 12:06:23 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:23 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-4fd840b1-ba0c-4309-92c9-4784ba6912eb tempest-CreateVolumesFromSnapshotTest-1799284639 None] Volume volume-b406d0c7-be83-4a5b-bf4c-1f17cd291b1a (b406d0c7-be83-4a5b-bf4c-1f17cd291b1a): created successfully Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4fd840b1-ba0c-4309-92c9-4784ba6912eb tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (053b00c3-dbb4-4cd9-897e-84a17641200a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4fd840b1-ba0c-4309-92c9-4784ba6912eb tempest-CreateVolumesFromSnapshotTest-1799284639 None] Flow 'volume_create_manager' (05ba05ca-654a-4358-a33e-c7b581fd859a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:06:23 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-4fd840b1-ba0c-4309-92c9-4784ba6912eb tempest-CreateVolumesFromSnapshotTest-1799284639 None] Created volume successfully. Sep 28 12:06:24 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_95bd6a1e-5e6e-4592-a71e-b8530542c810_vy06uawidevstack@QuobyteHD" returned: 0 in 0.568s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_95bd6a1e-5e6e-4592-a71e-b8530542c810_vy06uawidevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8fdacba6-261e-47b4-8051-e5fe6aa13cd0 tempest-CreateVolumesFromImageTest-1278365810 None] Acquiring lock "cinder-e4ccc56d-a67a-4e92-ba11-82f9e165b6b9-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:06:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8fdacba6-261e-47b4-8051-e5fe6aa13cd0 tempest-CreateVolumesFromImageTest-1278365810 None] Lock "cinder-e4ccc56d-a67a-4e92-ba11-82f9e165b6b9-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:06:24 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-40726227-1539-4de4-a957-1966f05f537c tempest-CreateVolumesFromSnapshotTest-1799284639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:06:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-40726227-1539-4de4-a957-1966f05f537c tempest-CreateVolumesFromSnapshotTest-1799284639 None] Flow 'volume_create_manager' (24a787b5-f9c3-4c19-90af-c2fef73bd589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:06:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-40726227-1539-4de4-a957-1966f05f537c tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (182d3a25-1283-4c36-b2bb-a1248e476593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:24 devstack sudo[107292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_95bd6a1e-5e6e-4592-a71e-b8530542c810_vy06uawidevstack@QuobyteHD Sep 28 12:06:24 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-40726227-1539-4de4-a957-1966f05f537c tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (182d3a25-1283-4c36-b2bb-a1248e476593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1159599379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49c64bd1-76fa-4599-bf81-26fdeb8070c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec95a230f7ef4894b205462f8a9a17c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:06:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:06:24Z,use_quota=True,user_id='42fad2f83c79410abd63e30982c043ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-40726227-1539-4de4-a957-1966f05f537c tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c80d4d1b-f9d4-45ec-88c0-93e93035ee69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-40726227-1539-4de4-a957-1966f05f537c tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c80d4d1b-f9d4-45ec-88c0-93e93035ee69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-40726227-1539-4de4-a957-1966f05f537c tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4c0b121-8b2f-4815-b275-f17182306857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-40726227-1539-4de4-a957-1966f05f537c tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4c0b121-8b2f-4815-b275-f17182306857) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49c64bd1-76fa-4599-bf81-26fdeb8070c2', 'volume_name': 'volume-49c64bd1-76fa-4599-bf81-26fdeb8070c2', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-40726227-1539-4de4-a957-1966f05f537c tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (631e5eba-ca4c-4ef5-bf47-f4af45250fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-40726227-1539-4de4-a957-1966f05f537c tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (631e5eba-ca4c-4ef5-bf47-f4af45250fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-40726227-1539-4de4-a957-1966f05f537c tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86c64ae4-9693-4424-879b-734952dd4124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:24 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-40726227-1539-4de4-a957-1966f05f537c tempest-CreateVolumesFromSnapshotTest-1799284639 None] Volume 49c64bd1-76fa-4599-bf81-26fdeb8070c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49c64bd1-76fa-4599-bf81-26fdeb8070c2', 'volume_size': 1} Sep 28 12:06:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-40726227-1539-4de4-a957-1966f05f537c tempest-CreateVolumesFromSnapshotTest-1799284639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8fdacba6-261e-47b4-8051-e5fe6aa13cd0 tempest-CreateVolumesFromImageTest-1278365810 None] Acquiring lock "cinder-quobyte-e4ccc56d-a67a-4e92-ba11-82f9e165b6b9" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:06:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8fdacba6-261e-47b4-8051-e5fe6aa13cd0 tempest-CreateVolumesFromImageTest-1278365810 None] Lock "cinder-quobyte-e4ccc56d-a67a-4e92-ba11-82f9e165b6b9" acquired by "delete_volume" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:06:24 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2fd956-4252-4b99-b74c-f4cacd5ae609]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:06:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8fdacba6-261e-47b4-8051-e5fe6aa13cd0 tempest-CreateVolumesFromImageTest-1278365810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e4ccc56d-a67a-4e92-ba11-82f9e165b6b9 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:24 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4406b902-db1e-4f60-b5df-efb62dc3a9b3 tempest-CreateVolumesFromSnapshotTest-1799284639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b64e70c3-79bf-4f35-9d9f-586472bc0f08 1073741824" returned: 0 in 0.669s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4406b902-db1e-4f60-b5df-efb62dc3a9b3 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b64e70c3-79bf-4f35-9d9f-586472bc0f08 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:24 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:24 devstack sudo[107298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e4ccc56d-a67a-4e92-ba11-82f9e165b6b9 Sep 28 12:06:24 devstack sudo[107298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_95bd6a1e-5e6e-4592-a71e-b8530542c810_vy06uawidevstack@QuobyteHD" returned: 1 in 0.447s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_95bd6a1e-5e6e-4592-a71e-b8530542c810_vy06uawidevstack@QuobyteHD' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:06:24 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] 95bd6a1e-5e6e-4592-a71e-b8530542c810 was raw, converting to qcow2 {{(pid=86916) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 12:06:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_95bd6a1e-5e6e-4592-a71e-b8530542c810_vy06uawidevstack@QuobyteHD /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-437d0068-b3f5-405e-9284-30fcb790b60a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:24 devstack sudo[107302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b64e70c3-79bf-4f35-9d9f-586472bc0f08 Sep 28 12:06:24 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:24 devstack sudo[107305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_95bd6a1e-5e6e-4592-a71e-b8530542c810_vy06uawidevstack@QuobyteHD /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-437d0068-b3f5-405e-9284-30fcb790b60a Sep 28 12:06:24 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:24 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4406b902-db1e-4f60-b5df-efb62dc3a9b3 tempest-CreateVolumesFromSnapshotTest-1799284639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b64e70c3-79bf-4f35-9d9f-586472bc0f08" returned: 0 in 0.239s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4406b902-db1e-4f60-b5df-efb62dc3a9b3 tempest-CreateVolumesFromSnapshotTest-1799284639 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:06:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4406b902-db1e-4f60-b5df-efb62dc3a9b3 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4ade5bde-9fea-4dc2-919d-c5ef5bb079e9 tempest-ProjectMemberTests-1312558137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.785s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-4ade5bde-9fea-4dc2-919d-c5ef5bb079e9 tempest-ProjectMemberTests-1312558137 None] Creating offline snapshot 0334bae9-e16e-4786-af85-ce208e58b35c of volume 4cf94d6a-7beb-4cdf-92ed-76f753c469b4 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:06:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4406b902-db1e-4f60-b5df-efb62dc3a9b3 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50cb0031-2f46-473b-9a81-98de6e04eee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b64e70c3-79bf-4f35-9d9f-586472bc0f08', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4406b902-db1e-4f60-b5df-efb62dc3a9b3 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12fa4691-92e8-493e-b417-160d60218be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:24 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f20c460-22e1-4118-9c5e-d83cd0de5943]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:06:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4ade5bde-9fea-4dc2-919d-c5ef5bb079e9 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4cf94d6a-7beb-4cdf-92ed-76f753c469b4 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:24 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-4406b902-db1e-4f60-b5df-efb62dc3a9b3 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Volume volume-b64e70c3-79bf-4f35-9d9f-586472bc0f08 (b64e70c3-79bf-4f35-9d9f-586472bc0f08): created successfully Sep 28 12:06:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4406b902-db1e-4f60-b5df-efb62dc3a9b3 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12fa4691-92e8-493e-b417-160d60218be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:24 devstack sudo[107298]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4406b902-db1e-4f60-b5df-efb62dc3a9b3 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Flow 'volume_create_manager' (73aeb467-06a9-49b1-a288-bb09b4a53e15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:06:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8fdacba6-261e-47b4-8051-e5fe6aa13cd0 tempest-CreateVolumesFromImageTest-1278365810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e4ccc56d-a67a-4e92-ba11-82f9e165b6b9" returned: 0 in 0.430s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8fdacba6-261e-47b4-8051-e5fe6aa13cd0 tempest-CreateVolumesFromImageTest-1278365810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e4ccc56d-a67a-4e92-ba11-82f9e165b6b9 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:24 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-4406b902-db1e-4f60-b5df-efb62dc3a9b3 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Created volume successfully. Sep 28 12:06:24 devstack sudo[107315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e4ccc56d-a67a-4e92-ba11-82f9e165b6b9 Sep 28 12:06:24 devstack sudo[107315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:24 devstack sudo[107313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4cf94d6a-7beb-4cdf-92ed-76f753c469b4 Sep 28 12:06:24 devstack sudo[107313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:25 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_95bd6a1e-5e6e-4592-a71e-b8530542c810_vy06uawidevstack@QuobyteHD /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-437d0068-b3f5-405e-9284-30fcb790b60a" returned: 0 in 0.514s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:25 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_95bd6a1e-5e6e-4592-a71e-b8530542c810_vy06uawidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-437d0068-b3f5-405e-9284-30fcb790b60a {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:06:25 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 12:06:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-437d0068-b3f5-405e-9284-30fcb790b60a 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:25 devstack sudo[107318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-437d0068-b3f5-405e-9284-30fcb790b60a 1G Sep 28 12:06:25 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:25 devstack sudo[107315]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8fdacba6-261e-47b4-8051-e5fe6aa13cd0 tempest-CreateVolumesFromImageTest-1278365810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e4ccc56d-a67a-4e92-ba11-82f9e165b6b9" returned: 0 in 0.295s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8fdacba6-261e-47b4-8051-e5fe6aa13cd0 tempest-CreateVolumesFromImageTest-1278365810 None] Lock "cinder-quobyte-e4ccc56d-a67a-4e92-ba11-82f9e165b6b9" released by "delete_volume" :: held 0.782s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:06:25 devstack sudo[107313]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:25 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-8fdacba6-261e-47b4-8051-e5fe6aa13cd0 tempest-CreateVolumesFromImageTest-1278365810 None] Created reservations ['307c7cb8-e6e5-42b7-b310-9530972f4606', '24bab3f6-6185-46cc-98a0-bdd9edae1f78', '27163f13-db73-4978-98c4-567ef5fdeb66', 'fc167300-bee6-4315-8ebf-28c047e62c36'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:06:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4ade5bde-9fea-4dc2-919d-c5ef5bb079e9 tempest-ProjectMemberTests-1312558137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4cf94d6a-7beb-4cdf-92ed-76f753c469b4" returned: 0 in 0.457s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4ade5bde-9fea-4dc2-919d-c5ef5bb079e9 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4cf94d6a-7beb-4cdf-92ed-76f753c469b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4cf94d6a-7beb-4cdf-92ed-76f753c469b4.0334bae9-e16e-4786-af85-ce208e58b35c 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:25 devstack sudo[107325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4cf94d6a-7beb-4cdf-92ed-76f753c469b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4cf94d6a-7beb-4cdf-92ed-76f753c469b4.0334bae9-e16e-4786-af85-ce208e58b35c 1G Sep 28 12:06:25 devstack sudo[107325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8fdacba6-261e-47b4-8051-e5fe6aa13cd0 tempest-CreateVolumesFromImageTest-1278365810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8fdacba6-261e-47b4-8051-e5fe6aa13cd0 tempest-CreateVolumesFromImageTest-1278365810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8fdacba6-261e-47b4-8051-e5fe6aa13cd0 tempest-CreateVolumesFromImageTest-1278365810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:06:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8fdacba6-261e-47b4-8051-e5fe6aa13cd0 tempest-CreateVolumesFromImageTest-1278365810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:06:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8fdacba6-261e-47b4-8051-e5fe6aa13cd0 tempest-CreateVolumesFromImageTest-1278365810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8fdacba6-261e-47b4-8051-e5fe6aa13cd0 tempest-CreateVolumesFromImageTest-1278365810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:25 devstack sudo[107330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:06:25 devstack sudo[107330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1edac2ce-53bb-4bb9-a67e-b01daf6baaef tempest-CreateVolumesFromImageTest-1278365810 None] Acquiring lock "cinder-e655a6cc-b600-4e96-99f2-b504b48ac660-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:06:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1edac2ce-53bb-4bb9-a67e-b01daf6baaef tempest-CreateVolumesFromImageTest-1278365810 None] Lock "cinder-e655a6cc-b600-4e96-99f2-b504b48ac660-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:06:25 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-437d0068-b3f5-405e-9284-30fcb790b60a 1G" returned: 0 in 0.444s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:25 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Downloaded image 95bd6a1e-5e6e-4592-a71e-b8530542c810 ((None, [{'url': 'file:///opt/stack/data/glance/images/95bd6a1e-5e6e-4592-a71e-b8530542c810', 'metadata': {}}])) to volume 437d0068-b3f5-405e-9284-30fcb790b60a successfully. {{(pid=86916) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 12:06:25 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Temporary image 95bd6a1e-5e6e-4592-a71e-b8530542c810 for user caaf8cc5008d4da889944db8a9c95809 is deleted. {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 12:06:25 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Marking volume 437d0068-b3f5-405e-9284-30fcb790b60a as bootable. {{(pid=86916) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 12:06:25 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Copying metadata from image 95bd6a1e-5e6e-4592-a71e-b8530542c810 to 437d0068-b3f5-405e-9284-30fcb790b60a. {{(pid=86916) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 12:06:25 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Creating volume glance metadata for volume 437d0068-b3f5-405e-9284-30fcb790b60a backed by image 95bd6a1e-5e6e-4592-a71e-b8530542c810 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '95bd6a1e-5e6e-4592-a71e-b8530542c810', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '54dace5069aef0aa05d82dc490e8a733', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86916) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 12:06:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1edac2ce-53bb-4bb9-a67e-b01daf6baaef tempest-CreateVolumesFromImageTest-1278365810 None] Acquiring lock "cinder-quobyte-e655a6cc-b600-4e96-99f2-b504b48ac660" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:06:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1edac2ce-53bb-4bb9-a67e-b01daf6baaef tempest-CreateVolumesFromImageTest-1278365810 None] Lock "cinder-quobyte-e655a6cc-b600-4e96-99f2-b504b48ac660" acquired by "delete_volume" :: waited 0.026s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:06:25 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc64f55-df03-4a8c-8b04-3a50bcc50480]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:06:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1edac2ce-53bb-4bb9-a67e-b01daf6baaef tempest-CreateVolumesFromImageTest-1278365810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e655a6cc-b600-4e96-99f2-b504b48ac660 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c401379-38af-43f7-8bfd-bf50e995e8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-437d0068-b3f5-405e-9284-30fcb790b60a', 'volume_size': 1, 'image_id': '95bd6a1e-5e6e-4592-a71e-b8530542c810', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/95bd6a1e-5e6e-4592-a71e-b8530542c810', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '54dace5069aef0aa05d82dc490e8a733', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1185589cbe31440eb6c30f2196135636', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7c378a03e0e616a699d7107f361ce445357f9d703e1284f54a5bc7fff0527f397c7936003c1977dd1e6ff1eca6f65d1081e5389ed593ff8f64d70a8d0cdbf723', 'id': '95bd6a1e-5e6e-4592-a71e-b8530542c810', 'created_at': datetime.datetime(2026, 9, 28, 10, 6, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 6, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/95bd6a1e-5e6e-4592-a71e-b8530542c810/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:25 devstack sudo[107330]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c229ab9a-e05a-49ea-9601-700dd3dc196a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8fdacba6-261e-47b4-8051-e5fe6aa13cd0 tempest-CreateVolumesFromImageTest-1278365810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.331s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:25 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-8fdacba6-261e-47b4-8051-e5fe6aa13cd0 tempest-CreateVolumesFromImageTest-1278365810 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:06:25 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Volume volume-437d0068-b3f5-405e-9284-30fcb790b60a (437d0068-b3f5-405e-9284-30fcb790b60a): created successfully Sep 28 12:06:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c229ab9a-e05a-49ea-9601-700dd3dc196a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Flow 'volume_create_manager' (66647723-7da8-48a9-9da7-b5a368b6da36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:06:25 devstack sudo[107335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e655a6cc-b600-4e96-99f2-b504b48ac660 Sep 28 12:06:25 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:25 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-8fdacba6-261e-47b4-8051-e5fe6aa13cd0 tempest-CreateVolumesFromImageTest-1278365810 None] Deleted volume successfully. Sep 28 12:06:25 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-1f320d26-959d-48a3-ac46-80b66f68d320 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Created volume successfully. Sep 28 12:06:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8fdacba6-261e-47b4-8051-e5fe6aa13cd0 tempest-CreateVolumesFromImageTest-1278365810 None] Lock "cinder-e4ccc56d-a67a-4e92-ba11-82f9e165b6b9-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:06:25 devstack sudo[107325]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4ade5bde-9fea-4dc2-919d-c5ef5bb079e9 tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4cf94d6a-7beb-4cdf-92ed-76f753c469b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4cf94d6a-7beb-4cdf-92ed-76f753c469b4.0334bae9-e16e-4786-af85-ce208e58b35c 1G" returned: 0 in 0.594s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4ade5bde-9fea-4dc2-919d-c5ef5bb079e9 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cf94d6a-7beb-4cdf-92ed-76f753c469b4 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4cf94d6a-7beb-4cdf-92ed-76f753c469b4.0334bae9-e16e-4786-af85-ce208e58b35c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:25 devstack sudo[107339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cf94d6a-7beb-4cdf-92ed-76f753c469b4 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4cf94d6a-7beb-4cdf-92ed-76f753c469b4.0334bae9-e16e-4786-af85-ce208e58b35c Sep 28 12:06:25 devstack sudo[107339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:26 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1edac2ce-53bb-4bb9-a67e-b01daf6baaef tempest-CreateVolumesFromImageTest-1278365810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e655a6cc-b600-4e96-99f2-b504b48ac660" returned: 0 in 0.432s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1edac2ce-53bb-4bb9-a67e-b01daf6baaef tempest-CreateVolumesFromImageTest-1278365810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e655a6cc-b600-4e96-99f2-b504b48ac660 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:26 devstack sudo[107344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e655a6cc-b600-4e96-99f2-b504b48ac660 Sep 28 12:06:26 devstack sudo[107344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:26 devstack sudo[107339]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4ade5bde-9fea-4dc2-919d-c5ef5bb079e9 tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cf94d6a-7beb-4cdf-92ed-76f753c469b4 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4cf94d6a-7beb-4cdf-92ed-76f753c469b4.0334bae9-e16e-4786-af85-ce208e58b35c" returned: 0 in 0.313s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:26 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-4ade5bde-9fea-4dc2-919d-c5ef5bb079e9 tempest-ProjectMemberTests-1312558137 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4cf94d6a-7beb-4cdf-92ed-76f753c469b4.0334bae9-e16e-4786-af85-ce208e58b35c is being set with open permissions: ugo+rw Sep 28 12:06:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4ade5bde-9fea-4dc2-919d-c5ef5bb079e9 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4cf94d6a-7beb-4cdf-92ed-76f753c469b4.0334bae9-e16e-4786-af85-ce208e58b35c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:26 devstack sudo[107349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4cf94d6a-7beb-4cdf-92ed-76f753c469b4.0334bae9-e16e-4786-af85-ce208e58b35c Sep 28 12:06:26 devstack sudo[107349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:26 devstack sudo[107344]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1edac2ce-53bb-4bb9-a67e-b01daf6baaef tempest-CreateVolumesFromImageTest-1278365810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-e655a6cc-b600-4e96-99f2-b504b48ac660" returned: 0 in 0.326s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1edac2ce-53bb-4bb9-a67e-b01daf6baaef tempest-CreateVolumesFromImageTest-1278365810 None] Lock "cinder-quobyte-e655a6cc-b600-4e96-99f2-b504b48ac660" released by "delete_volume" :: held 0.831s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:06:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-55b23243-8e55-4ec0-8b81-a35b191bc104 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Acquiring lock "cinder-437d0068-b3f5-405e-9284-30fcb790b60a-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:06:26 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-1edac2ce-53bb-4bb9-a67e-b01daf6baaef tempest-CreateVolumesFromImageTest-1278365810 None] Created reservations ['263b5e1f-9b0e-4d64-a09b-d3709b175787', '60a698fa-f760-4119-90d4-faf5b768ef60', 'c65ecc51-d250-46d9-b37f-c7fcc7d9111a', 'd6c35cdc-8733-4f14-b02d-715ede28d433'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:06:26 devstack sudo[107349]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-55b23243-8e55-4ec0-8b81-a35b191bc104 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Lock "cinder-437d0068-b3f5-405e-9284-30fcb790b60a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:06:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4ade5bde-9fea-4dc2-919d-c5ef5bb079e9 tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4cf94d6a-7beb-4cdf-92ed-76f753c469b4.0334bae9-e16e-4786-af85-ce208e58b35c" returned: 0 in 0.362s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4ade5bde-9fea-4dc2-919d-c5ef5bb079e9 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4cf94d6a-7beb-4cdf-92ed-76f753c469b4.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-55b23243-8e55-4ec0-8b81-a35b191bc104 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Acquiring lock "cinder-quobyte-437d0068-b3f5-405e-9284-30fcb790b60a" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:06:26 devstack sudo[107353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4cf94d6a-7beb-4cdf-92ed-76f753c469b4.info Sep 28 12:06:26 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-55b23243-8e55-4ec0-8b81-a35b191bc104 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Lock "cinder-quobyte-437d0068-b3f5-405e-9284-30fcb790b60a" acquired by "delete_volume" :: waited 0.023s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:06:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1edac2ce-53bb-4bb9-a67e-b01daf6baaef tempest-CreateVolumesFromImageTest-1278365810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1edac2ce-53bb-4bb9-a67e-b01daf6baaef tempest-CreateVolumesFromImageTest-1278365810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:26 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1edac2ce-53bb-4bb9-a67e-b01daf6baaef tempest-CreateVolumesFromImageTest-1278365810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:06:26 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1edac2ce-53bb-4bb9-a67e-b01daf6baaef tempest-CreateVolumesFromImageTest-1278365810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:06:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1edac2ce-53bb-4bb9-a67e-b01daf6baaef tempest-CreateVolumesFromImageTest-1278365810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1edac2ce-53bb-4bb9-a67e-b01daf6baaef tempest-CreateVolumesFromImageTest-1278365810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:26 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ede499-5161-463d-9d09-3b5e82de356b]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:06:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-55b23243-8e55-4ec0-8b81-a35b191bc104 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-437d0068-b3f5-405e-9284-30fcb790b60a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:26 devstack sudo[107355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:06:26 devstack sudo[107355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:26 devstack sudo[107356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-437d0068-b3f5-405e-9284-30fcb790b60a Sep 28 12:06:26 devstack sudo[107356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:26 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4ade5bde-9fea-4dc2-919d-c5ef5bb079e9 tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4cf94d6a-7beb-4cdf-92ed-76f753c469b4.info" returned: 0 in 0.306s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:26 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-4ade5bde-9fea-4dc2-919d-c5ef5bb079e9 tempest-ProjectMemberTests-1312558137 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4cf94d6a-7beb-4cdf-92ed-76f753c469b4.info is being set with open permissions: ugo+rw Sep 28 12:06:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4ade5bde-9fea-4dc2-919d-c5ef5bb079e9 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4cf94d6a-7beb-4cdf-92ed-76f753c469b4.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:26 devstack sudo[107361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4cf94d6a-7beb-4cdf-92ed-76f753c469b4.info Sep 28 12:06:26 devstack sudo[107361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:26 devstack sudo[107355]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1edac2ce-53bb-4bb9-a67e-b01daf6baaef tempest-CreateVolumesFromImageTest-1278365810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.277s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:26 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-1edac2ce-53bb-4bb9-a67e-b01daf6baaef tempest-CreateVolumesFromImageTest-1278365810 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:06:27 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-1edac2ce-53bb-4bb9-a67e-b01daf6baaef tempest-CreateVolumesFromImageTest-1278365810 None] Deleted volume successfully. Sep 28 12:06:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1edac2ce-53bb-4bb9-a67e-b01daf6baaef tempest-CreateVolumesFromImageTest-1278365810 None] Lock "cinder-e655a6cc-b600-4e96-99f2-b504b48ac660-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:06:27 devstack sudo[107356]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-55b23243-8e55-4ec0-8b81-a35b191bc104 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-437d0068-b3f5-405e-9284-30fcb790b60a" returned: 0 in 0.405s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-55b23243-8e55-4ec0-8b81-a35b191bc104 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-437d0068-b3f5-405e-9284-30fcb790b60a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:27 devstack sudo[107366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-437d0068-b3f5-405e-9284-30fcb790b60a Sep 28 12:06:27 devstack sudo[107366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:27 devstack sudo[107361]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4ade5bde-9fea-4dc2-919d-c5ef5bb079e9 tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4cf94d6a-7beb-4cdf-92ed-76f753c469b4.info" returned: 0 in 0.305s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4ade5bde-9fea-4dc2-919d-c5ef5bb079e9 tempest-ProjectMemberTests-1312558137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.476s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c90d0bf6-af74-4386-ba9f-ef4ebda2bd26 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.951s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c90d0bf6-af74-4386-ba9f-ef4ebda2bd26 tempest-CreateVolumesFromSnapshotTest-1799284639 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:06:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-446918777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15e460c3-4fc8-477f-a58d-8732532776a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec95a230f7ef4894b205462f8a9a17c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:06:23Z,use_quota=True,user_id='42fad2f83c79410abd63e30982c043ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:06:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-c90d0bf6-af74-4386-ba9f-ef4ebda2bd26 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Creating volume 15e460c3-4fc8-477f-a58d-8732532776a0 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:06:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c90d0bf6-af74-4386-ba9f-ef4ebda2bd26 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c90d0bf6-af74-4386-ba9f-ef4ebda2bd26 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c90d0bf6-af74-4386-ba9f-ef4ebda2bd26 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:06:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c90d0bf6-af74-4386-ba9f-ef4ebda2bd26 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:06:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c90d0bf6-af74-4386-ba9f-ef4ebda2bd26 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c90d0bf6-af74-4386-ba9f-ef4ebda2bd26 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:06:27 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-c90d0bf6-af74-4386-ba9f-ef4ebda2bd26 tempest-CreateVolumesFromSnapshotTest-1799284639 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:06:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c90d0bf6-af74-4386-ba9f-ef4ebda2bd26 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-15e460c3-4fc8-477f-a58d-8732532776a0 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:27 devstack sudo[107369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-15e460c3-4fc8-477f-a58d-8732532776a0 1073741824 Sep 28 12:06:27 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:27 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-4ade5bde-9fea-4dc2-919d-c5ef5bb079e9 tempest-ProjectMemberTests-1312558137 None] Create snapshot completed successfully Sep 28 12:06:27 devstack sudo[107366]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-55b23243-8e55-4ec0-8b81-a35b191bc104 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-437d0068-b3f5-405e-9284-30fcb790b60a" returned: 0 in 0.276s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-55b23243-8e55-4ec0-8b81-a35b191bc104 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Lock "cinder-quobyte-437d0068-b3f5-405e-9284-30fcb790b60a" released by "delete_volume" :: held 0.761s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:06:27 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-55b23243-8e55-4ec0-8b81-a35b191bc104 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Created reservations ['faf6b883-2623-4444-aa31-b7a548763c97', '1cff14e0-9db7-48a3-933f-83cd8e228a53', 'dce6d326-4f64-4037-8d37-b860ad57990b', '062bde34-eb4d-4f09-a7e4-7b5952ab4838'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:06:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-55b23243-8e55-4ec0-8b81-a35b191bc104 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-55b23243-8e55-4ec0-8b81-a35b191bc104 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-55b23243-8e55-4ec0-8b81-a35b191bc104 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:06:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-55b23243-8e55-4ec0-8b81-a35b191bc104 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:06:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-55b23243-8e55-4ec0-8b81-a35b191bc104 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-55b23243-8e55-4ec0-8b81-a35b191bc104 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:27 devstack sudo[107375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:06:27 devstack sudo[107375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-04402b34-c34d-40d1-a2fd-022f04de7e15 tempest-ProjectMemberTests-1312558137 None] Acquiring lock "cinder-0334bae9-e16e-4786-af85-ce208e58b35c-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:06:27 devstack sudo[107375]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-55b23243-8e55-4ec0-8b81-a35b191bc104 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.346s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:27 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:27 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-55b23243-8e55-4ec0-8b81-a35b191bc104 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:06:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c90d0bf6-af74-4386-ba9f-ef4ebda2bd26 tempest-CreateVolumesFromSnapshotTest-1799284639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-15e460c3-4fc8-477f-a58d-8732532776a0 1073741824" returned: 0 in 0.644s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:27 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-55b23243-8e55-4ec0-8b81-a35b191bc104 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Deleted volume successfully. Sep 28 12:06:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-04402b34-c34d-40d1-a2fd-022f04de7e15 tempest-ProjectMemberTests-1312558137 None] Lock "cinder-0334bae9-e16e-4786-af85-ce208e58b35c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:06:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-04402b34-c34d-40d1-a2fd-022f04de7e15 tempest-ProjectMemberTests-1312558137 None] Acquiring lock "cinder-quobyte-4cf94d6a-7beb-4cdf-92ed-76f753c469b4" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:06:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-55b23243-8e55-4ec0-8b81-a35b191bc104 tempest-VolumeAndVolumeTypeFromImageTest-807876692 None] Lock "cinder-437d0068-b3f5-405e-9284-30fcb790b60a-delete_volume" released by "delete_volume" :: held 1.428s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:06:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-04402b34-c34d-40d1-a2fd-022f04de7e15 tempest-ProjectMemberTests-1312558137 None] Lock "cinder-quobyte-4cf94d6a-7beb-4cdf-92ed-76f753c469b4" acquired by "delete_snapshot" :: waited 0.049s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:06:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-04402b34-c34d-40d1-a2fd-022f04de7e15 tempest-ProjectMemberTests-1312558137 None] Acquiring lock "cinder-quobyte-0334bae9-e16e-4786-af85-ce208e58b35c" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:06:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c90d0bf6-af74-4386-ba9f-ef4ebda2bd26 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-15e460c3-4fc8-477f-a58d-8732532776a0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:28 devstack sudo[107380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-15e460c3-4fc8-477f-a58d-8732532776a0 Sep 28 12:06:28 devstack sudo[107380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:28 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-04402b34-c34d-40d1-a2fd-022f04de7e15 tempest-ProjectMemberTests-1312558137 None] Lock "cinder-quobyte-0334bae9-e16e-4786-af85-ce208e58b35c" acquired by "_delete_snapshot" :: waited 0.053s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:06:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-04402b34-c34d-40d1-a2fd-022f04de7e15 tempest-ProjectMemberTests-1312558137 None] Deleting offline snapshot 0334bae9-e16e-4786-af85-ce208e58b35c of volume 4cf94d6a-7beb-4cdf-92ed-76f753c469b4 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:06:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-04402b34-c34d-40d1-a2fd-022f04de7e15 tempest-ProjectMemberTests-1312558137 None] snapshot_file for this snap is: volume-4cf94d6a-7beb-4cdf-92ed-76f753c469b4.0334bae9-e16e-4786-af85-ce208e58b35c {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:06:28 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[280776ab-2922-4dae-a7d2-37563ed38042]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:06:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-04402b34-c34d-40d1-a2fd-022f04de7e15 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4cf94d6a-7beb-4cdf-92ed-76f753c469b4.0334bae9-e16e-4786-af85-ce208e58b35c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:28 devstack sudo[107382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4cf94d6a-7beb-4cdf-92ed-76f753c469b4.0334bae9-e16e-4786-af85-ce208e58b35c Sep 28 12:06:28 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:28 devstack sudo[107380]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c90d0bf6-af74-4386-ba9f-ef4ebda2bd26 tempest-CreateVolumesFromSnapshotTest-1799284639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-15e460c3-4fc8-477f-a58d-8732532776a0" returned: 0 in 0.354s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c90d0bf6-af74-4386-ba9f-ef4ebda2bd26 tempest-CreateVolumesFromSnapshotTest-1799284639 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:06:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c90d0bf6-af74-4386-ba9f-ef4ebda2bd26 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-68fc6aa7-07e3-49b2-9766-51facda9cf5d tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.546s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-68fc6aa7-07e3-49b2-9766-51facda9cf5d tempest-CreateVolumesFromSnapshotTest-1799284639 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:06:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-443814020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61c9da72-d102-40bb-b2ff-666ef675c19c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec95a230f7ef4894b205462f8a9a17c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:06:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:06:24Z,use_quota=True,user_id='42fad2f83c79410abd63e30982c043ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:06:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-68fc6aa7-07e3-49b2-9766-51facda9cf5d tempest-CreateVolumesFromSnapshotTest-1799284639 None] Creating volume 61c9da72-d102-40bb-b2ff-666ef675c19c {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:06:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-68fc6aa7-07e3-49b2-9766-51facda9cf5d tempest-CreateVolumesFromSnapshotTest-1799284639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-68fc6aa7-07e3-49b2-9766-51facda9cf5d tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-68fc6aa7-07e3-49b2-9766-51facda9cf5d tempest-CreateVolumesFromSnapshotTest-1799284639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:06:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-68fc6aa7-07e3-49b2-9766-51facda9cf5d tempest-CreateVolumesFromSnapshotTest-1799284639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:06:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-68fc6aa7-07e3-49b2-9766-51facda9cf5d tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-68fc6aa7-07e3-49b2-9766-51facda9cf5d tempest-CreateVolumesFromSnapshotTest-1799284639 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:06:28 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-68fc6aa7-07e3-49b2-9766-51facda9cf5d tempest-CreateVolumesFromSnapshotTest-1799284639 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:06:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-68fc6aa7-07e3-49b2-9766-51facda9cf5d tempest-CreateVolumesFromSnapshotTest-1799284639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-61c9da72-d102-40bb-b2ff-666ef675c19c 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c90d0bf6-af74-4386-ba9f-ef4ebda2bd26 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48cdd68b-70e6-4c93-a2a4-ead7841dd78e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15e460c3-4fc8-477f-a58d-8732532776a0', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c90d0bf6-af74-4386-ba9f-ef4ebda2bd26 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57fd1157-772a-44ba-8640-d98b3dc095b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:28 devstack sudo[107385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-61c9da72-d102-40bb-b2ff-666ef675c19c 1073741824 Sep 28 12:06:28 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:28 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-c90d0bf6-af74-4386-ba9f-ef4ebda2bd26 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Volume volume-15e460c3-4fc8-477f-a58d-8732532776a0 (15e460c3-4fc8-477f-a58d-8732532776a0): created successfully Sep 28 12:06:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c90d0bf6-af74-4386-ba9f-ef4ebda2bd26 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57fd1157-772a-44ba-8640-d98b3dc095b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c90d0bf6-af74-4386-ba9f-ef4ebda2bd26 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Flow 'volume_create_manager' (80190c4d-7d26-4fd6-a9ca-6e555cb1e95a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:06:28 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-c90d0bf6-af74-4386-ba9f-ef4ebda2bd26 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Created volume successfully. Sep 28 12:06:28 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-04402b34-c34d-40d1-a2fd-022f04de7e15 tempest-ProjectMemberTests-1312558137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4cf94d6a-7beb-4cdf-92ed-76f753c469b4.0334bae9-e16e-4786-af85-ce208e58b35c" returned: 0 in 0.575s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-04402b34-c34d-40d1-a2fd-022f04de7e15 tempest-ProjectMemberTests-1312558137 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cf94d6a-7beb-4cdf-92ed-76f753c469b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:06:28 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b6b18b-c306-40a3-8038-3b47d3919d9b]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:06:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-04402b34-c34d-40d1-a2fd-022f04de7e15 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4cf94d6a-7beb-4cdf-92ed-76f753c469b4 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:28 devstack sudo[107393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4cf94d6a-7beb-4cdf-92ed-76f753c469b4 Sep 28 12:06:28 devstack sudo[107393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:29 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-68fc6aa7-07e3-49b2-9766-51facda9cf5d tempest-CreateVolumesFromSnapshotTest-1799284639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-61c9da72-d102-40bb-b2ff-666ef675c19c 1073741824" returned: 0 in 0.696s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-68fc6aa7-07e3-49b2-9766-51facda9cf5d tempest-CreateVolumesFromSnapshotTest-1799284639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-61c9da72-d102-40bb-b2ff-666ef675c19c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:29 devstack sudo[107399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-61c9da72-d102-40bb-b2ff-666ef675c19c Sep 28 12:06:29 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:29 devstack sudo[107393]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-04402b34-c34d-40d1-a2fd-022f04de7e15 tempest-ProjectMemberTests-1312558137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4cf94d6a-7beb-4cdf-92ed-76f753c469b4" returned: 0 in 0.497s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-04402b34-c34d-40d1-a2fd-022f04de7e15 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4cf94d6a-7beb-4cdf-92ed-76f753c469b4.0334bae9-e16e-4786-af85-ce208e58b35c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:29 devstack sudo[107402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4cf94d6a-7beb-4cdf-92ed-76f753c469b4.0334bae9-e16e-4786-af85-ce208e58b35c Sep 28 12:06:29 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:29 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-68fc6aa7-07e3-49b2-9766-51facda9cf5d tempest-CreateVolumesFromSnapshotTest-1799284639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-61c9da72-d102-40bb-b2ff-666ef675c19c" returned: 0 in 0.344s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-68fc6aa7-07e3-49b2-9766-51facda9cf5d tempest-CreateVolumesFromSnapshotTest-1799284639 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:06:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-68fc6aa7-07e3-49b2-9766-51facda9cf5d tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-40726227-1539-4de4-a957-1966f05f537c tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.115s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-40726227-1539-4de4-a957-1966f05f537c tempest-CreateVolumesFromSnapshotTest-1799284639 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1159599379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49c64bd1-76fa-4599-bf81-26fdeb8070c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec95a230f7ef4894b205462f8a9a17c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:06:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:06:24Z,use_quota=True,user_id='42fad2f83c79410abd63e30982c043ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:06:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-40726227-1539-4de4-a957-1966f05f537c tempest-CreateVolumesFromSnapshotTest-1799284639 None] Creating volume 49c64bd1-76fa-4599-bf81-26fdeb8070c2 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:06:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-40726227-1539-4de4-a957-1966f05f537c tempest-CreateVolumesFromSnapshotTest-1799284639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-40726227-1539-4de4-a957-1966f05f537c tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-40726227-1539-4de4-a957-1966f05f537c tempest-CreateVolumesFromSnapshotTest-1799284639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:06:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-40726227-1539-4de4-a957-1966f05f537c tempest-CreateVolumesFromSnapshotTest-1799284639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:06:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-40726227-1539-4de4-a957-1966f05f537c tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-40726227-1539-4de4-a957-1966f05f537c tempest-CreateVolumesFromSnapshotTest-1799284639 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:06:29 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-40726227-1539-4de4-a957-1966f05f537c tempest-CreateVolumesFromSnapshotTest-1799284639 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:06:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-40726227-1539-4de4-a957-1966f05f537c tempest-CreateVolumesFromSnapshotTest-1799284639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-49c64bd1-76fa-4599-bf81-26fdeb8070c2 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:29 devstack sudo[107408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-49c64bd1-76fa-4599-bf81-26fdeb8070c2 1073741824 Sep 28 12:06:29 devstack sudo[107408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-68fc6aa7-07e3-49b2-9766-51facda9cf5d tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acbcf00a-7fda-45a8-af09-5cec8c187561) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61c9da72-d102-40bb-b2ff-666ef675c19c', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-68fc6aa7-07e3-49b2-9766-51facda9cf5d tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad4b8dee-64a4-4f50-abe5-21ccdb1fd402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:29 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-68fc6aa7-07e3-49b2-9766-51facda9cf5d tempest-CreateVolumesFromSnapshotTest-1799284639 None] Volume volume-61c9da72-d102-40bb-b2ff-666ef675c19c (61c9da72-d102-40bb-b2ff-666ef675c19c): created successfully Sep 28 12:06:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-68fc6aa7-07e3-49b2-9766-51facda9cf5d tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad4b8dee-64a4-4f50-abe5-21ccdb1fd402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-68fc6aa7-07e3-49b2-9766-51facda9cf5d tempest-CreateVolumesFromSnapshotTest-1799284639 None] Flow 'volume_create_manager' (d5b08e63-adcc-4599-b86c-61b9fbc81e04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:06:29 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-68fc6aa7-07e3-49b2-9766-51facda9cf5d tempest-CreateVolumesFromSnapshotTest-1799284639 None] Created volume successfully. Sep 28 12:06:29 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-04402b34-c34d-40d1-a2fd-022f04de7e15 tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4cf94d6a-7beb-4cdf-92ed-76f753c469b4.0334bae9-e16e-4786-af85-ce208e58b35c" returned: 0 in 0.530s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-04402b34-c34d-40d1-a2fd-022f04de7e15 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4cf94d6a-7beb-4cdf-92ed-76f753c469b4.0334bae9-e16e-4786-af85-ce208e58b35c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:29 devstack sudo[107411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4cf94d6a-7beb-4cdf-92ed-76f753c469b4.0334bae9-e16e-4786-af85-ce208e58b35c Sep 28 12:06:29 devstack sudo[107411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:30 devstack sudo[107411]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-04402b34-c34d-40d1-a2fd-022f04de7e15 tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4cf94d6a-7beb-4cdf-92ed-76f753c469b4.0334bae9-e16e-4786-af85-ce208e58b35c" returned: 0 in 0.343s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:30 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=102,cinder:INSERT=41,cinder:UPDATE=152,cinder:DELETE=14 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:06:30 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-04402b34-c34d-40d1-a2fd-022f04de7e15 tempest-ProjectMemberTests-1312558137 None] Lock "cinder-quobyte-0334bae9-e16e-4786-af85-ce208e58b35c" released by "_delete_snapshot" :: held 2.119s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:06:30 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-04402b34-c34d-40d1-a2fd-022f04de7e15 tempest-ProjectMemberTests-1312558137 None] Lock "cinder-quobyte-4cf94d6a-7beb-4cdf-92ed-76f753c469b4" released by "delete_snapshot" :: held 2.188s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:06:30 devstack sudo[107408]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-40726227-1539-4de4-a957-1966f05f537c tempest-CreateVolumesFromSnapshotTest-1799284639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-49c64bd1-76fa-4599-bf81-26fdeb8070c2 1073741824" returned: 0 in 0.732s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:30 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-04402b34-c34d-40d1-a2fd-022f04de7e15 tempest-ProjectMemberTests-1312558137 None] Created reservations ['d6121cf8-f0f1-4e3a-b866-aacb778fc2d9', '982282ef-845f-41d4-bcad-c6ade90fd752', '68d46fae-9b15-47e9-92bd-c118ec2746bf', 'cb94ac1d-6faa-4419-a969-18eb46acaf8b'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:06:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-40726227-1539-4de4-a957-1966f05f537c tempest-CreateVolumesFromSnapshotTest-1799284639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-49c64bd1-76fa-4599-bf81-26fdeb8070c2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:30 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=122,cinder:UPDATE=142,cinder:INSERT=44,cinder:DELETE=16 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:06:30 devstack sudo[107418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-49c64bd1-76fa-4599-bf81-26fdeb8070c2 Sep 28 12:06:30 devstack sudo[107418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:30 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-04402b34-c34d-40d1-a2fd-022f04de7e15 tempest-ProjectMemberTests-1312558137 None] Delete snapshot completed successfully. Sep 28 12:06:30 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-04402b34-c34d-40d1-a2fd-022f04de7e15 tempest-ProjectMemberTests-1312558137 None] Lock "cinder-0334bae9-e16e-4786-af85-ce208e58b35c-delete_snapshot" released by "delete_snapshot" :: held 2.484s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:06:30 devstack sudo[107418]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-40726227-1539-4de4-a957-1966f05f537c tempest-CreateVolumesFromSnapshotTest-1799284639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-49c64bd1-76fa-4599-bf81-26fdeb8070c2" returned: 0 in 0.325s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-40726227-1539-4de4-a957-1966f05f537c tempest-CreateVolumesFromSnapshotTest-1799284639 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:06:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-40726227-1539-4de4-a957-1966f05f537c tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-40726227-1539-4de4-a957-1966f05f537c tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86c64ae4-9693-4424-879b-734952dd4124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49c64bd1-76fa-4599-bf81-26fdeb8070c2', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-40726227-1539-4de4-a957-1966f05f537c tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22e16d03-7b2a-4f3f-a127-c73aebebe0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:30 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-40726227-1539-4de4-a957-1966f05f537c tempest-CreateVolumesFromSnapshotTest-1799284639 None] Volume volume-49c64bd1-76fa-4599-bf81-26fdeb8070c2 (49c64bd1-76fa-4599-bf81-26fdeb8070c2): created successfully Sep 28 12:06:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-40726227-1539-4de4-a957-1966f05f537c tempest-CreateVolumesFromSnapshotTest-1799284639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22e16d03-7b2a-4f3f-a127-c73aebebe0e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-40726227-1539-4de4-a957-1966f05f537c tempest-CreateVolumesFromSnapshotTest-1799284639 None] Flow 'volume_create_manager' (24a787b5-f9c3-4c19-90af-c2fef73bd589) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:06:30 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-40726227-1539-4de4-a957-1966f05f537c tempest-CreateVolumesFromSnapshotTest-1799284639 None] Created volume successfully. Sep 28 12:06:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2b8a8c03-bbc6-40bd-9c4b-c27bb312e138 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Acquiring lock "cinder-49c64bd1-76fa-4599-bf81-26fdeb8070c2-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:06:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2b8a8c03-bbc6-40bd-9c4b-c27bb312e138 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "cinder-49c64bd1-76fa-4599-bf81-26fdeb8070c2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:06:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2b8a8c03-bbc6-40bd-9c4b-c27bb312e138 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Acquiring lock "cinder-quobyte-49c64bd1-76fa-4599-bf81-26fdeb8070c2" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:06:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2b8a8c03-bbc6-40bd-9c4b-c27bb312e138 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "cinder-quobyte-49c64bd1-76fa-4599-bf81-26fdeb8070c2" acquired by "delete_volume" :: waited 0.042s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:06:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d8cfd02c-cc90-4f10-b86d-df9e779babc5 tempest-ProjectMemberTests-1312558137 None] Acquiring lock "cinder-4cf94d6a-7beb-4cdf-92ed-76f753c469b4-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:06:31 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd635cd-9edc-4dc4-bee2-fd9fecef280a]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:06:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2b8a8c03-bbc6-40bd-9c4b-c27bb312e138 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-49c64bd1-76fa-4599-bf81-26fdeb8070c2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d8cfd02c-cc90-4f10-b86d-df9e779babc5 tempest-ProjectMemberTests-1312558137 None] Lock "cinder-4cf94d6a-7beb-4cdf-92ed-76f753c469b4-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:06:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d8cfd02c-cc90-4f10-b86d-df9e779babc5 tempest-ProjectMemberTests-1312558137 None] Acquiring lock "cinder-quobyte-4cf94d6a-7beb-4cdf-92ed-76f753c469b4" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:06:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d8cfd02c-cc90-4f10-b86d-df9e779babc5 tempest-ProjectMemberTests-1312558137 None] Lock "cinder-quobyte-4cf94d6a-7beb-4cdf-92ed-76f753c469b4" acquired by "delete_volume" :: waited 0.026s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:06:31 devstack sudo[107424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-49c64bd1-76fa-4599-bf81-26fdeb8070c2 Sep 28 12:06:31 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:31 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2fdbd4-5498-4204-a795-8bea4fa461e1]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:06:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d8cfd02c-cc90-4f10-b86d-df9e779babc5 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4cf94d6a-7beb-4cdf-92ed-76f753c469b4 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:31 devstack sudo[107426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4cf94d6a-7beb-4cdf-92ed-76f753c469b4 Sep 28 12:06:31 devstack sudo[107426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:31 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2b8a8c03-bbc6-40bd-9c4b-c27bb312e138 tempest-CreateVolumesFromSnapshotTest-1799284639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-49c64bd1-76fa-4599-bf81-26fdeb8070c2" returned: 0 in 0.632s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2b8a8c03-bbc6-40bd-9c4b-c27bb312e138 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-49c64bd1-76fa-4599-bf81-26fdeb8070c2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:31 devstack sudo[107433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-49c64bd1-76fa-4599-bf81-26fdeb8070c2 Sep 28 12:06:31 devstack sudo[107433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:31 devstack sudo[107426]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d8cfd02c-cc90-4f10-b86d-df9e779babc5 tempest-ProjectMemberTests-1312558137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4cf94d6a-7beb-4cdf-92ed-76f753c469b4" returned: 0 in 0.490s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d8cfd02c-cc90-4f10-b86d-df9e779babc5 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4cf94d6a-7beb-4cdf-92ed-76f753c469b4 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:32 devstack sudo[107437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4cf94d6a-7beb-4cdf-92ed-76f753c469b4 Sep 28 12:06:32 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:32 devstack sudo[107433]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2b8a8c03-bbc6-40bd-9c4b-c27bb312e138 tempest-CreateVolumesFromSnapshotTest-1799284639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-49c64bd1-76fa-4599-bf81-26fdeb8070c2" returned: 0 in 0.380s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2b8a8c03-bbc6-40bd-9c4b-c27bb312e138 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "cinder-quobyte-49c64bd1-76fa-4599-bf81-26fdeb8070c2" released by "delete_volume" :: held 1.121s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:06:32 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d8cfd02c-cc90-4f10-b86d-df9e779babc5 tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4cf94d6a-7beb-4cdf-92ed-76f753c469b4" returned: 0 in 0.358s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d8cfd02c-cc90-4f10-b86d-df9e779babc5 tempest-ProjectMemberTests-1312558137 None] Lock "cinder-quobyte-4cf94d6a-7beb-4cdf-92ed-76f753c469b4" released by "delete_volume" :: held 0.951s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:06:32 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-2b8a8c03-bbc6-40bd-9c4b-c27bb312e138 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Created reservations ['c81c78ce-ba5b-40f5-84b6-34afa531c3f7', '5592b93f-e63e-4aa1-9d42-1a2f731f4ca9', '8dbe5942-1527-45b7-ae58-8df04d73bf00', '4dcaea88-d8cd-4cdd-97f7-c1824bdb585a'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:06:32 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-d8cfd02c-cc90-4f10-b86d-df9e779babc5 tempest-ProjectMemberTests-1312558137 None] Created reservations ['8a3e9605-bc4f-43d9-9fe9-d3f4048cd758', 'bbd175d2-db00-4762-9538-5e9f36ccc563', '1793e2ac-c5a7-4bff-8af5-7b75042fa88d', 'b4a472cd-80e3-4a0c-9114-3b09cce78f26'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:06:32 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ed860d4-0853-474d-8631-72026857daef tempest-VolumeDependencyTests-1874592473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:06:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3ed860d4-0853-474d-8631-72026857daef tempest-VolumeDependencyTests-1874592473 None] Flow 'volume_create_manager' (fc00a086-90f6-41bd-a0e9-e49404fd7a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:06:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3ed860d4-0853-474d-8631-72026857daef tempest-VolumeDependencyTests-1874592473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d39abb8-c3c6-4c1b-970e-d0d2b00fbdb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3ed860d4-0853-474d-8631-72026857daef tempest-VolumeDependencyTests-1874592473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d39abb8-c3c6-4c1b-970e-d0d2b00fbdb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:06:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1473759972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aaa7054-f0e9-4648-8ae6-8bccfebae37a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5510e71a30034fe9a3e5861d17061b5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:06:32Z,use_quota=True,user_id='d7e7f07f601d40519c9b7df94d2959f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3ed860d4-0853-474d-8631-72026857daef tempest-VolumeDependencyTests-1874592473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9722c036-c28b-43c8-8795-9d2b59577a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3ed860d4-0853-474d-8631-72026857daef tempest-VolumeDependencyTests-1874592473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9722c036-c28b-43c8-8795-9d2b59577a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3ed860d4-0853-474d-8631-72026857daef tempest-VolumeDependencyTests-1874592473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c11ca7c0-44b8-4bf4-82b3-6efaee5cf889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3ed860d4-0853-474d-8631-72026857daef tempest-VolumeDependencyTests-1874592473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c11ca7c0-44b8-4bf4-82b3-6efaee5cf889) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2aaa7054-f0e9-4648-8ae6-8bccfebae37a', 'volume_name': 'volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3ed860d4-0853-474d-8631-72026857daef tempest-VolumeDependencyTests-1874592473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c21213c4-1408-4094-af5e-6a896395112c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3ed860d4-0853-474d-8631-72026857daef tempest-VolumeDependencyTests-1874592473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c21213c4-1408-4094-af5e-6a896395112c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3ed860d4-0853-474d-8631-72026857daef tempest-VolumeDependencyTests-1874592473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43806601-ca3f-495d-a674-38e485a5b903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:32 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-3ed860d4-0853-474d-8631-72026857daef tempest-VolumeDependencyTests-1874592473 None] Volume 2aaa7054-f0e9-4648-8ae6-8bccfebae37a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a', 'volume_size': 1} Sep 28 12:06:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3ed860d4-0853-474d-8631-72026857daef tempest-VolumeDependencyTests-1874592473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3ed860d4-0853-474d-8631-72026857daef tempest-VolumeDependencyTests-1874592473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3ed860d4-0853-474d-8631-72026857daef tempest-VolumeDependencyTests-1874592473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:06:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1473759972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aaa7054-f0e9-4648-8ae6-8bccfebae37a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5510e71a30034fe9a3e5861d17061b5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:06:32Z,use_quota=True,user_id='d7e7f07f601d40519c9b7df94d2959f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:06:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-3ed860d4-0853-474d-8631-72026857daef tempest-VolumeDependencyTests-1874592473 None] Creating volume 2aaa7054-f0e9-4648-8ae6-8bccfebae37a {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:06:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3ed860d4-0853-474d-8631-72026857daef tempest-VolumeDependencyTests-1874592473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3ed860d4-0853-474d-8631-72026857daef tempest-VolumeDependencyTests-1874592473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3ed860d4-0853-474d-8631-72026857daef tempest-VolumeDependencyTests-1874592473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:06:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3ed860d4-0853-474d-8631-72026857daef tempest-VolumeDependencyTests-1874592473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:06:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3ed860d4-0853-474d-8631-72026857daef tempest-VolumeDependencyTests-1874592473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3ed860d4-0853-474d-8631-72026857daef tempest-VolumeDependencyTests-1874592473 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:06:32 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-3ed860d4-0853-474d-8631-72026857daef tempest-VolumeDependencyTests-1874592473 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:06:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3ed860d4-0853-474d-8631-72026857daef tempest-VolumeDependencyTests-1874592473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:32 devstack sudo[107441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a 1073741824 Sep 28 12:06:32 devstack sudo[107441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2b8a8c03-bbc6-40bd-9c4b-c27bb312e138 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2b8a8c03-bbc6-40bd-9c4b-c27bb312e138 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2b8a8c03-bbc6-40bd-9c4b-c27bb312e138 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:06:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2b8a8c03-bbc6-40bd-9c4b-c27bb312e138 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:06:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2b8a8c03-bbc6-40bd-9c4b-c27bb312e138 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2b8a8c03-bbc6-40bd-9c4b-c27bb312e138 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:32 devstack sudo[107443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:06:32 devstack sudo[107443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d8cfd02c-cc90-4f10-b86d-df9e779babc5 tempest-ProjectMemberTests-1312558137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d8cfd02c-cc90-4f10-b86d-df9e779babc5 tempest-ProjectMemberTests-1312558137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d8cfd02c-cc90-4f10-b86d-df9e779babc5 tempest-ProjectMemberTests-1312558137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:06:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d8cfd02c-cc90-4f10-b86d-df9e779babc5 tempest-ProjectMemberTests-1312558137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:06:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d8cfd02c-cc90-4f10-b86d-df9e779babc5 tempest-ProjectMemberTests-1312558137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d8cfd02c-cc90-4f10-b86d-df9e779babc5 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:32 devstack sudo[107445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:06:32 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:32 devstack sudo[107443]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2b8a8c03-bbc6-40bd-9c4b-c27bb312e138 tempest-CreateVolumesFromSnapshotTest-1799284639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.309s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:33 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-2b8a8c03-bbc6-40bd-9c4b-c27bb312e138 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:06:33 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-2b8a8c03-bbc6-40bd-9c4b-c27bb312e138 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Deleted volume successfully. Sep 28 12:06:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2b8a8c03-bbc6-40bd-9c4b-c27bb312e138 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "cinder-49c64bd1-76fa-4599-bf81-26fdeb8070c2-delete_volume" released by "delete_volume" :: held 1.965s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:06:33 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d8cfd02c-cc90-4f10-b86d-df9e779babc5 tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.313s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:33 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-d8cfd02c-cc90-4f10-b86d-df9e779babc5 tempest-ProjectMemberTests-1312558137 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:06:33 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-d8cfd02c-cc90-4f10-b86d-df9e779babc5 tempest-ProjectMemberTests-1312558137 None] Deleted volume successfully. Sep 28 12:06:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d8cfd02c-cc90-4f10-b86d-df9e779babc5 tempest-ProjectMemberTests-1312558137 None] Lock "cinder-4cf94d6a-7beb-4cdf-92ed-76f753c469b4-delete_volume" released by "delete_volume" :: held 1.801s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:06:33 devstack sudo[107441]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3ed860d4-0853-474d-8631-72026857daef tempest-VolumeDependencyTests-1874592473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a 1073741824" returned: 0 in 0.594s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3ed860d4-0853-474d-8631-72026857daef tempest-VolumeDependencyTests-1874592473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:33 devstack sudo[107453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a Sep 28 12:06:33 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3f6a63e1-9767-4d8f-8af4-d1cd9c7b3aac tempest-CreateVolumesFromSnapshotTest-1799284639 None] Acquiring lock "cinder-61c9da72-d102-40bb-b2ff-666ef675c19c-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:06:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3f6a63e1-9767-4d8f-8af4-d1cd9c7b3aac tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "cinder-61c9da72-d102-40bb-b2ff-666ef675c19c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:06:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3f6a63e1-9767-4d8f-8af4-d1cd9c7b3aac tempest-CreateVolumesFromSnapshotTest-1799284639 None] Acquiring lock "cinder-quobyte-61c9da72-d102-40bb-b2ff-666ef675c19c" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:06:33 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3ed860d4-0853-474d-8631-72026857daef tempest-VolumeDependencyTests-1874592473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a" returned: 0 in 0.304s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3ed860d4-0853-474d-8631-72026857daef tempest-VolumeDependencyTests-1874592473 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:06:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3ed860d4-0853-474d-8631-72026857daef tempest-VolumeDependencyTests-1874592473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3ed860d4-0853-474d-8631-72026857daef tempest-VolumeDependencyTests-1874592473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43806601-ca3f-495d-a674-38e485a5b903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3ed860d4-0853-474d-8631-72026857daef tempest-VolumeDependencyTests-1874592473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87b41a4d-9823-4233-bd3c-056a4ff5f48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3f6a63e1-9767-4d8f-8af4-d1cd9c7b3aac tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "cinder-quobyte-61c9da72-d102-40bb-b2ff-666ef675c19c" acquired by "delete_volume" :: waited 0.051s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:06:33 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-3ed860d4-0853-474d-8631-72026857daef tempest-VolumeDependencyTests-1874592473 None] Volume volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a (2aaa7054-f0e9-4648-8ae6-8bccfebae37a): created successfully Sep 28 12:06:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3ed860d4-0853-474d-8631-72026857daef tempest-VolumeDependencyTests-1874592473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87b41a4d-9823-4233-bd3c-056a4ff5f48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3ed860d4-0853-474d-8631-72026857daef tempest-VolumeDependencyTests-1874592473 None] Flow 'volume_create_manager' (fc00a086-90f6-41bd-a0e9-e49404fd7a24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:06:33 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d71ef81-4686-48ec-aa70-3a103ad4059c]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:06:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3f6a63e1-9767-4d8f-8af4-d1cd9c7b3aac tempest-CreateVolumesFromSnapshotTest-1799284639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-61c9da72-d102-40bb-b2ff-666ef675c19c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:33 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-3ed860d4-0853-474d-8631-72026857daef tempest-VolumeDependencyTests-1874592473 None] Created volume successfully. Sep 28 12:06:33 devstack sudo[107456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-61c9da72-d102-40bb-b2ff-666ef675c19c Sep 28 12:06:33 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:33 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-970c09ad-e0e4-4e88-b173-654275762947 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:06:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-970c09ad-e0e4-4e88-b173-654275762947 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Flow 'volume_create_manager' (009b9e7e-2da5-4069-9d15-995b1efe6ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:06:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-970c09ad-e0e4-4e88-b173-654275762947 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (589e700c-620b-4b13-85bb-94363139697e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-970c09ad-e0e4-4e88-b173-654275762947 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (589e700c-620b-4b13-85bb-94363139697e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-222458271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43f6d0c3-7d01-4fd1-b7b6-78b5ba12865f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c286b74f89db450ba3d48c0f90e44784',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:06:34Z,use_quota=True,user_id='bc14d5f27eee4a6d8ebe2e88b779241f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-970c09ad-e0e4-4e88-b173-654275762947 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3463fb5-2e1a-4cd2-a6fa-46c71d348821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-970c09ad-e0e4-4e88-b173-654275762947 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3463fb5-2e1a-4cd2-a6fa-46c71d348821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-970c09ad-e0e4-4e88-b173-654275762947 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01e86a9c-f62f-43a2-9af7-ac2be0440400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-970c09ad-e0e4-4e88-b173-654275762947 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01e86a9c-f62f-43a2-9af7-ac2be0440400) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43f6d0c3-7d01-4fd1-b7b6-78b5ba12865f', 'volume_name': 'volume-43f6d0c3-7d01-4fd1-b7b6-78b5ba12865f', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:34 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-970c09ad-e0e4-4e88-b173-654275762947 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73bb517e-cf9c-4239-b89c-f4818919bc94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-970c09ad-e0e4-4e88-b173-654275762947 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73bb517e-cf9c-4239-b89c-f4818919bc94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-970c09ad-e0e4-4e88-b173-654275762947 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc31eef0-f92f-41c7-9731-350eb4920016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:34 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-970c09ad-e0e4-4e88-b173-654275762947 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Volume 43f6d0c3-7d01-4fd1-b7b6-78b5ba12865f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43f6d0c3-7d01-4fd1-b7b6-78b5ba12865f', 'volume_size': 1} Sep 28 12:06:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-970c09ad-e0e4-4e88-b173-654275762947 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-970c09ad-e0e4-4e88-b173-654275762947 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-970c09ad-e0e4-4e88-b173-654275762947 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-222458271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43f6d0c3-7d01-4fd1-b7b6-78b5ba12865f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c286b74f89db450ba3d48c0f90e44784',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:06:34Z,use_quota=True,user_id='bc14d5f27eee4a6d8ebe2e88b779241f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:06:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-970c09ad-e0e4-4e88-b173-654275762947 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Creating volume 43f6d0c3-7d01-4fd1-b7b6-78b5ba12865f {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:06:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-970c09ad-e0e4-4e88-b173-654275762947 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-970c09ad-e0e4-4e88-b173-654275762947 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-970c09ad-e0e4-4e88-b173-654275762947 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:06:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-970c09ad-e0e4-4e88-b173-654275762947 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:06:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-970c09ad-e0e4-4e88-b173-654275762947 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-970c09ad-e0e4-4e88-b173-654275762947 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:06:34 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-970c09ad-e0e4-4e88-b173-654275762947 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:06:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-970c09ad-e0e4-4e88-b173-654275762947 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-43f6d0c3-7d01-4fd1-b7b6-78b5ba12865f 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3f6a63e1-9767-4d8f-8af4-d1cd9c7b3aac tempest-CreateVolumesFromSnapshotTest-1799284639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-61c9da72-d102-40bb-b2ff-666ef675c19c" returned: 0 in 0.470s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3f6a63e1-9767-4d8f-8af4-d1cd9c7b3aac tempest-CreateVolumesFromSnapshotTest-1799284639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-61c9da72-d102-40bb-b2ff-666ef675c19c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:34 devstack sudo[107462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-43f6d0c3-7d01-4fd1-b7b6-78b5ba12865f 1073741824 Sep 28 12:06:34 devstack sudo[107462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:34 devstack sudo[107463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-61c9da72-d102-40bb-b2ff-666ef675c19c Sep 28 12:06:34 devstack sudo[107463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:34 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-05af2bf2-cab6-4537-a6a7-f0c23a8fee06 tempest-ProjectMemberTests-1312558137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:06:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-05af2bf2-cab6-4537-a6a7-f0c23a8fee06 tempest-ProjectMemberTests-1312558137 None] Flow 'volume_create_manager' (d3a41244-2a50-426d-bfb0-ca2acb546442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:06:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-05af2bf2-cab6-4537-a6a7-f0c23a8fee06 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (165d2e1b-9ae3-40ab-864a-f159674a9545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-05af2bf2-cab6-4537-a6a7-f0c23a8fee06 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (165d2e1b-9ae3-40ab-864a-f159674a9545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1065592812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47a361c4-ee8f-43f2-bbd6-217a88098933,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba606417eb184510b6154fa1a28dce16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:06:34Z,use_quota=True,user_id='bb30da770afa465f8162e7779a473226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-05af2bf2-cab6-4537-a6a7-f0c23a8fee06 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36ed6471-0716-481b-b470-cbf7c9a81d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-05af2bf2-cab6-4537-a6a7-f0c23a8fee06 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36ed6471-0716-481b-b470-cbf7c9a81d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-05af2bf2-cab6-4537-a6a7-f0c23a8fee06 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d243131a-d7f6-4aff-a7d5-a9a178d4a788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-05af2bf2-cab6-4537-a6a7-f0c23a8fee06 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d243131a-d7f6-4aff-a7d5-a9a178d4a788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47a361c4-ee8f-43f2-bbd6-217a88098933', 'volume_name': 'volume-47a361c4-ee8f-43f2-bbd6-217a88098933', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-05af2bf2-cab6-4537-a6a7-f0c23a8fee06 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d6c935a-6911-4b3c-9de1-5556f4e32559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-05af2bf2-cab6-4537-a6a7-f0c23a8fee06 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d6c935a-6911-4b3c-9de1-5556f4e32559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-05af2bf2-cab6-4537-a6a7-f0c23a8fee06 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f38329d-0a65-4377-8a6d-56ec353814a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:34 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-05af2bf2-cab6-4537-a6a7-f0c23a8fee06 tempest-ProjectMemberTests-1312558137 None] Volume 47a361c4-ee8f-43f2-bbd6-217a88098933: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47a361c4-ee8f-43f2-bbd6-217a88098933', 'volume_size': 1} Sep 28 12:06:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-05af2bf2-cab6-4537-a6a7-f0c23a8fee06 tempest-ProjectMemberTests-1312558137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:34 devstack sudo[107463]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3f6a63e1-9767-4d8f-8af4-d1cd9c7b3aac tempest-CreateVolumesFromSnapshotTest-1799284639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-61c9da72-d102-40bb-b2ff-666ef675c19c" returned: 0 in 0.268s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3f6a63e1-9767-4d8f-8af4-d1cd9c7b3aac tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "cinder-quobyte-61c9da72-d102-40bb-b2ff-666ef675c19c" released by "delete_volume" :: held 0.805s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:06:34 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-3f6a63e1-9767-4d8f-8af4-d1cd9c7b3aac tempest-CreateVolumesFromSnapshotTest-1799284639 None] Created reservations ['b556a849-e0f9-45f5-aa3f-f0157bfe5c0e', '2ef2fd8f-5c88-468b-a072-0438638146a3', '748a695c-d048-4be1-9fa9-8452834bc4bf', '79eed59d-296b-42b3-bf8c-06b49116e748'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:06:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3f6a63e1-9767-4d8f-8af4-d1cd9c7b3aac tempest-CreateVolumesFromSnapshotTest-1799284639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3f6a63e1-9767-4d8f-8af4-d1cd9c7b3aac tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3f6a63e1-9767-4d8f-8af4-d1cd9c7b3aac tempest-CreateVolumesFromSnapshotTest-1799284639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:06:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3f6a63e1-9767-4d8f-8af4-d1cd9c7b3aac tempest-CreateVolumesFromSnapshotTest-1799284639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:06:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3f6a63e1-9767-4d8f-8af4-d1cd9c7b3aac tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3f6a63e1-9767-4d8f-8af4-d1cd9c7b3aac tempest-CreateVolumesFromSnapshotTest-1799284639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:34 devstack sudo[107471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:06:34 devstack sudo[107471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6d1be682-c63b-4517-96f7-37b0147c7dde tempest-CreateVolumesFromSnapshotTest-1799284639 None] Acquiring lock "cinder-15e460c3-4fc8-477f-a58d-8732532776a0-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:06:34 devstack sudo[107462]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-970c09ad-e0e4-4e88-b173-654275762947 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-43f6d0c3-7d01-4fd1-b7b6-78b5ba12865f 1073741824" returned: 0 in 0.605s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6d1be682-c63b-4517-96f7-37b0147c7dde tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "cinder-15e460c3-4fc8-477f-a58d-8732532776a0-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:06:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-970c09ad-e0e4-4e88-b173-654275762947 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-43f6d0c3-7d01-4fd1-b7b6-78b5ba12865f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6d1be682-c63b-4517-96f7-37b0147c7dde tempest-CreateVolumesFromSnapshotTest-1799284639 None] Acquiring lock "cinder-quobyte-15e460c3-4fc8-477f-a58d-8732532776a0" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:06:34 devstack sudo[107474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-43f6d0c3-7d01-4fd1-b7b6-78b5ba12865f Sep 28 12:06:34 devstack sudo[107474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:34 devstack sudo[107471]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-659afb98-416b-473f-90c7-fb0bd85c0fad tempest-VolumeDependencyTests-1874592473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6d1be682-c63b-4517-96f7-37b0147c7dde tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "cinder-quobyte-15e460c3-4fc8-477f-a58d-8732532776a0" acquired by "delete_volume" :: waited 0.038s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:06:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3f6a63e1-9767-4d8f-8af4-d1cd9c7b3aac tempest-CreateVolumesFromSnapshotTest-1799284639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.335s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:34 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-3f6a63e1-9767-4d8f-8af4-d1cd9c7b3aac tempest-CreateVolumesFromSnapshotTest-1799284639 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:06:34 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-3f6a63e1-9767-4d8f-8af4-d1cd9c7b3aac tempest-CreateVolumesFromSnapshotTest-1799284639 None] Deleted volume successfully. Sep 28 12:06:34 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0454e4f-fc10-4cc1-bbcf-a2ad8c0dcab2]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:06:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6d1be682-c63b-4517-96f7-37b0147c7dde tempest-CreateVolumesFromSnapshotTest-1799284639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-15e460c3-4fc8-477f-a58d-8732532776a0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3f6a63e1-9767-4d8f-8af4-d1cd9c7b3aac tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "cinder-61c9da72-d102-40bb-b2ff-666ef675c19c-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:06:35 devstack sudo[107476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-15e460c3-4fc8-477f-a58d-8732532776a0 Sep 28 12:06:35 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:35 devstack sudo[107474]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-970c09ad-e0e4-4e88-b173-654275762947 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-43f6d0c3-7d01-4fd1-b7b6-78b5ba12865f" returned: 0 in 0.297s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-970c09ad-e0e4-4e88-b173-654275762947 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:06:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-970c09ad-e0e4-4e88-b173-654275762947 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-05af2bf2-cab6-4537-a6a7-f0c23a8fee06 tempest-ProjectMemberTests-1312558137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.827s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-05af2bf2-cab6-4537-a6a7-f0c23a8fee06 tempest-ProjectMemberTests-1312558137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1065592812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47a361c4-ee8f-43f2-bbd6-217a88098933,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba606417eb184510b6154fa1a28dce16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:06:34Z,use_quota=True,user_id='bb30da770afa465f8162e7779a473226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:06:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-05af2bf2-cab6-4537-a6a7-f0c23a8fee06 tempest-ProjectMemberTests-1312558137 None] Creating volume 47a361c4-ee8f-43f2-bbd6-217a88098933 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:06:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-05af2bf2-cab6-4537-a6a7-f0c23a8fee06 tempest-ProjectMemberTests-1312558137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-05af2bf2-cab6-4537-a6a7-f0c23a8fee06 tempest-ProjectMemberTests-1312558137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-05af2bf2-cab6-4537-a6a7-f0c23a8fee06 tempest-ProjectMemberTests-1312558137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:06:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-05af2bf2-cab6-4537-a6a7-f0c23a8fee06 tempest-ProjectMemberTests-1312558137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:06:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-05af2bf2-cab6-4537-a6a7-f0c23a8fee06 tempest-ProjectMemberTests-1312558137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-05af2bf2-cab6-4537-a6a7-f0c23a8fee06 tempest-ProjectMemberTests-1312558137 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:06:35 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-05af2bf2-cab6-4537-a6a7-f0c23a8fee06 tempest-ProjectMemberTests-1312558137 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:06:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-05af2bf2-cab6-4537-a6a7-f0c23a8fee06 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-47a361c4-ee8f-43f2-bbd6-217a88098933 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-970c09ad-e0e4-4e88-b173-654275762947 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc31eef0-f92f-41c7-9731-350eb4920016) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43f6d0c3-7d01-4fd1-b7b6-78b5ba12865f', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:35 devstack sudo[107479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-47a361c4-ee8f-43f2-bbd6-217a88098933 1073741824 Sep 28 12:06:35 devstack sudo[107479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-970c09ad-e0e4-4e88-b173-654275762947 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96fb4c98-6e4d-47db-9413-a2e439955fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:35 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-970c09ad-e0e4-4e88-b173-654275762947 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Volume volume-43f6d0c3-7d01-4fd1-b7b6-78b5ba12865f (43f6d0c3-7d01-4fd1-b7b6-78b5ba12865f): created successfully Sep 28 12:06:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-970c09ad-e0e4-4e88-b173-654275762947 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96fb4c98-6e4d-47db-9413-a2e439955fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-970c09ad-e0e4-4e88-b173-654275762947 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Flow 'volume_create_manager' (009b9e7e-2da5-4069-9d15-995b1efe6ed4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:06:35 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-970c09ad-e0e4-4e88-b173-654275762947 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Created volume successfully. Sep 28 12:06:35 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6d1be682-c63b-4517-96f7-37b0147c7dde tempest-CreateVolumesFromSnapshotTest-1799284639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-15e460c3-4fc8-477f-a58d-8732532776a0" returned: 0 in 0.398s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6d1be682-c63b-4517-96f7-37b0147c7dde tempest-CreateVolumesFromSnapshotTest-1799284639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-15e460c3-4fc8-477f-a58d-8732532776a0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:35 devstack sudo[107484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-15e460c3-4fc8-477f-a58d-8732532776a0 Sep 28 12:06:35 devstack sudo[107484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:35 devstack sudo[107484]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6d1be682-c63b-4517-96f7-37b0147c7dde tempest-CreateVolumesFromSnapshotTest-1799284639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-15e460c3-4fc8-477f-a58d-8732532776a0" returned: 0 in 0.279s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:35 devstack sudo[107479]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-05af2bf2-cab6-4537-a6a7-f0c23a8fee06 tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-47a361c4-ee8f-43f2-bbd6-217a88098933 1073741824" returned: 0 in 0.464s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6d1be682-c63b-4517-96f7-37b0147c7dde tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "cinder-quobyte-15e460c3-4fc8-477f-a58d-8732532776a0" released by "delete_volume" :: held 0.733s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:06:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-05af2bf2-cab6-4537-a6a7-f0c23a8fee06 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-47a361c4-ee8f-43f2-bbd6-217a88098933 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:35 devstack sudo[107490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-47a361c4-ee8f-43f2-bbd6-217a88098933 Sep 28 12:06:35 devstack sudo[107490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:35 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-6d1be682-c63b-4517-96f7-37b0147c7dde tempest-CreateVolumesFromSnapshotTest-1799284639 None] Created reservations ['b3aa8c9f-6ef5-401f-a3ac-8eb63d834444', '581b7354-ff24-45ab-bea7-e23a447ca72e', 'b5e4918a-a7bf-42ac-891d-a109cb131dbf', '8903a28e-1d22-4e80-be61-479d99a11243'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:06:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6d1be682-c63b-4517-96f7-37b0147c7dde tempest-CreateVolumesFromSnapshotTest-1799284639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6d1be682-c63b-4517-96f7-37b0147c7dde tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6d1be682-c63b-4517-96f7-37b0147c7dde tempest-CreateVolumesFromSnapshotTest-1799284639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:06:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6d1be682-c63b-4517-96f7-37b0147c7dde tempest-CreateVolumesFromSnapshotTest-1799284639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:06:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6d1be682-c63b-4517-96f7-37b0147c7dde tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6d1be682-c63b-4517-96f7-37b0147c7dde tempest-CreateVolumesFromSnapshotTest-1799284639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:35 devstack sudo[107492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:06:35 devstack sudo[107492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5c3a81e9-4fcb-4020-bc62-03b2e5141324 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Acquiring lock "cinder-b64e70c3-79bf-4f35-9d9f-586472bc0f08-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:06:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5c3a81e9-4fcb-4020-bc62-03b2e5141324 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "cinder-b64e70c3-79bf-4f35-9d9f-586472bc0f08-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:06:35 devstack sudo[107490]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-05af2bf2-cab6-4537-a6a7-f0c23a8fee06 tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-47a361c4-ee8f-43f2-bbd6-217a88098933" returned: 0 in 0.327s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-05af2bf2-cab6-4537-a6a7-f0c23a8fee06 tempest-ProjectMemberTests-1312558137 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:06:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-05af2bf2-cab6-4537-a6a7-f0c23a8fee06 tempest-ProjectMemberTests-1312558137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-659afb98-416b-473f-90c7-fb0bd85c0fad tempest-VolumeDependencyTests-1874592473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.115s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5c3a81e9-4fcb-4020-bc62-03b2e5141324 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Acquiring lock "cinder-quobyte-b64e70c3-79bf-4f35-9d9f-586472bc0f08" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:06:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-05af2bf2-cab6-4537-a6a7-f0c23a8fee06 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f38329d-0a65-4377-8a6d-56ec353814a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47a361c4-ee8f-43f2-bbd6-217a88098933', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-05af2bf2-cab6-4537-a6a7-f0c23a8fee06 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f189a901-a55d-4059-8bfe-6740a2c1ecd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-659afb98-416b-473f-90c7-fb0bd85c0fad tempest-VolumeDependencyTests-1874592473 None] Creating offline snapshot 965060c4-362a-4426-9758-31c62fe99ab5 of volume 2aaa7054-f0e9-4648-8ae6-8bccfebae37a {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:06:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5c3a81e9-4fcb-4020-bc62-03b2e5141324 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "cinder-quobyte-b64e70c3-79bf-4f35-9d9f-586472bc0f08" acquired by "delete_volume" :: waited 0.038s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:06:36 devstack sudo[107492]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:36 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87e0152-ba08-4bd8-bb19-540c1d532616]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:06:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-659afb98-416b-473f-90c7-fb0bd85c0fad tempest-VolumeDependencyTests-1874592473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:36 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[152f2033-545f-43b9-9ce0-6386f2c885c9]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:06:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6d1be682-c63b-4517-96f7-37b0147c7dde tempest-CreateVolumesFromSnapshotTest-1799284639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.326s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5c3a81e9-4fcb-4020-bc62-03b2e5141324 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b64e70c3-79bf-4f35-9d9f-586472bc0f08 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:36 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-6d1be682-c63b-4517-96f7-37b0147c7dde tempest-CreateVolumesFromSnapshotTest-1799284639 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:06:36 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-05af2bf2-cab6-4537-a6a7-f0c23a8fee06 tempest-ProjectMemberTests-1312558137 None] Volume volume-47a361c4-ee8f-43f2-bbd6-217a88098933 (47a361c4-ee8f-43f2-bbd6-217a88098933): created successfully Sep 28 12:06:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-05af2bf2-cab6-4537-a6a7-f0c23a8fee06 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f189a901-a55d-4059-8bfe-6740a2c1ecd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-05af2bf2-cab6-4537-a6a7-f0c23a8fee06 tempest-ProjectMemberTests-1312558137 None] Flow 'volume_create_manager' (d3a41244-2a50-426d-bfb0-ca2acb546442) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:06:36 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-6d1be682-c63b-4517-96f7-37b0147c7dde tempest-CreateVolumesFromSnapshotTest-1799284639 None] Deleted volume successfully. Sep 28 12:06:36 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-05af2bf2-cab6-4537-a6a7-f0c23a8fee06 tempest-ProjectMemberTests-1312558137 None] Created volume successfully. Sep 28 12:06:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6d1be682-c63b-4517-96f7-37b0147c7dde tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "cinder-15e460c3-4fc8-477f-a58d-8732532776a0-delete_volume" released by "delete_volume" :: held 1.423s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:06:36 devstack sudo[107496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a Sep 28 12:06:36 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:36 devstack sudo[107497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b64e70c3-79bf-4f35-9d9f-586472bc0f08 Sep 28 12:06:36 devstack sudo[107497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:36 devstack sudo[107497]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5c3a81e9-4fcb-4020-bc62-03b2e5141324 tempest-CreateVolumesFromSnapshotTest-1799284639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b64e70c3-79bf-4f35-9d9f-586472bc0f08" returned: 0 in 0.504s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5c3a81e9-4fcb-4020-bc62-03b2e5141324 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b64e70c3-79bf-4f35-9d9f-586472bc0f08 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:36 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-659afb98-416b-473f-90c7-fb0bd85c0fad tempest-VolumeDependencyTests-1874592473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a" returned: 0 in 0.542s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-659afb98-416b-473f-90c7-fb0bd85c0fad tempest-VolumeDependencyTests-1874592473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a.965060c4-362a-4426-9758-31c62fe99ab5 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:36 devstack sudo[107508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b64e70c3-79bf-4f35-9d9f-586472bc0f08 Sep 28 12:06:36 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:36 devstack sudo[107510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a.965060c4-362a-4426-9758-31c62fe99ab5 1G Sep 28 12:06:36 devstack sudo[107510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b421d306-48e0-4ecc-9a25-d59b947846b5 tempest-ProjectMemberTests-1312558137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:36 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5c3a81e9-4fcb-4020-bc62-03b2e5141324 tempest-CreateVolumesFromSnapshotTest-1799284639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b64e70c3-79bf-4f35-9d9f-586472bc0f08" returned: 0 in 0.332s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:36 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-88b30873-19d5-49ea-abed-516b64678bf5 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:06:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-88b30873-19d5-49ea-abed-516b64678bf5 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Flow 'volume_create_manager' (a71a7ff3-24a3-4fe2-b8ec-64f728bc177c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:06:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-88b30873-19d5-49ea-abed-516b64678bf5 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2bf811e-4284-4760-a662-dde99e939784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5c3a81e9-4fcb-4020-bc62-03b2e5141324 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "cinder-quobyte-b64e70c3-79bf-4f35-9d9f-586472bc0f08" released by "delete_volume" :: held 0.925s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:06:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-88b30873-19d5-49ea-abed-516b64678bf5 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2bf811e-4284-4760-a662-dde99e939784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1894853010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=212c1da5-6f2e-4221-81af-9ec108c83607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c286b74f89db450ba3d48c0f90e44784',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:06:37Z,use_quota=True,user_id='bc14d5f27eee4a6d8ebe2e88b779241f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-88b30873-19d5-49ea-abed-516b64678bf5 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ef270b3-7a8b-4553-a975-c94a22707e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-88b30873-19d5-49ea-abed-516b64678bf5 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ef270b3-7a8b-4553-a975-c94a22707e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-88b30873-19d5-49ea-abed-516b64678bf5 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1f575b5-89b8-461b-86af-2ee6afaafe80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-88b30873-19d5-49ea-abed-516b64678bf5 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1f575b5-89b8-461b-86af-2ee6afaafe80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '212c1da5-6f2e-4221-81af-9ec108c83607', 'volume_name': 'volume-212c1da5-6f2e-4221-81af-9ec108c83607', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-88b30873-19d5-49ea-abed-516b64678bf5 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f50c2a2-5419-41ad-b590-900b2e1a5380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-88b30873-19d5-49ea-abed-516b64678bf5 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f50c2a2-5419-41ad-b590-900b2e1a5380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-88b30873-19d5-49ea-abed-516b64678bf5 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4499ef8-7d3f-4f4c-850c-b25f1c4f641e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:37 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-88b30873-19d5-49ea-abed-516b64678bf5 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Volume 212c1da5-6f2e-4221-81af-9ec108c83607: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-212c1da5-6f2e-4221-81af-9ec108c83607', 'volume_size': 1} Sep 28 12:06:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-88b30873-19d5-49ea-abed-516b64678bf5 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:37 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-5c3a81e9-4fcb-4020-bc62-03b2e5141324 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Created reservations ['5614f8fe-72a5-43d6-85f9-ef383fe8cd23', '00348530-327b-46c7-84f2-58b3a090b0fb', 'f41cb535-5e16-4a75-a80b-a4b53a3fa9f2', '6123bb7d-f739-4365-afa0-5e591c8478ad'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:06:37 devstack sudo[107510]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:37 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-ede58024-de7b-47d0-8e90-069bb9bafaf0 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:06:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ede58024-de7b-47d0-8e90-069bb9bafaf0 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Flow 'volume_create_manager' (94484b39-eb8d-4ba9-9248-08460c9a8d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:06:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ede58024-de7b-47d0-8e90-069bb9bafaf0 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adfbcc71-40d0-4c40-928d-23981820bb2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-659afb98-416b-473f-90c7-fb0bd85c0fad tempest-VolumeDependencyTests-1874592473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a.965060c4-362a-4426-9758-31c62fe99ab5 1G" returned: 0 in 0.661s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-659afb98-416b-473f-90c7-fb0bd85c0fad tempest-VolumeDependencyTests-1874592473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a.965060c4-362a-4426-9758-31c62fe99ab5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ede58024-de7b-47d0-8e90-069bb9bafaf0 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adfbcc71-40d0-4c40-928d-23981820bb2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1995209522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a7ca908-f2de-4a27-bf4c-b488c203f1b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c286b74f89db450ba3d48c0f90e44784',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:06:37Z,use_quota=True,user_id='bc14d5f27eee4a6d8ebe2e88b779241f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:37 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a.965060c4-362a-4426-9758-31c62fe99ab5 Sep 28 12:06:37 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ede58024-de7b-47d0-8e90-069bb9bafaf0 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87d4eeb8-eb56-447b-a202-182c51838014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ede58024-de7b-47d0-8e90-069bb9bafaf0 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87d4eeb8-eb56-447b-a202-182c51838014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ede58024-de7b-47d0-8e90-069bb9bafaf0 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d98a145-1b01-4cc9-a4d5-5f170366d14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ede58024-de7b-47d0-8e90-069bb9bafaf0 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d98a145-1b01-4cc9-a4d5-5f170366d14c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a7ca908-f2de-4a27-bf4c-b488c203f1b6', 'volume_name': 'volume-8a7ca908-f2de-4a27-bf4c-b488c203f1b6', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ede58024-de7b-47d0-8e90-069bb9bafaf0 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a874820-ee56-45d5-b66e-efcb054cff4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ede58024-de7b-47d0-8e90-069bb9bafaf0 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a874820-ee56-45d5-b66e-efcb054cff4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ede58024-de7b-47d0-8e90-069bb9bafaf0 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff371e59-4e14-4acd-b8ab-273cb325fed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:37 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-ede58024-de7b-47d0-8e90-069bb9bafaf0 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Volume 8a7ca908-f2de-4a27-bf4c-b488c203f1b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a7ca908-f2de-4a27-bf4c-b488c203f1b6', 'volume_size': 1} Sep 28 12:06:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ede58024-de7b-47d0-8e90-069bb9bafaf0 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5c3a81e9-4fcb-4020-bc62-03b2e5141324 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5c3a81e9-4fcb-4020-bc62-03b2e5141324 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5c3a81e9-4fcb-4020-bc62-03b2e5141324 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:06:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5c3a81e9-4fcb-4020-bc62-03b2e5141324 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:06:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5c3a81e9-4fcb-4020-bc62-03b2e5141324 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5c3a81e9-4fcb-4020-bc62-03b2e5141324 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:37 devstack sudo[107519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:06:37 devstack sudo[107519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:37 devstack sudo[107519]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5c3a81e9-4fcb-4020-bc62-03b2e5141324 tempest-CreateVolumesFromSnapshotTest-1799284639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.288s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:37 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:37 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-5c3a81e9-4fcb-4020-bc62-03b2e5141324 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:06:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-659afb98-416b-473f-90c7-fb0bd85c0fad tempest-VolumeDependencyTests-1874592473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a.965060c4-362a-4426-9758-31c62fe99ab5" returned: 0 in 0.402s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:37 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-659afb98-416b-473f-90c7-fb0bd85c0fad tempest-VolumeDependencyTests-1874592473 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a.965060c4-362a-4426-9758-31c62fe99ab5 is being set with open permissions: ugo+rw Sep 28 12:06:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-659afb98-416b-473f-90c7-fb0bd85c0fad tempest-VolumeDependencyTests-1874592473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a.965060c4-362a-4426-9758-31c62fe99ab5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:37 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-5c3a81e9-4fcb-4020-bc62-03b2e5141324 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Deleted volume successfully. Sep 28 12:06:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5c3a81e9-4fcb-4020-bc62-03b2e5141324 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "cinder-b64e70c3-79bf-4f35-9d9f-586472bc0f08-delete_volume" released by "delete_volume" :: held 1.785s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:06:37 devstack sudo[107526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a.965060c4-362a-4426-9758-31c62fe99ab5 Sep 28 12:06:37 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:37 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0bcb370-dd16-418b-b6c6-b2b8fe0bd484 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:06:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c0bcb370-dd16-418b-b6c6-b2b8fe0bd484 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Flow 'volume_create_manager' (7d543f5e-b1c1-4fbb-946d-b0fa44c9a69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:06:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c0bcb370-dd16-418b-b6c6-b2b8fe0bd484 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52b3f0ad-a219-4606-a390-36d1f42e0eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c0bcb370-dd16-418b-b6c6-b2b8fe0bd484 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52b3f0ad-a219-4606-a390-36d1f42e0eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1773579669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ab38c01-f7a5-4b5e-b23d-e81c03ab798f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c286b74f89db450ba3d48c0f90e44784',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:06:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:06:38Z,use_quota=True,user_id='bc14d5f27eee4a6d8ebe2e88b779241f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c0bcb370-dd16-418b-b6c6-b2b8fe0bd484 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa9c6f61-0423-4ef8-883d-17f21c3dcaac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c0bcb370-dd16-418b-b6c6-b2b8fe0bd484 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa9c6f61-0423-4ef8-883d-17f21c3dcaac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c0bcb370-dd16-418b-b6c6-b2b8fe0bd484 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cd94099-2451-47e5-8c58-bafac6f6eaf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c0bcb370-dd16-418b-b6c6-b2b8fe0bd484 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cd94099-2451-47e5-8c58-bafac6f6eaf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ab38c01-f7a5-4b5e-b23d-e81c03ab798f', 'volume_name': 'volume-1ab38c01-f7a5-4b5e-b23d-e81c03ab798f', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c0bcb370-dd16-418b-b6c6-b2b8fe0bd484 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a007db2d-23e5-4be2-83c8-ce0db7a36dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c0bcb370-dd16-418b-b6c6-b2b8fe0bd484 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a007db2d-23e5-4be2-83c8-ce0db7a36dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c0bcb370-dd16-418b-b6c6-b2b8fe0bd484 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1634ac09-aff8-415e-a594-c02425f29071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:37 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-c0bcb370-dd16-418b-b6c6-b2b8fe0bd484 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Volume 1ab38c01-f7a5-4b5e-b23d-e81c03ab798f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ab38c01-f7a5-4b5e-b23d-e81c03ab798f', 'volume_size': 1} Sep 28 12:06:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c0bcb370-dd16-418b-b6c6-b2b8fe0bd484 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:37 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-659afb98-416b-473f-90c7-fb0bd85c0fad tempest-VolumeDependencyTests-1874592473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a.965060c4-362a-4426-9758-31c62fe99ab5" returned: 0 in 0.309s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-659afb98-416b-473f-90c7-fb0bd85c0fad tempest-VolumeDependencyTests-1874592473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:38 devstack sudo[107529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a.info Sep 28 12:06:38 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-cfddf57c-b90b-450b-8b52-7c33abd09963 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Acquiring lock "cinder-b406d0c7-be83-4a5b-bf4c-1f17cd291b1a-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:06:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-cfddf57c-b90b-450b-8b52-7c33abd09963 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "cinder-b406d0c7-be83-4a5b-bf4c-1f17cd291b1a-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:06:38 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ab877f3-6f80-4570-96aa-5d697f3bc656 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:06:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6ab877f3-6f80-4570-96aa-5d697f3bc656 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Flow 'volume_create_manager' (82c08641-2857-4de9-844e-a3bd2b672098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:06:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6ab877f3-6f80-4570-96aa-5d697f3bc656 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (390aaf28-e842-4832-a672-a57c8aba9409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6ab877f3-6f80-4570-96aa-5d697f3bc656 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (390aaf28-e842-4832-a672-a57c8aba9409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:06:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-241138711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15b75dae-a145-4bb5-954c-ead21d1080db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c286b74f89db450ba3d48c0f90e44784',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:06:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:06:38Z,use_quota=True,user_id='bc14d5f27eee4a6d8ebe2e88b779241f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6ab877f3-6f80-4570-96aa-5d697f3bc656 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83ba07c5-6ed7-48b9-bb48-4785c635c655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6ab877f3-6f80-4570-96aa-5d697f3bc656 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83ba07c5-6ed7-48b9-bb48-4785c635c655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6ab877f3-6f80-4570-96aa-5d697f3bc656 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9be85a3-8760-4392-a5e4-f2410cb57459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6ab877f3-6f80-4570-96aa-5d697f3bc656 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9be85a3-8760-4392-a5e4-f2410cb57459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15b75dae-a145-4bb5-954c-ead21d1080db', 'volume_name': 'volume-15b75dae-a145-4bb5-954c-ead21d1080db', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6ab877f3-6f80-4570-96aa-5d697f3bc656 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0047696-eda0-4d3a-a44a-901c54ffe843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6ab877f3-6f80-4570-96aa-5d697f3bc656 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0047696-eda0-4d3a-a44a-901c54ffe843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6ab877f3-6f80-4570-96aa-5d697f3bc656 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de5f93cb-5093-4317-8b49-6bc633b1f985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:38 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-6ab877f3-6f80-4570-96aa-5d697f3bc656 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Volume 15b75dae-a145-4bb5-954c-ead21d1080db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15b75dae-a145-4bb5-954c-ead21d1080db', 'volume_size': 1} Sep 28 12:06:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6ab877f3-6f80-4570-96aa-5d697f3bc656 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-cfddf57c-b90b-450b-8b52-7c33abd09963 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Acquiring lock "cinder-quobyte-b406d0c7-be83-4a5b-bf4c-1f17cd291b1a" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:06:38 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-659afb98-416b-473f-90c7-fb0bd85c0fad tempest-VolumeDependencyTests-1874592473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a.info" returned: 0 in 0.363s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:38 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-659afb98-416b-473f-90c7-fb0bd85c0fad tempest-VolumeDependencyTests-1874592473 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a.info is being set with open permissions: ugo+rw Sep 28 12:06:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-659afb98-416b-473f-90c7-fb0bd85c0fad tempest-VolumeDependencyTests-1874592473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-cfddf57c-b90b-450b-8b52-7c33abd09963 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "cinder-quobyte-b406d0c7-be83-4a5b-bf4c-1f17cd291b1a" acquired by "delete_volume" :: waited 0.028s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:06:38 devstack sudo[107532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a.info Sep 28 12:06:38 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:38 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[51cdeaa6-c5d5-4136-b3be-d691d4136138]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:06:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cfddf57c-b90b-450b-8b52-7c33abd09963 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b406d0c7-be83-4a5b-bf4c-1f17cd291b1a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:38 devstack sudo[107534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b406d0c7-be83-4a5b-bf4c-1f17cd291b1a Sep 28 12:06:38 devstack sudo[107534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:38 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:06:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:06:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:06:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:38 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:38 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-ded09ad7-a8be-49d2-9934-08e7815b6ed4 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:06:38 devstack sudo[107537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:06:38 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ded09ad7-a8be-49d2-9934-08e7815b6ed4 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Flow 'volume_create_manager' (daa1dbab-c540-4652-b4dd-1403d3e20e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:06:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ded09ad7-a8be-49d2-9934-08e7815b6ed4 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82569631-92cf-43c2-85de-3d4a9221e4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-659afb98-416b-473f-90c7-fb0bd85c0fad tempest-VolumeDependencyTests-1874592473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a.info" returned: 0 in 0.353s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-659afb98-416b-473f-90c7-fb0bd85c0fad tempest-VolumeDependencyTests-1874592473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.763s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b421d306-48e0-4ecc-9a25-d59b947846b5 tempest-ProjectMemberTests-1312558137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.874s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ded09ad7-a8be-49d2-9934-08e7815b6ed4 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82569631-92cf-43c2-85de-3d4a9221e4dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:06:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1939592671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28ea4a9e-14a4-4cf6-b58b-a1899f392a33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c286b74f89db450ba3d48c0f90e44784',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:06:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:06:39Z,use_quota=True,user_id='bc14d5f27eee4a6d8ebe2e88b779241f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ded09ad7-a8be-49d2-9934-08e7815b6ed4 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9f36478-ecf7-4aff-ab46-1e6dda012bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ded09ad7-a8be-49d2-9934-08e7815b6ed4 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9f36478-ecf7-4aff-ab46-1e6dda012bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ded09ad7-a8be-49d2-9934-08e7815b6ed4 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ff85e91-27b1-4d55-bf15-b920d91e5e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ded09ad7-a8be-49d2-9934-08e7815b6ed4 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ff85e91-27b1-4d55-bf15-b920d91e5e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28ea4a9e-14a4-4cf6-b58b-a1899f392a33', 'volume_name': 'volume-28ea4a9e-14a4-4cf6-b58b-a1899f392a33', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ded09ad7-a8be-49d2-9934-08e7815b6ed4 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bed9fb76-e9fc-4b91-a2cd-299a1e59f3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ded09ad7-a8be-49d2-9934-08e7815b6ed4 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bed9fb76-e9fc-4b91-a2cd-299a1e59f3af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ded09ad7-a8be-49d2-9934-08e7815b6ed4 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (349a53b8-9500-49b9-83ff-037b3c24b7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:38 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-ded09ad7-a8be-49d2-9934-08e7815b6ed4 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Volume 28ea4a9e-14a4-4cf6-b58b-a1899f392a33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28ea4a9e-14a4-4cf6-b58b-a1899f392a33', 'volume_size': 1} Sep 28 12:06:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ded09ad7-a8be-49d2-9934-08e7815b6ed4 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-b421d306-48e0-4ecc-9a25-d59b947846b5 tempest-ProjectMemberTests-1312558137 None] Creating offline snapshot 231e4a71-7ad7-4f94-aae8-4debbf5e655f of volume 47a361c4-ee8f-43f2-bbd6-217a88098933 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:06:38 devstack sudo[107534]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cfddf57c-b90b-450b-8b52-7c33abd09963 tempest-CreateVolumesFromSnapshotTest-1799284639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b406d0c7-be83-4a5b-bf4c-1f17cd291b1a" returned: 0 in 0.415s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cfddf57c-b90b-450b-8b52-7c33abd09963 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b406d0c7-be83-4a5b-bf4c-1f17cd291b1a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:38 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[875ba13f-7041-4f59-832d-b781de7c4599]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:06:38 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-659afb98-416b-473f-90c7-fb0bd85c0fad tempest-VolumeDependencyTests-1874592473 None] Create snapshot completed successfully Sep 28 12:06:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b421d306-48e0-4ecc-9a25-d59b947846b5 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-47a361c4-ee8f-43f2-bbd6-217a88098933 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:38 devstack sudo[107542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b406d0c7-be83-4a5b-bf4c-1f17cd291b1a Sep 28 12:06:38 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:38 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.307s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:38 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:06:38 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:06:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] thread count: 28 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:06:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] thread info: [<_MainThread(MainThread, started 135408582168704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:06:39 devstack sudo[107543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-47a361c4-ee8f-43f2-bbd6-217a88098933 Sep 28 12:06:39 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:39 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cfddf57c-b90b-450b-8b52-7c33abd09963 tempest-CreateVolumesFromSnapshotTest-1799284639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b406d0c7-be83-4a5b-bf4c-1f17cd291b1a" returned: 0 in 0.317s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-cfddf57c-b90b-450b-8b52-7c33abd09963 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "cinder-quobyte-b406d0c7-be83-4a5b-bf4c-1f17cd291b1a" released by "delete_volume" :: held 0.794s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:06:39 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-cfddf57c-b90b-450b-8b52-7c33abd09963 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Created reservations ['290a4701-e80d-47f8-a227-61c078b90293', '4cab4a1c-f1a4-49ec-876e-463b95af7645', 'b8bb10d7-efc3-40f2-a0fc-38b2ab6a883c', '6575bcb1-15b4-46be-b643-702478f24382'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:06:39 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b421d306-48e0-4ecc-9a25-d59b947846b5 tempest-ProjectMemberTests-1312558137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-47a361c4-ee8f-43f2-bbd6-217a88098933" returned: 0 in 0.457s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b421d306-48e0-4ecc-9a25-d59b947846b5 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-47a361c4-ee8f-43f2-bbd6-217a88098933,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-47a361c4-ee8f-43f2-bbd6-217a88098933.231e4a71-7ad7-4f94-aae8-4debbf5e655f 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cfddf57c-b90b-450b-8b52-7c33abd09963 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cfddf57c-b90b-450b-8b52-7c33abd09963 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cfddf57c-b90b-450b-8b52-7c33abd09963 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:06:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cfddf57c-b90b-450b-8b52-7c33abd09963 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:06:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cfddf57c-b90b-450b-8b52-7c33abd09963 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cfddf57c-b90b-450b-8b52-7c33abd09963 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:39 devstack sudo[107551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-47a361c4-ee8f-43f2-bbd6-217a88098933,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-47a361c4-ee8f-43f2-bbd6-217a88098933.231e4a71-7ad7-4f94-aae8-4debbf5e655f 1G Sep 28 12:06:39 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:39 devstack sudo[107552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:06:39 devstack sudo[107552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-23d38c1e-9498-4ee3-abd8-dc1e66986e74 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Acquiring lock "cinder-a2f5cc6f-c397-49b6-a7ea-67bb624d70df-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:06:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-23d38c1e-9498-4ee3-abd8-dc1e66986e74 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "cinder-a2f5cc6f-c397-49b6-a7ea-67bb624d70df-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:06:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-23d38c1e-9498-4ee3-abd8-dc1e66986e74 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Acquiring lock "cinder-quobyte-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:06:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-23d38c1e-9498-4ee3-abd8-dc1e66986e74 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "cinder-quobyte-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:06:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-23d38c1e-9498-4ee3-abd8-dc1e66986e74 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Acquiring lock "cinder-quobyte-a2f5cc6f-c397-49b6-a7ea-67bb624d70df" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:06:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-23d38c1e-9498-4ee3-abd8-dc1e66986e74 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "cinder-quobyte-a2f5cc6f-c397-49b6-a7ea-67bb624d70df" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:06:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-23d38c1e-9498-4ee3-abd8-dc1e66986e74 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Deleting offline snapshot a2f5cc6f-c397-49b6-a7ea-67bb624d70df of volume 4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:06:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-23d38c1e-9498-4ee3-abd8-dc1e66986e74 tempest-CreateVolumesFromSnapshotTest-1799284639 None] snapshot_file for this snap is: volume-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e.a2f5cc6f-c397-49b6-a7ea-67bb624d70df {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:06:39 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[2875222d-2eea-47e9-a147-505b8d0c8117]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:06:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-23d38c1e-9498-4ee3-abd8-dc1e66986e74 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e.a2f5cc6f-c397-49b6-a7ea-67bb624d70df {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:39 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-d152116d-5f91-4dc5-8b40-8eeb8174607b tempest-VolumeDependencyTests-1874592473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:06:39 devstack sudo[107555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e.a2f5cc6f-c397-49b6-a7ea-67bb624d70df Sep 28 12:06:39 devstack sudo[107555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:39 devstack sudo[107552]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d152116d-5f91-4dc5-8b40-8eeb8174607b tempest-VolumeDependencyTests-1874592473 None] Flow 'volume_create_manager' (252384ba-a66b-482f-bad6-57076621b90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:06:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d152116d-5f91-4dc5-8b40-8eeb8174607b tempest-VolumeDependencyTests-1874592473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd28b405-c15b-4d26-a80e-7b386c71dafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cfddf57c-b90b-450b-8b52-7c33abd09963 tempest-CreateVolumesFromSnapshotTest-1799284639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.455s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:39 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-cfddf57c-b90b-450b-8b52-7c33abd09963 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:06:39 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-cfddf57c-b90b-450b-8b52-7c33abd09963 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Deleted volume successfully. Sep 28 12:06:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d152116d-5f91-4dc5-8b40-8eeb8174607b tempest-VolumeDependencyTests-1874592473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd28b405-c15b-4d26-a80e-7b386c71dafb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-709449410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f664a47-4ffd-41a1-b0ba-65fd3dbd6887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5510e71a30034fe9a3e5861d17061b5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=965060c4-362a-4426-9758-31c62fe99ab5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:06:40Z,use_quota=True,user_id='d7e7f07f601d40519c9b7df94d2959f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d152116d-5f91-4dc5-8b40-8eeb8174607b tempest-VolumeDependencyTests-1874592473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (704d77b3-31d1-4a12-a755-4b7ec2d99f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d152116d-5f91-4dc5-8b40-8eeb8174607b tempest-VolumeDependencyTests-1874592473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (704d77b3-31d1-4a12-a755-4b7ec2d99f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d152116d-5f91-4dc5-8b40-8eeb8174607b tempest-VolumeDependencyTests-1874592473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbec7174-ed2e-408c-a0b9-14d9f60d49dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d152116d-5f91-4dc5-8b40-8eeb8174607b tempest-VolumeDependencyTests-1874592473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbec7174-ed2e-408c-a0b9-14d9f60d49dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5f664a47-4ffd-41a1-b0ba-65fd3dbd6887', 'volume_name': 'volume-5f664a47-4ffd-41a1-b0ba-65fd3dbd6887', 'volume_size': 1, 'snapshot_id': '965060c4-362a-4426-9758-31c62fe99ab5'}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d152116d-5f91-4dc5-8b40-8eeb8174607b tempest-VolumeDependencyTests-1874592473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3405777-90fd-4010-adc1-3b294bb0cdc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d152116d-5f91-4dc5-8b40-8eeb8174607b tempest-VolumeDependencyTests-1874592473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3405777-90fd-4010-adc1-3b294bb0cdc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d152116d-5f91-4dc5-8b40-8eeb8174607b tempest-VolumeDependencyTests-1874592473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8830c289-906a-4d0e-a2bf-956d049d7e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:39 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-d152116d-5f91-4dc5-8b40-8eeb8174607b tempest-VolumeDependencyTests-1874592473 None] Volume 5f664a47-4ffd-41a1-b0ba-65fd3dbd6887: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5f664a47-4ffd-41a1-b0ba-65fd3dbd6887', 'volume_size': 1, 'snapshot_id': '965060c4-362a-4426-9758-31c62fe99ab5'} Sep 28 12:06:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d152116d-5f91-4dc5-8b40-8eeb8174607b tempest-VolumeDependencyTests-1874592473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:39 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-cfddf57c-b90b-450b-8b52-7c33abd09963 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "cinder-b406d0c7-be83-4a5b-bf4c-1f17cd291b1a-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:06:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b421d306-48e0-4ecc-9a25-d59b947846b5 tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-47a361c4-ee8f-43f2-bbd6-217a88098933,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-47a361c4-ee8f-43f2-bbd6-217a88098933.231e4a71-7ad7-4f94-aae8-4debbf5e655f 1G" returned: 0 in 0.610s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b421d306-48e0-4ecc-9a25-d59b947846b5 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47a361c4-ee8f-43f2-bbd6-217a88098933 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-47a361c4-ee8f-43f2-bbd6-217a88098933.231e4a71-7ad7-4f94-aae8-4debbf5e655f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:39 devstack sudo[107562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47a361c4-ee8f-43f2-bbd6-217a88098933 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-47a361c4-ee8f-43f2-bbd6-217a88098933.231e4a71-7ad7-4f94-aae8-4debbf5e655f Sep 28 12:06:39 devstack sudo[107562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:40 devstack sudo[107555]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-23d38c1e-9498-4ee3-abd8-dc1e66986e74 tempest-CreateVolumesFromSnapshotTest-1799284639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e.a2f5cc6f-c397-49b6-a7ea-67bb624d70df" returned: 0 in 0.460s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-23d38c1e-9498-4ee3-abd8-dc1e66986e74 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:06:40 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9f006a-ebd5-4af8-802f-58e1f3a25767]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:06:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-23d38c1e-9498-4ee3-abd8-dc1e66986e74 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:40 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e Sep 28 12:06:40 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:40 devstack sudo[107562]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b421d306-48e0-4ecc-9a25-d59b947846b5 tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47a361c4-ee8f-43f2-bbd6-217a88098933 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-47a361c4-ee8f-43f2-bbd6-217a88098933.231e4a71-7ad7-4f94-aae8-4debbf5e655f" returned: 0 in 0.332s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:40 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-b421d306-48e0-4ecc-9a25-d59b947846b5 tempest-ProjectMemberTests-1312558137 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-47a361c4-ee8f-43f2-bbd6-217a88098933.231e4a71-7ad7-4f94-aae8-4debbf5e655f is being set with open permissions: ugo+rw Sep 28 12:06:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b421d306-48e0-4ecc-9a25-d59b947846b5 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-47a361c4-ee8f-43f2-bbd6-217a88098933.231e4a71-7ad7-4f94-aae8-4debbf5e655f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:40 devstack sudo[107573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-47a361c4-ee8f-43f2-bbd6-217a88098933.231e4a71-7ad7-4f94-aae8-4debbf5e655f Sep 28 12:06:40 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:40 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-23d38c1e-9498-4ee3-abd8-dc1e66986e74 tempest-CreateVolumesFromSnapshotTest-1799284639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e" returned: 0 in 0.395s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-23d38c1e-9498-4ee3-abd8-dc1e66986e74 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e.a2f5cc6f-c397-49b6-a7ea-67bb624d70df {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:40 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b421d306-48e0-4ecc-9a25-d59b947846b5 tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-47a361c4-ee8f-43f2-bbd6-217a88098933.231e4a71-7ad7-4f94-aae8-4debbf5e655f" returned: 0 in 0.255s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:40 devstack sudo[107580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e.a2f5cc6f-c397-49b6-a7ea-67bb624d70df Sep 28 12:06:40 devstack sudo[107580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b421d306-48e0-4ecc-9a25-d59b947846b5 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-47a361c4-ee8f-43f2-bbd6-217a88098933.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:40 devstack sudo[107582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-47a361c4-ee8f-43f2-bbd6-217a88098933.info Sep 28 12:06:40 devstack sudo[107582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:40 devstack sudo[107582]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b421d306-48e0-4ecc-9a25-d59b947846b5 tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-47a361c4-ee8f-43f2-bbd6-217a88098933.info" returned: 0 in 0.267s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:40 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-b421d306-48e0-4ecc-9a25-d59b947846b5 tempest-ProjectMemberTests-1312558137 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-47a361c4-ee8f-43f2-bbd6-217a88098933.info is being set with open permissions: ugo+rw Sep 28 12:06:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b421d306-48e0-4ecc-9a25-d59b947846b5 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-47a361c4-ee8f-43f2-bbd6-217a88098933.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:40 devstack sudo[107588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-47a361c4-ee8f-43f2-bbd6-217a88098933.info Sep 28 12:06:40 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:40 devstack sudo[107580]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-23d38c1e-9498-4ee3-abd8-dc1e66986e74 tempest-CreateVolumesFromSnapshotTest-1799284639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e.a2f5cc6f-c397-49b6-a7ea-67bb624d70df" returned: 0 in 0.346s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-23d38c1e-9498-4ee3-abd8-dc1e66986e74 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e.a2f5cc6f-c397-49b6-a7ea-67bb624d70df {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:40 devstack sudo[107590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e.a2f5cc6f-c397-49b6-a7ea-67bb624d70df Sep 28 12:06:40 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:41 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b421d306-48e0-4ecc-9a25-d59b947846b5 tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-47a361c4-ee8f-43f2-bbd6-217a88098933.info" returned: 0 in 0.244s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b421d306-48e0-4ecc-9a25-d59b947846b5 tempest-ProjectMemberTests-1312558137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.327s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-88b30873-19d5-49ea-abed-516b64678bf5 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.046s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-88b30873-19d5-49ea-abed-516b64678bf5 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1894853010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=212c1da5-6f2e-4221-81af-9ec108c83607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c286b74f89db450ba3d48c0f90e44784',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:06:37Z,use_quota=True,user_id='bc14d5f27eee4a6d8ebe2e88b779241f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:06:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-88b30873-19d5-49ea-abed-516b64678bf5 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Creating volume 212c1da5-6f2e-4221-81af-9ec108c83607 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:06:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-88b30873-19d5-49ea-abed-516b64678bf5 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-88b30873-19d5-49ea-abed-516b64678bf5 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-88b30873-19d5-49ea-abed-516b64678bf5 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:06:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-88b30873-19d5-49ea-abed-516b64678bf5 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:06:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-88b30873-19d5-49ea-abed-516b64678bf5 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-88b30873-19d5-49ea-abed-516b64678bf5 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:06:41 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-88b30873-19d5-49ea-abed-516b64678bf5 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:06:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-88b30873-19d5-49ea-abed-516b64678bf5 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-212c1da5-6f2e-4221-81af-9ec108c83607 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:41 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-23d38c1e-9498-4ee3-abd8-dc1e66986e74 tempest-CreateVolumesFromSnapshotTest-1799284639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e.a2f5cc6f-c397-49b6-a7ea-67bb624d70df" returned: 0 in 0.257s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:41 devstack sudo[107594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-212c1da5-6f2e-4221-81af-9ec108c83607 1073741824 Sep 28 12:06:41 devstack sudo[107594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:41 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b421d306-48e0-4ecc-9a25-d59b947846b5 tempest-ProjectMemberTests-1312558137 None] Create snapshot completed successfully Sep 28 12:06:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-23d38c1e-9498-4ee3-abd8-dc1e66986e74 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "cinder-quobyte-a2f5cc6f-c397-49b6-a7ea-67bb624d70df" released by "_delete_snapshot" :: held 1.644s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:06:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-23d38c1e-9498-4ee3-abd8-dc1e66986e74 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "cinder-quobyte-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e" released by "delete_snapshot" :: held 1.683s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:06:41 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-23d38c1e-9498-4ee3-abd8-dc1e66986e74 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Created reservations ['3772edf2-5471-4101-b48d-d8f2c94479cf', '0a79ffd2-e18b-487b-9cf6-a5ce5c4d1ad0', '9c246347-f8e7-4a13-8abb-2d6308dc25f0', '55d535aa-ffd6-4772-a0ba-e21be6ddd554'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:06:41 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-23d38c1e-9498-4ee3-abd8-dc1e66986e74 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Delete snapshot completed successfully. Sep 28 12:06:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-23d38c1e-9498-4ee3-abd8-dc1e66986e74 tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "cinder-a2f5cc6f-c397-49b6-a7ea-67bb624d70df-delete_snapshot" released by "delete_snapshot" :: held 1.883s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:06:41 devstack sudo[107594]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-88b30873-19d5-49ea-abed-516b64678bf5 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-212c1da5-6f2e-4221-81af-9ec108c83607 1073741824" returned: 0 in 0.435s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-88b30873-19d5-49ea-abed-516b64678bf5 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-212c1da5-6f2e-4221-81af-9ec108c83607 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a41c8317-819f-47d0-8351-d62f309bc7bd tempest-CreateVolumesFromSnapshotTest-1799284639 None] Acquiring lock "cinder-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:06:41 devstack sudo[107600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-212c1da5-6f2e-4221-81af-9ec108c83607 Sep 28 12:06:41 devstack sudo[107600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a41c8317-819f-47d0-8351-d62f309bc7bd tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "cinder-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:06:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a41c8317-819f-47d0-8351-d62f309bc7bd tempest-CreateVolumesFromSnapshotTest-1799284639 None] Acquiring lock "cinder-quobyte-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:06:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a41c8317-819f-47d0-8351-d62f309bc7bd tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "cinder-quobyte-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e" acquired by "delete_volume" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:06:41 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc4f07f-0b34-4ffa-a6c3-db79c67c420a]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:06:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a41c8317-819f-47d0-8351-d62f309bc7bd tempest-CreateVolumesFromSnapshotTest-1799284639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-31ff7ee7-79a5-42e6-9a5a-9e659b471226 tempest-ProjectMemberTests-1312558137 None] Acquiring lock "cinder-231e4a71-7ad7-4f94-aae8-4debbf5e655f-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:06:41 devstack sudo[107600]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-88b30873-19d5-49ea-abed-516b64678bf5 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-212c1da5-6f2e-4221-81af-9ec108c83607" returned: 0 in 0.278s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-88b30873-19d5-49ea-abed-516b64678bf5 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:06:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-88b30873-19d5-49ea-abed-516b64678bf5 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-31ff7ee7-79a5-42e6-9a5a-9e659b471226 tempest-ProjectMemberTests-1312558137 None] Lock "cinder-231e4a71-7ad7-4f94-aae8-4debbf5e655f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:06:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-31ff7ee7-79a5-42e6-9a5a-9e659b471226 tempest-ProjectMemberTests-1312558137 None] Acquiring lock "cinder-quobyte-47a361c4-ee8f-43f2-bbd6-217a88098933" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:06:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ede58024-de7b-47d0-8e90-069bb9bafaf0 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.514s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:41 devstack sudo[107602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e Sep 28 12:06:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ede58024-de7b-47d0-8e90-069bb9bafaf0 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1995209522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a7ca908-f2de-4a27-bf4c-b488c203f1b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c286b74f89db450ba3d48c0f90e44784',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:06:37Z,use_quota=True,user_id='bc14d5f27eee4a6d8ebe2e88b779241f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:06:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-ede58024-de7b-47d0-8e90-069bb9bafaf0 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Creating volume 8a7ca908-f2de-4a27-bf4c-b488c203f1b6 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:06:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ede58024-de7b-47d0-8e90-069bb9bafaf0 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ede58024-de7b-47d0-8e90-069bb9bafaf0 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ede58024-de7b-47d0-8e90-069bb9bafaf0 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:06:41 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ede58024-de7b-47d0-8e90-069bb9bafaf0 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:06:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ede58024-de7b-47d0-8e90-069bb9bafaf0 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ede58024-de7b-47d0-8e90-069bb9bafaf0 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:06:41 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-ede58024-de7b-47d0-8e90-069bb9bafaf0 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:06:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ede58024-de7b-47d0-8e90-069bb9bafaf0 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8a7ca908-f2de-4a27-bf4c-b488c203f1b6 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-88b30873-19d5-49ea-abed-516b64678bf5 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4499ef8-7d3f-4f4c-850c-b25f1c4f641e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-212c1da5-6f2e-4221-81af-9ec108c83607', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:41 devstack sudo[107605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8a7ca908-f2de-4a27-bf4c-b488c203f1b6 1073741824 Sep 28 12:06:41 devstack sudo[107605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-88b30873-19d5-49ea-abed-516b64678bf5 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b71797de-2be6-4fe9-bd39-7b59da201c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-31ff7ee7-79a5-42e6-9a5a-9e659b471226 tempest-ProjectMemberTests-1312558137 None] Lock "cinder-quobyte-47a361c4-ee8f-43f2-bbd6-217a88098933" acquired by "delete_snapshot" :: waited 0.055s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:06:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-31ff7ee7-79a5-42e6-9a5a-9e659b471226 tempest-ProjectMemberTests-1312558137 None] Acquiring lock "cinder-quobyte-231e4a71-7ad7-4f94-aae8-4debbf5e655f" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:06:41 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-88b30873-19d5-49ea-abed-516b64678bf5 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Volume volume-212c1da5-6f2e-4221-81af-9ec108c83607 (212c1da5-6f2e-4221-81af-9ec108c83607): created successfully Sep 28 12:06:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-88b30873-19d5-49ea-abed-516b64678bf5 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b71797de-2be6-4fe9-bd39-7b59da201c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-88b30873-19d5-49ea-abed-516b64678bf5 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Flow 'volume_create_manager' (a71a7ff3-24a3-4fe2-b8ec-64f728bc177c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:06:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-31ff7ee7-79a5-42e6-9a5a-9e659b471226 tempest-ProjectMemberTests-1312558137 None] Lock "cinder-quobyte-231e4a71-7ad7-4f94-aae8-4debbf5e655f" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:06:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-31ff7ee7-79a5-42e6-9a5a-9e659b471226 tempest-ProjectMemberTests-1312558137 None] Deleting offline snapshot 231e4a71-7ad7-4f94-aae8-4debbf5e655f of volume 47a361c4-ee8f-43f2-bbd6-217a88098933 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:06:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-31ff7ee7-79a5-42e6-9a5a-9e659b471226 tempest-ProjectMemberTests-1312558137 None] snapshot_file for this snap is: volume-47a361c4-ee8f-43f2-bbd6-217a88098933.231e4a71-7ad7-4f94-aae8-4debbf5e655f {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:06:41 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-88b30873-19d5-49ea-abed-516b64678bf5 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Created volume successfully. Sep 28 12:06:41 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0a12f1-882d-4b08-b86b-8293af1a902c]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:06:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-31ff7ee7-79a5-42e6-9a5a-9e659b471226 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-47a361c4-ee8f-43f2-bbd6-217a88098933.231e4a71-7ad7-4f94-aae8-4debbf5e655f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:42 devstack sudo[107607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-47a361c4-ee8f-43f2-bbd6-217a88098933.231e4a71-7ad7-4f94-aae8-4debbf5e655f Sep 28 12:06:42 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:42 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a41c8317-819f-47d0-8351-d62f309bc7bd tempest-CreateVolumesFromSnapshotTest-1799284639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e" returned: 0 in 0.393s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a41c8317-819f-47d0-8351-d62f309bc7bd tempest-CreateVolumesFromSnapshotTest-1799284639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:42 devstack sudo[107614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e Sep 28 12:06:42 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:42 devstack sudo[107605]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ede58024-de7b-47d0-8e90-069bb9bafaf0 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8a7ca908-f2de-4a27-bf4c-b488c203f1b6 1073741824" returned: 0 in 0.498s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:42 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-31ff7ee7-79a5-42e6-9a5a-9e659b471226 tempest-ProjectMemberTests-1312558137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-47a361c4-ee8f-43f2-bbd6-217a88098933.231e4a71-7ad7-4f94-aae8-4debbf5e655f" returned: 0 in 0.412s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-31ff7ee7-79a5-42e6-9a5a-9e659b471226 tempest-ProjectMemberTests-1312558137 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47a361c4-ee8f-43f2-bbd6-217a88098933(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:06:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ede58024-de7b-47d0-8e90-069bb9bafaf0 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8a7ca908-f2de-4a27-bf4c-b488c203f1b6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:42 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:42 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9623eeb-c5d9-4951-b2bf-3a2cf5d71e67]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:06:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-31ff7ee7-79a5-42e6-9a5a-9e659b471226 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-47a361c4-ee8f-43f2-bbd6-217a88098933 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a41c8317-819f-47d0-8351-d62f309bc7bd tempest-CreateVolumesFromSnapshotTest-1799284639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e" returned: 0 in 0.319s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:42 devstack sudo[107622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8a7ca908-f2de-4a27-bf4c-b488c203f1b6 Sep 28 12:06:42 devstack sudo[107622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:42 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a41c8317-819f-47d0-8351-d62f309bc7bd tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "cinder-quobyte-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e" released by "delete_volume" :: held 0.800s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:06:42 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-a41c8317-819f-47d0-8351-d62f309bc7bd tempest-CreateVolumesFromSnapshotTest-1799284639 None] Created reservations ['2d8c2a73-2d82-4cb3-a63d-6ea826c8e684', '53f9ab9c-8f6b-4360-adcc-38bdc05e178b', '87ec5b2c-9d3a-4111-ab05-1dbc6f8c9b94', '40f66b6b-f553-419e-9d38-8f21f2ca3260'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:06:42 devstack sudo[107623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-47a361c4-ee8f-43f2-bbd6-217a88098933 Sep 28 12:06:42 devstack sudo[107623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a41c8317-819f-47d0-8351-d62f309bc7bd tempest-CreateVolumesFromSnapshotTest-1799284639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a41c8317-819f-47d0-8351-d62f309bc7bd tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a41c8317-819f-47d0-8351-d62f309bc7bd tempest-CreateVolumesFromSnapshotTest-1799284639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:06:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a41c8317-819f-47d0-8351-d62f309bc7bd tempest-CreateVolumesFromSnapshotTest-1799284639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:06:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a41c8317-819f-47d0-8351-d62f309bc7bd tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a41c8317-819f-47d0-8351-d62f309bc7bd tempest-CreateVolumesFromSnapshotTest-1799284639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:42 devstack sudo[107627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:06:42 devstack sudo[107627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:42 devstack sudo[107622]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ede58024-de7b-47d0-8e90-069bb9bafaf0 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8a7ca908-f2de-4a27-bf4c-b488c203f1b6" returned: 0 in 0.306s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ede58024-de7b-47d0-8e90-069bb9bafaf0 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:06:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ede58024-de7b-47d0-8e90-069bb9bafaf0 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c0bcb370-dd16-418b-b6c6-b2b8fe0bd484 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.859s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c0bcb370-dd16-418b-b6c6-b2b8fe0bd484 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1773579669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ab38c01-f7a5-4b5e-b23d-e81c03ab798f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c286b74f89db450ba3d48c0f90e44784',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:06:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:06:38Z,use_quota=True,user_id='bc14d5f27eee4a6d8ebe2e88b779241f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:06:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-c0bcb370-dd16-418b-b6c6-b2b8fe0bd484 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Creating volume 1ab38c01-f7a5-4b5e-b23d-e81c03ab798f {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:06:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c0bcb370-dd16-418b-b6c6-b2b8fe0bd484 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c0bcb370-dd16-418b-b6c6-b2b8fe0bd484 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c0bcb370-dd16-418b-b6c6-b2b8fe0bd484 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:06:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c0bcb370-dd16-418b-b6c6-b2b8fe0bd484 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:06:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c0bcb370-dd16-418b-b6c6-b2b8fe0bd484 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c0bcb370-dd16-418b-b6c6-b2b8fe0bd484 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:06:42 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-c0bcb370-dd16-418b-b6c6-b2b8fe0bd484 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:06:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c0bcb370-dd16-418b-b6c6-b2b8fe0bd484 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1ab38c01-f7a5-4b5e-b23d-e81c03ab798f 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:42 devstack sudo[107632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1ab38c01-f7a5-4b5e-b23d-e81c03ab798f 1073741824 Sep 28 12:06:42 devstack sudo[107632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ede58024-de7b-47d0-8e90-069bb9bafaf0 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff371e59-4e14-4acd-b8ab-273cb325fed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a7ca908-f2de-4a27-bf4c-b488c203f1b6', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ede58024-de7b-47d0-8e90-069bb9bafaf0 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e088606b-745a-489a-8b75-8f0f7c970a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:42 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-ede58024-de7b-47d0-8e90-069bb9bafaf0 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Volume volume-8a7ca908-f2de-4a27-bf4c-b488c203f1b6 (8a7ca908-f2de-4a27-bf4c-b488c203f1b6): created successfully Sep 28 12:06:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ede58024-de7b-47d0-8e90-069bb9bafaf0 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e088606b-745a-489a-8b75-8f0f7c970a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ede58024-de7b-47d0-8e90-069bb9bafaf0 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Flow 'volume_create_manager' (94484b39-eb8d-4ba9-9248-08460c9a8d6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:06:42 devstack sudo[107623]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-31ff7ee7-79a5-42e6-9a5a-9e659b471226 tempest-ProjectMemberTests-1312558137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-47a361c4-ee8f-43f2-bbd6-217a88098933" returned: 0 in 0.488s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-31ff7ee7-79a5-42e6-9a5a-9e659b471226 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-47a361c4-ee8f-43f2-bbd6-217a88098933.231e4a71-7ad7-4f94-aae8-4debbf5e655f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:42 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-ede58024-de7b-47d0-8e90-069bb9bafaf0 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Created volume successfully. Sep 28 12:06:42 devstack sudo[107627]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:42 devstack sudo[107636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-47a361c4-ee8f-43f2-bbd6-217a88098933.231e4a71-7ad7-4f94-aae8-4debbf5e655f Sep 28 12:06:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a41c8317-819f-47d0-8351-d62f309bc7bd tempest-CreateVolumesFromSnapshotTest-1799284639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.379s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:42 devstack sudo[107636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:42 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a41c8317-819f-47d0-8351-d62f309bc7bd tempest-CreateVolumesFromSnapshotTest-1799284639 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:06:43 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-a41c8317-819f-47d0-8351-d62f309bc7bd tempest-CreateVolumesFromSnapshotTest-1799284639 None] Deleted volume successfully. Sep 28 12:06:43 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a41c8317-819f-47d0-8351-d62f309bc7bd tempest-CreateVolumesFromSnapshotTest-1799284639 None] Lock "cinder-4fb3ed4f-5223-4c2b-89b8-63e4dfb20a0e-delete_volume" released by "delete_volume" :: held 1.424s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:06:43 devstack sudo[107632]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c0bcb370-dd16-418b-b6c6-b2b8fe0bd484 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1ab38c01-f7a5-4b5e-b23d-e81c03ab798f 1073741824" returned: 0 in 0.601s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:43 devstack sudo[107636]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-31ff7ee7-79a5-42e6-9a5a-9e659b471226 tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-47a361c4-ee8f-43f2-bbd6-217a88098933.231e4a71-7ad7-4f94-aae8-4debbf5e655f" returned: 0 in 0.460s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-31ff7ee7-79a5-42e6-9a5a-9e659b471226 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-47a361c4-ee8f-43f2-bbd6-217a88098933.231e4a71-7ad7-4f94-aae8-4debbf5e655f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c0bcb370-dd16-418b-b6c6-b2b8fe0bd484 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1ab38c01-f7a5-4b5e-b23d-e81c03ab798f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:43 devstack sudo[107645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-47a361c4-ee8f-43f2-bbd6-217a88098933.231e4a71-7ad7-4f94-aae8-4debbf5e655f Sep 28 12:06:43 devstack sudo[107645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:43 devstack sudo[107647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1ab38c01-f7a5-4b5e-b23d-e81c03ab798f Sep 28 12:06:43 devstack sudo[107647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:43 devstack sudo[107645]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-31ff7ee7-79a5-42e6-9a5a-9e659b471226 tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-47a361c4-ee8f-43f2-bbd6-217a88098933.231e4a71-7ad7-4f94-aae8-4debbf5e655f" returned: 0 in 0.304s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:43 devstack sudo[107647]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c0bcb370-dd16-418b-b6c6-b2b8fe0bd484 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1ab38c01-f7a5-4b5e-b23d-e81c03ab798f" returned: 0 in 0.320s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c0bcb370-dd16-418b-b6c6-b2b8fe0bd484 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:06:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c0bcb370-dd16-418b-b6c6-b2b8fe0bd484 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:43 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-31ff7ee7-79a5-42e6-9a5a-9e659b471226 tempest-ProjectMemberTests-1312558137 None] Lock "cinder-quobyte-231e4a71-7ad7-4f94-aae8-4debbf5e655f" released by "_delete_snapshot" :: held 1.809s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:06:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6ab877f3-6f80-4570-96aa-5d697f3bc656 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.381s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6ab877f3-6f80-4570-96aa-5d697f3bc656 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:06:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-241138711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15b75dae-a145-4bb5-954c-ead21d1080db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c286b74f89db450ba3d48c0f90e44784',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:06:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:06:38Z,use_quota=True,user_id='bc14d5f27eee4a6d8ebe2e88b779241f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:06:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-6ab877f3-6f80-4570-96aa-5d697f3bc656 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Creating volume 15b75dae-a145-4bb5-954c-ead21d1080db {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:06:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6ab877f3-6f80-4570-96aa-5d697f3bc656 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6ab877f3-6f80-4570-96aa-5d697f3bc656 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6ab877f3-6f80-4570-96aa-5d697f3bc656 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:06:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6ab877f3-6f80-4570-96aa-5d697f3bc656 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:06:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6ab877f3-6f80-4570-96aa-5d697f3bc656 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6ab877f3-6f80-4570-96aa-5d697f3bc656 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:06:43 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-6ab877f3-6f80-4570-96aa-5d697f3bc656 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:06:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6ab877f3-6f80-4570-96aa-5d697f3bc656 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-15b75dae-a145-4bb5-954c-ead21d1080db 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:43 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-31ff7ee7-79a5-42e6-9a5a-9e659b471226 tempest-ProjectMemberTests-1312558137 None] Lock "cinder-quobyte-47a361c4-ee8f-43f2-bbd6-217a88098933" released by "delete_snapshot" :: held 1.875s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:06:43 devstack sudo[107651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-15b75dae-a145-4bb5-954c-ead21d1080db 1073741824 Sep 28 12:06:43 devstack sudo[107651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c0bcb370-dd16-418b-b6c6-b2b8fe0bd484 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1634ac09-aff8-415e-a594-c02425f29071) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ab38c01-f7a5-4b5e-b23d-e81c03ab798f', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c0bcb370-dd16-418b-b6c6-b2b8fe0bd484 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40d06a8a-4a1d-48a6-a9ca-0ed9cd304037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:43 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-c0bcb370-dd16-418b-b6c6-b2b8fe0bd484 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Volume volume-1ab38c01-f7a5-4b5e-b23d-e81c03ab798f (1ab38c01-f7a5-4b5e-b23d-e81c03ab798f): created successfully Sep 28 12:06:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c0bcb370-dd16-418b-b6c6-b2b8fe0bd484 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40d06a8a-4a1d-48a6-a9ca-0ed9cd304037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c0bcb370-dd16-418b-b6c6-b2b8fe0bd484 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Flow 'volume_create_manager' (7d543f5e-b1c1-4fbb-946d-b0fa44c9a69c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:06:43 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-c0bcb370-dd16-418b-b6c6-b2b8fe0bd484 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Created volume successfully. Sep 28 12:06:43 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-31ff7ee7-79a5-42e6-9a5a-9e659b471226 tempest-ProjectMemberTests-1312558137 None] Created reservations ['711d6f0e-5359-4d43-b8e0-bf56b2fcea4b', '8ad2dc0c-7d93-40e1-b541-6ac37c07125b', '7506577f-e538-474f-8991-17650e2a357d', '49bae4df-4b30-41e9-9f81-2b0d2985ac88'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:06:43 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-31ff7ee7-79a5-42e6-9a5a-9e659b471226 tempest-ProjectMemberTests-1312558137 None] Delete snapshot completed successfully. Sep 28 12:06:43 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-31ff7ee7-79a5-42e6-9a5a-9e659b471226 tempest-ProjectMemberTests-1312558137 None] Lock "cinder-231e4a71-7ad7-4f94-aae8-4debbf5e655f-delete_snapshot" released by "delete_snapshot" :: held 2.122s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:06:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7b1c3be6-a5cb-4ad7-88ae-ca11b1479cf6 tempest-ProjectMemberTests-1312558137 None] Acquiring lock "cinder-47a361c4-ee8f-43f2-bbd6-217a88098933-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:06:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7b1c3be6-a5cb-4ad7-88ae-ca11b1479cf6 tempest-ProjectMemberTests-1312558137 None] Lock "cinder-47a361c4-ee8f-43f2-bbd6-217a88098933-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:06:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7b1c3be6-a5cb-4ad7-88ae-ca11b1479cf6 tempest-ProjectMemberTests-1312558137 None] Acquiring lock "cinder-quobyte-47a361c4-ee8f-43f2-bbd6-217a88098933" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:06:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7b1c3be6-a5cb-4ad7-88ae-ca11b1479cf6 tempest-ProjectMemberTests-1312558137 None] Lock "cinder-quobyte-47a361c4-ee8f-43f2-bbd6-217a88098933" acquired by "delete_volume" :: waited 0.027s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:06:44 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e536eba-f480-46d7-8061-c4bb91a4e9b0]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:06:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7b1c3be6-a5cb-4ad7-88ae-ca11b1479cf6 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-47a361c4-ee8f-43f2-bbd6-217a88098933 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:44 devstack sudo[107651]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6ab877f3-6f80-4570-96aa-5d697f3bc656 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-15b75dae-a145-4bb5-954c-ead21d1080db 1073741824" returned: 0 in 0.593s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6ab877f3-6f80-4570-96aa-5d697f3bc656 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-15b75dae-a145-4bb5-954c-ead21d1080db {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:44 devstack sudo[107657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-47a361c4-ee8f-43f2-bbd6-217a88098933 Sep 28 12:06:44 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:44 devstack sudo[107658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-15b75dae-a145-4bb5-954c-ead21d1080db Sep 28 12:06:44 devstack sudo[107658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:44 devstack sudo[107658]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6ab877f3-6f80-4570-96aa-5d697f3bc656 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-15b75dae-a145-4bb5-954c-ead21d1080db" returned: 0 in 0.283s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:44 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6ab877f3-6f80-4570-96aa-5d697f3bc656 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:06:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6ab877f3-6f80-4570-96aa-5d697f3bc656 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ded09ad7-a8be-49d2-9934-08e7815b6ed4 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.855s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:44 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ded09ad7-a8be-49d2-9934-08e7815b6ed4 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:06:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1939592671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28ea4a9e-14a4-4cf6-b58b-a1899f392a33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c286b74f89db450ba3d48c0f90e44784',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:06:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:06:39Z,use_quota=True,user_id='bc14d5f27eee4a6d8ebe2e88b779241f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:06:44 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-ded09ad7-a8be-49d2-9934-08e7815b6ed4 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Creating volume 28ea4a9e-14a4-4cf6-b58b-a1899f392a33 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:06:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ded09ad7-a8be-49d2-9934-08e7815b6ed4 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ded09ad7-a8be-49d2-9934-08e7815b6ed4 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:44 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:44 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ded09ad7-a8be-49d2-9934-08e7815b6ed4 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:06:44 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ded09ad7-a8be-49d2-9934-08e7815b6ed4 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:06:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ded09ad7-a8be-49d2-9934-08e7815b6ed4 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:44 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ded09ad7-a8be-49d2-9934-08e7815b6ed4 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:06:44 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-ded09ad7-a8be-49d2-9934-08e7815b6ed4 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:06:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ded09ad7-a8be-49d2-9934-08e7815b6ed4 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-28ea4a9e-14a4-4cf6-b58b-a1899f392a33 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7b1c3be6-a5cb-4ad7-88ae-ca11b1479cf6 tempest-ProjectMemberTests-1312558137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-47a361c4-ee8f-43f2-bbd6-217a88098933" returned: 0 in 0.411s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7b1c3be6-a5cb-4ad7-88ae-ca11b1479cf6 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-47a361c4-ee8f-43f2-bbd6-217a88098933 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:44 devstack sudo[107665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-28ea4a9e-14a4-4cf6-b58b-a1899f392a33 1073741824 Sep 28 12:06:44 devstack sudo[107665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:44 devstack sudo[107666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-47a361c4-ee8f-43f2-bbd6-217a88098933 Sep 28 12:06:44 devstack sudo[107666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6ab877f3-6f80-4570-96aa-5d697f3bc656 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de5f93cb-5093-4317-8b49-6bc633b1f985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15b75dae-a145-4bb5-954c-ead21d1080db', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6ab877f3-6f80-4570-96aa-5d697f3bc656 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a6b9e22-92d3-43f3-a2f7-210229f8fc48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:44 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-6ab877f3-6f80-4570-96aa-5d697f3bc656 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Volume volume-15b75dae-a145-4bb5-954c-ead21d1080db (15b75dae-a145-4bb5-954c-ead21d1080db): created successfully Sep 28 12:06:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6ab877f3-6f80-4570-96aa-5d697f3bc656 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a6b9e22-92d3-43f3-a2f7-210229f8fc48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6ab877f3-6f80-4570-96aa-5d697f3bc656 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Flow 'volume_create_manager' (82c08641-2857-4de9-844e-a3bd2b672098) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:06:44 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-6ab877f3-6f80-4570-96aa-5d697f3bc656 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Created volume successfully. Sep 28 12:06:45 devstack sudo[107666]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7b1c3be6-a5cb-4ad7-88ae-ca11b1479cf6 tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-47a361c4-ee8f-43f2-bbd6-217a88098933" returned: 0 in 0.299s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:45 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7b1c3be6-a5cb-4ad7-88ae-ca11b1479cf6 tempest-ProjectMemberTests-1312558137 None] Lock "cinder-quobyte-47a361c4-ee8f-43f2-bbd6-217a88098933" released by "delete_volume" :: held 0.806s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:06:45 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-7b1c3be6-a5cb-4ad7-88ae-ca11b1479cf6 tempest-ProjectMemberTests-1312558137 None] Created reservations ['35636732-a49c-490d-83b5-6ef13f560839', '4e6b754d-1a0d-405b-a3f0-634874aea31a', '8ef16b58-865d-49fb-91a2-290d0a6db4cd', '1ca14fdc-55c6-4cb9-81ff-619368bb4647'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:06:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7b1c3be6-a5cb-4ad7-88ae-ca11b1479cf6 tempest-ProjectMemberTests-1312558137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7b1c3be6-a5cb-4ad7-88ae-ca11b1479cf6 tempest-ProjectMemberTests-1312558137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7b1c3be6-a5cb-4ad7-88ae-ca11b1479cf6 tempest-ProjectMemberTests-1312558137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:06:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7b1c3be6-a5cb-4ad7-88ae-ca11b1479cf6 tempest-ProjectMemberTests-1312558137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:06:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7b1c3be6-a5cb-4ad7-88ae-ca11b1479cf6 tempest-ProjectMemberTests-1312558137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7b1c3be6-a5cb-4ad7-88ae-ca11b1479cf6 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:45 devstack sudo[107674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:06:45 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:45 devstack sudo[107665]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ded09ad7-a8be-49d2-9934-08e7815b6ed4 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-28ea4a9e-14a4-4cf6-b58b-a1899f392a33 1073741824" returned: 0 in 0.544s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ded09ad7-a8be-49d2-9934-08e7815b6ed4 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-28ea4a9e-14a4-4cf6-b58b-a1899f392a33 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:45 devstack sudo[107676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-28ea4a9e-14a4-4cf6-b58b-a1899f392a33 Sep 28 12:06:45 devstack sudo[107676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:45 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7b1c3be6-a5cb-4ad7-88ae-ca11b1479cf6 tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.365s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:45 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-7b1c3be6-a5cb-4ad7-88ae-ca11b1479cf6 tempest-ProjectMemberTests-1312558137 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:06:45 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-7b1c3be6-a5cb-4ad7-88ae-ca11b1479cf6 tempest-ProjectMemberTests-1312558137 None] Deleted volume successfully. Sep 28 12:06:45 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7b1c3be6-a5cb-4ad7-88ae-ca11b1479cf6 tempest-ProjectMemberTests-1312558137 None] Lock "cinder-47a361c4-ee8f-43f2-bbd6-217a88098933-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:06:45 devstack sudo[107676]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ded09ad7-a8be-49d2-9934-08e7815b6ed4 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-28ea4a9e-14a4-4cf6-b58b-a1899f392a33" returned: 0 in 0.392s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ded09ad7-a8be-49d2-9934-08e7815b6ed4 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:06:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ded09ad7-a8be-49d2-9934-08e7815b6ed4 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d152116d-5f91-4dc5-8b40-8eeb8174607b tempest-VolumeDependencyTests-1874592473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.800s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:45 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d152116d-5f91-4dc5-8b40-8eeb8174607b tempest-VolumeDependencyTests-1874592473 None] Acquiring lock "cinder-quobyte-965060c4-362a-4426-9758-31c62fe99ab5-5f664a47-4ffd-41a1-b0ba-65fd3dbd6887" by "_create_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:06:45 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d152116d-5f91-4dc5-8b40-8eeb8174607b tempest-VolumeDependencyTests-1874592473 None] Lock "cinder-quobyte-965060c4-362a-4426-9758-31c62fe99ab5-5f664a47-4ffd-41a1-b0ba-65fd3dbd6887" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:06:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d152116d-5f91-4dc5-8b40-8eeb8174607b tempest-VolumeDependencyTests-1874592473 None] Creating volume 5f664a47-4ffd-41a1-b0ba-65fd3dbd6887 from snapshot 965060c4-362a-4426-9758-31c62fe99ab5 {{(pid=86916) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 12:06:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d152116d-5f91-4dc5-8b40-8eeb8174607b tempest-VolumeDependencyTests-1874592473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d152116d-5f91-4dc5-8b40-8eeb8174607b tempest-VolumeDependencyTests-1874592473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d152116d-5f91-4dc5-8b40-8eeb8174607b tempest-VolumeDependencyTests-1874592473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:06:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d152116d-5f91-4dc5-8b40-8eeb8174607b tempest-VolumeDependencyTests-1874592473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:06:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d152116d-5f91-4dc5-8b40-8eeb8174607b tempest-VolumeDependencyTests-1874592473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d152116d-5f91-4dc5-8b40-8eeb8174607b tempest-VolumeDependencyTests-1874592473 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:06:45 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d152116d-5f91-4dc5-8b40-8eeb8174607b tempest-VolumeDependencyTests-1874592473 None] Acquiring lock "cinder-quobyte-5f664a47-4ffd-41a1-b0ba-65fd3dbd6887" by "_copy_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:06:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ded09ad7-a8be-49d2-9934-08e7815b6ed4 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (349a53b8-9500-49b9-83ff-037b3c24b7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28ea4a9e-14a4-4cf6-b58b-a1899f392a33', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ded09ad7-a8be-49d2-9934-08e7815b6ed4 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e25f1e87-c98d-47cb-9718-54c2b195a40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:45 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-ded09ad7-a8be-49d2-9934-08e7815b6ed4 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Volume volume-28ea4a9e-14a4-4cf6-b58b-a1899f392a33 (28ea4a9e-14a4-4cf6-b58b-a1899f392a33): created successfully Sep 28 12:06:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ded09ad7-a8be-49d2-9934-08e7815b6ed4 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e25f1e87-c98d-47cb-9718-54c2b195a40a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ded09ad7-a8be-49d2-9934-08e7815b6ed4 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Flow 'volume_create_manager' (daa1dbab-c540-4652-b4dd-1403d3e20e95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:06:45 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d152116d-5f91-4dc5-8b40-8eeb8174607b tempest-VolumeDependencyTests-1874592473 None] Lock "cinder-quobyte-5f664a47-4ffd-41a1-b0ba-65fd3dbd6887" acquired by "_copy_volume_from_snapshot" :: waited 0.050s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:06:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d152116d-5f91-4dc5-8b40-8eeb8174607b tempest-VolumeDependencyTests-1874592473 None] snapshot: 965060c4-362a-4426-9758-31c62fe99ab5, volume: 5f664a47-4ffd-41a1-b0ba-65fd3dbd6887, {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 12:06:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d152116d-5f91-4dc5-8b40-8eeb8174607b tempest-VolumeDependencyTests-1874592473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d152116d-5f91-4dc5-8b40-8eeb8174607b tempest-VolumeDependencyTests-1874592473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d152116d-5f91-4dc5-8b40-8eeb8174607b tempest-VolumeDependencyTests-1874592473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:06:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d152116d-5f91-4dc5-8b40-8eeb8174607b tempest-VolumeDependencyTests-1874592473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:06:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d152116d-5f91-4dc5-8b40-8eeb8174607b tempest-VolumeDependencyTests-1874592473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:45 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-ded09ad7-a8be-49d2-9934-08e7815b6ed4 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Created volume successfully. Sep 28 12:06:45 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11abb66-fa1e-48b8-9550-bb57628091be]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:06:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d152116d-5f91-4dc5-8b40-8eeb8174607b tempest-VolumeDependencyTests-1874592473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a.965060c4-362a-4426-9758-31c62fe99ab5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:45 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-2710c87c-976c-4b65-b58b-fd708b0314a9 tempest-ProjectMemberTests-1312558137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:06:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2710c87c-976c-4b65-b58b-fd708b0314a9 tempest-ProjectMemberTests-1312558137 None] Flow 'volume_create_manager' (f84d3551-6e06-4ae8-b7a7-16769c818d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:06:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2710c87c-976c-4b65-b58b-fd708b0314a9 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecb5c828-4a95-48eb-be0a-e64b346d585f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2710c87c-976c-4b65-b58b-fd708b0314a9 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecb5c828-4a95-48eb-be0a-e64b346d585f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:06:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-539845673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bc5587f-190c-4a61-aa5a-11acfaeb8e65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba606417eb184510b6154fa1a28dce16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:06:46Z,use_quota=True,user_id='bb30da770afa465f8162e7779a473226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2710c87c-976c-4b65-b58b-fd708b0314a9 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbf7d0ff-764f-4996-8dc2-383f9dc68370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2710c87c-976c-4b65-b58b-fd708b0314a9 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbf7d0ff-764f-4996-8dc2-383f9dc68370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2710c87c-976c-4b65-b58b-fd708b0314a9 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (685a6f44-4fd2-4407-aaac-d4897d6dbeb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2710c87c-976c-4b65-b58b-fd708b0314a9 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (685a6f44-4fd2-4407-aaac-d4897d6dbeb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bc5587f-190c-4a61-aa5a-11acfaeb8e65', 'volume_name': 'volume-1bc5587f-190c-4a61-aa5a-11acfaeb8e65', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2710c87c-976c-4b65-b58b-fd708b0314a9 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3242479-eb09-495c-97c2-cc155ab4edbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2710c87c-976c-4b65-b58b-fd708b0314a9 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3242479-eb09-495c-97c2-cc155ab4edbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2710c87c-976c-4b65-b58b-fd708b0314a9 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2736e6c-c3f2-4e97-b4ee-844d231a2690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:45 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-2710c87c-976c-4b65-b58b-fd708b0314a9 tempest-ProjectMemberTests-1312558137 None] Volume 1bc5587f-190c-4a61-aa5a-11acfaeb8e65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bc5587f-190c-4a61-aa5a-11acfaeb8e65', 'volume_size': 1} Sep 28 12:06:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2710c87c-976c-4b65-b58b-fd708b0314a9 tempest-ProjectMemberTests-1312558137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:45 devstack sudo[107680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a.965060c4-362a-4426-9758-31c62fe99ab5 Sep 28 12:06:45 devstack sudo[107680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:46 devstack sudo[107680]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d152116d-5f91-4dc5-8b40-8eeb8174607b tempest-VolumeDependencyTests-1874592473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a.965060c4-362a-4426-9758-31c62fe99ab5" returned: 0 in 0.413s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-d152116d-5f91-4dc5-8b40-8eeb8174607b tempest-VolumeDependencyTests-1874592473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:06:46 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbcd9614-3a95-4088-baa9-9e24c7ae4c9a]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:06:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d152116d-5f91-4dc5-8b40-8eeb8174607b tempest-VolumeDependencyTests-1874592473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:46 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4fbef72-142f-4ee1-b6f8-07f77c04b287 tempest-CinderUnicodeTest-82330997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:06:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c4fbef72-142f-4ee1-b6f8-07f77c04b287 tempest-CinderUnicodeTest-82330997 None] Flow 'volume_create_manager' (be2bba4f-592e-4f6e-b86e-b8c65edf1258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:06:46 devstack sudo[107685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a Sep 28 12:06:46 devstack sudo[107685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c4fbef72-142f-4ee1-b6f8-07f77c04b287 tempest-CinderUnicodeTest-82330997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bf4f2dc-c406-46af-871b-268e7a858aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c4fbef72-142f-4ee1-b6f8-07f77c04b287 tempest-CinderUnicodeTest-82330997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bf4f2dc-c406-46af-871b-268e7a858aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:06:46Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60bafc7b-7dec-4ee3-9f23-df9cfe73e2d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3373e94b854b452cb8d700d79db0b6e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:06:46Z,use_quota=True,user_id='e8dc974352754f7fafc31e04a4f133e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c4fbef72-142f-4ee1-b6f8-07f77c04b287 tempest-CinderUnicodeTest-82330997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fd146f7-a485-47a2-978d-1ee8cff693f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c4fbef72-142f-4ee1-b6f8-07f77c04b287 tempest-CinderUnicodeTest-82330997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fd146f7-a485-47a2-978d-1ee8cff693f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c4fbef72-142f-4ee1-b6f8-07f77c04b287 tempest-CinderUnicodeTest-82330997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6b17d21-8cbc-4e99-b2a8-5c764dc42670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c4fbef72-142f-4ee1-b6f8-07f77c04b287 tempest-CinderUnicodeTest-82330997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6b17d21-8cbc-4e99-b2a8-5c764dc42670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60bafc7b-7dec-4ee3-9f23-df9cfe73e2d1', 'volume_name': 'volume-60bafc7b-7dec-4ee3-9f23-df9cfe73e2d1', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c4fbef72-142f-4ee1-b6f8-07f77c04b287 tempest-CinderUnicodeTest-82330997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99b4e35f-40c1-44dd-87af-46e3001c15d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c4fbef72-142f-4ee1-b6f8-07f77c04b287 tempest-CinderUnicodeTest-82330997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99b4e35f-40c1-44dd-87af-46e3001c15d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c4fbef72-142f-4ee1-b6f8-07f77c04b287 tempest-CinderUnicodeTest-82330997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd4dec4d-3740-4345-a582-538a40eae36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:46 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-c4fbef72-142f-4ee1-b6f8-07f77c04b287 tempest-CinderUnicodeTest-82330997 None] Volume 60bafc7b-7dec-4ee3-9f23-df9cfe73e2d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60bafc7b-7dec-4ee3-9f23-df9cfe73e2d1', 'volume_size': 1} Sep 28 12:06:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c4fbef72-142f-4ee1-b6f8-07f77c04b287 tempest-CinderUnicodeTest-82330997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b6ca2a24-bb78-419c-b13d-34216e7b55f5 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Acquiring lock "cinder-28ea4a9e-14a4-4cf6-b58b-a1899f392a33-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:06:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b6ca2a24-bb78-419c-b13d-34216e7b55f5 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Lock "cinder-28ea4a9e-14a4-4cf6-b58b-a1899f392a33-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:06:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b6ca2a24-bb78-419c-b13d-34216e7b55f5 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Acquiring lock "cinder-quobyte-28ea4a9e-14a4-4cf6-b58b-a1899f392a33" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:06:46 devstack sudo[107685]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b6ca2a24-bb78-419c-b13d-34216e7b55f5 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Lock "cinder-quobyte-28ea4a9e-14a4-4cf6-b58b-a1899f392a33" acquired by "delete_volume" :: waited 0.013s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:06:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d152116d-5f91-4dc5-8b40-8eeb8174607b tempest-VolumeDependencyTests-1874592473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a" returned: 0 in 0.415s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d152116d-5f91-4dc5-8b40-8eeb8174607b tempest-VolumeDependencyTests-1874592473 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 12:06:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d152116d-5f91-4dc5-8b40-8eeb8174607b tempest-VolumeDependencyTests-1874592473 None] Creating direct copy from snapshot {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 12:06:46 devstack cinder-volume[86916]: DEBUG cinder.utils [None req-d152116d-5f91-4dc5-8b40-8eeb8174607b tempest-VolumeDependencyTests-1874592473 None] Path /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5f664a47-4ffd-41a1-b0ba-65fd3dbd6887 not found in is_blk_device check {{(pid=86916) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 12:06:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d152116d-5f91-4dc5-8b40-8eeb8174607b tempest-VolumeDependencyTests-1874592473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5f664a47-4ffd-41a1-b0ba-65fd3dbd6887 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:46 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2e1a1c-a705-476d-ac73-196631f3bc79]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:06:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b6ca2a24-bb78-419c-b13d-34216e7b55f5 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-28ea4a9e-14a4-4cf6-b58b-a1899f392a33 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:46 devstack sudo[107690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5f664a47-4ffd-41a1-b0ba-65fd3dbd6887 Sep 28 12:06:46 devstack sudo[107690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:46 devstack sudo[107692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-28ea4a9e-14a4-4cf6-b58b-a1899f392a33 Sep 28 12:06:46 devstack sudo[107692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:47 devstack sudo[107692]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b6ca2a24-bb78-419c-b13d-34216e7b55f5 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-28ea4a9e-14a4-4cf6-b58b-a1899f392a33" returned: 0 in 0.394s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b6ca2a24-bb78-419c-b13d-34216e7b55f5 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-28ea4a9e-14a4-4cf6-b58b-a1899f392a33 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:47 devstack sudo[107701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-28ea4a9e-14a4-4cf6-b58b-a1899f392a33 Sep 28 12:06:47 devstack sudo[107701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:47 devstack sudo[107701]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b6ca2a24-bb78-419c-b13d-34216e7b55f5 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-28ea4a9e-14a4-4cf6-b58b-a1899f392a33" returned: 0 in 0.349s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:47 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b6ca2a24-bb78-419c-b13d-34216e7b55f5 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Lock "cinder-quobyte-28ea4a9e-14a4-4cf6-b58b-a1899f392a33" released by "delete_volume" :: held 0.801s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:06:47 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-b6ca2a24-bb78-419c-b13d-34216e7b55f5 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Created reservations ['768859b6-80ca-4164-9aed-a3bd38dc5067', 'afb82421-a376-4778-9388-56b4291b5dff', 'f87ee587-d889-4e05-b928-6033523445c5', '1e937590-b66a-4590-b581-acbba69a6f7f'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:06:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b6ca2a24-bb78-419c-b13d-34216e7b55f5 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b6ca2a24-bb78-419c-b13d-34216e7b55f5 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b6ca2a24-bb78-419c-b13d-34216e7b55f5 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:06:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b6ca2a24-bb78-419c-b13d-34216e7b55f5 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:06:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b6ca2a24-bb78-419c-b13d-34216e7b55f5 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b6ca2a24-bb78-419c-b13d-34216e7b55f5 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:47 devstack sudo[107710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:06:47 devstack sudo[107710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:47 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-566f452e-1fd1-4892-9318-c0df66440080 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Acquiring lock "cinder-15b75dae-a145-4bb5-954c-ead21d1080db-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:06:47 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-566f452e-1fd1-4892-9318-c0df66440080 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Lock "cinder-15b75dae-a145-4bb5-954c-ead21d1080db-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:06:48 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-566f452e-1fd1-4892-9318-c0df66440080 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Acquiring lock "cinder-quobyte-15b75dae-a145-4bb5-954c-ead21d1080db" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:06:48 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-566f452e-1fd1-4892-9318-c0df66440080 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Lock "cinder-quobyte-15b75dae-a145-4bb5-954c-ead21d1080db" acquired by "delete_volume" :: waited 0.028s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:06:48 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37900d9-be16-4fd1-9c44-ff187e036177]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:06:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-566f452e-1fd1-4892-9318-c0df66440080 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-15b75dae-a145-4bb5-954c-ead21d1080db {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:48 devstack sudo[107710]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b6ca2a24-bb78-419c-b13d-34216e7b55f5 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.415s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:48 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-b6ca2a24-bb78-419c-b13d-34216e7b55f5 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:06:48 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b6ca2a24-bb78-419c-b13d-34216e7b55f5 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Deleted volume successfully. Sep 28 12:06:48 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b6ca2a24-bb78-419c-b13d-34216e7b55f5 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Lock "cinder-28ea4a9e-14a4-4cf6-b58b-a1899f392a33-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:06:48 devstack sudo[107713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-15b75dae-a145-4bb5-954c-ead21d1080db Sep 28 12:06:48 devstack sudo[107713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:48 devstack sudo[107713]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-566f452e-1fd1-4892-9318-c0df66440080 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-15b75dae-a145-4bb5-954c-ead21d1080db" returned: 0 in 0.576s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-566f452e-1fd1-4892-9318-c0df66440080 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-15b75dae-a145-4bb5-954c-ead21d1080db {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:48 devstack sudo[107718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-15b75dae-a145-4bb5-954c-ead21d1080db Sep 28 12:06:48 devstack sudo[107718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:49 devstack sudo[107718]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-566f452e-1fd1-4892-9318-c0df66440080 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-15b75dae-a145-4bb5-954c-ead21d1080db" returned: 0 in 0.410s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:49 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-566f452e-1fd1-4892-9318-c0df66440080 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Lock "cinder-quobyte-15b75dae-a145-4bb5-954c-ead21d1080db" released by "delete_volume" :: held 1.073s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:06:49 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-566f452e-1fd1-4892-9318-c0df66440080 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Created reservations ['342fbe5a-f13a-4297-8df9-d03e7d148b9f', 'd30a805c-eeba-47bc-89c8-d8ff387e9415', 'eeef630f-3110-4af3-a6ab-13b7eaec12c7', 'a1fd9b68-4541-4e90-b4e6-dc3c8458d334'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:06:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-566f452e-1fd1-4892-9318-c0df66440080 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-566f452e-1fd1-4892-9318-c0df66440080 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-566f452e-1fd1-4892-9318-c0df66440080 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:06:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-566f452e-1fd1-4892-9318-c0df66440080 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:06:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-566f452e-1fd1-4892-9318-c0df66440080 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-566f452e-1fd1-4892-9318-c0df66440080 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:49 devstack sudo[107721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:06:49 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:49 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-566f452e-1fd1-4892-9318-c0df66440080 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.277s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:49 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-566f452e-1fd1-4892-9318-c0df66440080 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:06:49 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-566f452e-1fd1-4892-9318-c0df66440080 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Deleted volume successfully. Sep 28 12:06:49 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-566f452e-1fd1-4892-9318-c0df66440080 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Lock "cinder-15b75dae-a145-4bb5-954c-ead21d1080db-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:06:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a7e69f22-16c8-4c17-915e-e8273ca0cfcf tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Acquiring lock "cinder-1ab38c01-f7a5-4b5e-b23d-e81c03ab798f-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:06:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a7e69f22-16c8-4c17-915e-e8273ca0cfcf tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Lock "cinder-1ab38c01-f7a5-4b5e-b23d-e81c03ab798f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:06:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a7e69f22-16c8-4c17-915e-e8273ca0cfcf tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Acquiring lock "cinder-quobyte-1ab38c01-f7a5-4b5e-b23d-e81c03ab798f" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:06:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a7e69f22-16c8-4c17-915e-e8273ca0cfcf tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Lock "cinder-quobyte-1ab38c01-f7a5-4b5e-b23d-e81c03ab798f" acquired by "delete_volume" :: waited 0.028s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:06:50 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc84338-9d5b-498f-ae84-c4fdfa39a3e7]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:06:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a7e69f22-16c8-4c17-915e-e8273ca0cfcf tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1ab38c01-f7a5-4b5e-b23d-e81c03ab798f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:50 devstack sudo[107726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1ab38c01-f7a5-4b5e-b23d-e81c03ab798f Sep 28 12:06:50 devstack sudo[107726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:51 devstack sudo[107726]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a7e69f22-16c8-4c17-915e-e8273ca0cfcf tempest-CreateVolumesFromSourceVolumeTest-213755039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1ab38c01-f7a5-4b5e-b23d-e81c03ab798f" returned: 0 in 0.596s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a7e69f22-16c8-4c17-915e-e8273ca0cfcf tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1ab38c01-f7a5-4b5e-b23d-e81c03ab798f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:51 devstack sudo[107731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1ab38c01-f7a5-4b5e-b23d-e81c03ab798f Sep 28 12:06:51 devstack sudo[107731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:51 devstack sudo[107731]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a7e69f22-16c8-4c17-915e-e8273ca0cfcf tempest-CreateVolumesFromSourceVolumeTest-213755039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1ab38c01-f7a5-4b5e-b23d-e81c03ab798f" returned: 0 in 0.397s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a7e69f22-16c8-4c17-915e-e8273ca0cfcf tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Lock "cinder-quobyte-1ab38c01-f7a5-4b5e-b23d-e81c03ab798f" released by "delete_volume" :: held 1.099s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:06:51 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-a7e69f22-16c8-4c17-915e-e8273ca0cfcf tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Created reservations ['629716ea-6c8a-444f-9d38-ce41586d38ca', '16c26d17-2409-47f3-aa49-e9de8fe00b40', 'c1f207d1-45fe-494f-9ffe-d3c2646af3c8', '3ae26e30-728f-401d-9efc-5e06677e089c'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:06:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a7e69f22-16c8-4c17-915e-e8273ca0cfcf tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a7e69f22-16c8-4c17-915e-e8273ca0cfcf tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a7e69f22-16c8-4c17-915e-e8273ca0cfcf tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:06:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a7e69f22-16c8-4c17-915e-e8273ca0cfcf tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:06:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a7e69f22-16c8-4c17-915e-e8273ca0cfcf tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a7e69f22-16c8-4c17-915e-e8273ca0cfcf tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:51 devstack sudo[107734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:06:51 devstack sudo[107734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:52 devstack sudo[107734]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a7e69f22-16c8-4c17-915e-e8273ca0cfcf tempest-CreateVolumesFromSourceVolumeTest-213755039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.342s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:52 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a7e69f22-16c8-4c17-915e-e8273ca0cfcf tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:06:52 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-a7e69f22-16c8-4c17-915e-e8273ca0cfcf tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Deleted volume successfully. Sep 28 12:06:52 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a7e69f22-16c8-4c17-915e-e8273ca0cfcf tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Lock "cinder-1ab38c01-f7a5-4b5e-b23d-e81c03ab798f-delete_volume" released by "delete_volume" :: held 1.794s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:06:52 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ee844d5a-975a-4483-a640-62719c3163d4 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Acquiring lock "cinder-8a7ca908-f2de-4a27-bf4c-b488c203f1b6-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:06:52 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ee844d5a-975a-4483-a640-62719c3163d4 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Lock "cinder-8a7ca908-f2de-4a27-bf4c-b488c203f1b6-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:06:52 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ee844d5a-975a-4483-a640-62719c3163d4 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Acquiring lock "cinder-quobyte-8a7ca908-f2de-4a27-bf4c-b488c203f1b6" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:06:52 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ee844d5a-975a-4483-a640-62719c3163d4 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Lock "cinder-quobyte-8a7ca908-f2de-4a27-bf4c-b488c203f1b6" acquired by "delete_volume" :: waited 0.025s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:06:52 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[37894706-96c7-4828-b109-988df2e89322]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:06:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ee844d5a-975a-4483-a640-62719c3163d4 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8a7ca908-f2de-4a27-bf4c-b488c203f1b6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:52 devstack sudo[107737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8a7ca908-f2de-4a27-bf4c-b488c203f1b6 Sep 28 12:06:52 devstack sudo[107737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:53 devstack sudo[107737]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ee844d5a-975a-4483-a640-62719c3163d4 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8a7ca908-f2de-4a27-bf4c-b488c203f1b6" returned: 0 in 0.489s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ee844d5a-975a-4483-a640-62719c3163d4 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8a7ca908-f2de-4a27-bf4c-b488c203f1b6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:53 devstack sudo[107742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8a7ca908-f2de-4a27-bf4c-b488c203f1b6 Sep 28 12:06:53 devstack sudo[107742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:53 devstack sudo[107742]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ee844d5a-975a-4483-a640-62719c3163d4 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8a7ca908-f2de-4a27-bf4c-b488c203f1b6" returned: 0 in 0.460s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ee844d5a-975a-4483-a640-62719c3163d4 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Lock "cinder-quobyte-8a7ca908-f2de-4a27-bf4c-b488c203f1b6" released by "delete_volume" :: held 1.060s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:06:53 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-ee844d5a-975a-4483-a640-62719c3163d4 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Created reservations ['e8f57040-8612-482a-ae09-23bad61d03f4', '8bfc187f-04b2-4fa9-958b-5cf9f4f7a6e4', '1d37919b-e695-4c70-abf9-37e32e1a335c', '86833038-ed88-4b77-aa70-e5f63f59f884'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:06:53 devstack sudo[107690]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ee844d5a-975a-4483-a640-62719c3163d4 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ee844d5a-975a-4483-a640-62719c3163d4 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ee844d5a-975a-4483-a640-62719c3163d4 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:06:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ee844d5a-975a-4483-a640-62719c3163d4 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:06:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ee844d5a-975a-4483-a640-62719c3163d4 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ee844d5a-975a-4483-a640-62719c3163d4 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d152116d-5f91-4dc5-8b40-8eeb8174607b tempest-VolumeDependencyTests-1874592473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5f664a47-4ffd-41a1-b0ba-65fd3dbd6887" returned: 0 in 7.271s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:53 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-d152116d-5f91-4dc5-8b40-8eeb8174607b tempest-VolumeDependencyTests-1874592473 None] Image conversion details: src /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a, size 1024.00 MB, duration 7.27 sec, destination /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5f664a47-4ffd-41a1-b0ba-65fd3dbd6887 {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:06:53 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-d152116d-5f91-4dc5-8b40-8eeb8174607b tempest-VolumeDependencyTests-1874592473 None] Converted 1024.00 MB image at 140.79 MB/s Sep 28 12:06:53 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-d152116d-5f91-4dc5-8b40-8eeb8174607b tempest-VolumeDependencyTests-1874592473 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5f664a47-4ffd-41a1-b0ba-65fd3dbd6887 is being set with open permissions: ugo+rw Sep 28 12:06:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d152116d-5f91-4dc5-8b40-8eeb8174607b tempest-VolumeDependencyTests-1874592473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5f664a47-4ffd-41a1-b0ba-65fd3dbd6887 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:53 devstack sudo[107746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:06:54 devstack sudo[107746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:54 devstack sudo[107747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5f664a47-4ffd-41a1-b0ba-65fd3dbd6887 Sep 28 12:06:54 devstack sudo[107747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:54 devstack sudo[107747]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d152116d-5f91-4dc5-8b40-8eeb8174607b tempest-VolumeDependencyTests-1874592473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5f664a47-4ffd-41a1-b0ba-65fd3dbd6887" returned: 0 in 0.244s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:54 devstack sudo[107746]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ee844d5a-975a-4483-a640-62719c3163d4 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.264s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:54 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-ee844d5a-975a-4483-a640-62719c3163d4 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:06:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d152116d-5f91-4dc5-8b40-8eeb8174607b tempest-VolumeDependencyTests-1874592473 None] Lock "cinder-quobyte-5f664a47-4ffd-41a1-b0ba-65fd3dbd6887" released by "_copy_volume_from_snapshot" :: held 8.455s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:06:54 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-ee844d5a-975a-4483-a640-62719c3163d4 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Deleted volume successfully. Sep 28 12:06:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ee844d5a-975a-4483-a640-62719c3163d4 tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Lock "cinder-8a7ca908-f2de-4a27-bf4c-b488c203f1b6-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:06:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d152116d-5f91-4dc5-8b40-8eeb8174607b tempest-VolumeDependencyTests-1874592473 None] Lock "cinder-quobyte-965060c4-362a-4426-9758-31c62fe99ab5-5f664a47-4ffd-41a1-b0ba-65fd3dbd6887" released by "_create_volume_from_snapshot" :: held 8.563s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:06:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d152116d-5f91-4dc5-8b40-8eeb8174607b tempest-VolumeDependencyTests-1874592473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.585s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2710c87c-976c-4b65-b58b-fd708b0314a9 tempest-ProjectMemberTests-1312558137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.324s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2710c87c-976c-4b65-b58b-fd708b0314a9 tempest-ProjectMemberTests-1312558137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:06:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-539845673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bc5587f-190c-4a61-aa5a-11acfaeb8e65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba606417eb184510b6154fa1a28dce16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:06:46Z,use_quota=True,user_id='bb30da770afa465f8162e7779a473226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:06:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-2710c87c-976c-4b65-b58b-fd708b0314a9 tempest-ProjectMemberTests-1312558137 None] Creating volume 1bc5587f-190c-4a61-aa5a-11acfaeb8e65 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:06:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2710c87c-976c-4b65-b58b-fd708b0314a9 tempest-ProjectMemberTests-1312558137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2710c87c-976c-4b65-b58b-fd708b0314a9 tempest-ProjectMemberTests-1312558137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2710c87c-976c-4b65-b58b-fd708b0314a9 tempest-ProjectMemberTests-1312558137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:06:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2710c87c-976c-4b65-b58b-fd708b0314a9 tempest-ProjectMemberTests-1312558137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:06:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2710c87c-976c-4b65-b58b-fd708b0314a9 tempest-ProjectMemberTests-1312558137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2710c87c-976c-4b65-b58b-fd708b0314a9 tempest-ProjectMemberTests-1312558137 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:06:54 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-2710c87c-976c-4b65-b58b-fd708b0314a9 tempest-ProjectMemberTests-1312558137 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:06:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2710c87c-976c-4b65-b58b-fd708b0314a9 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1bc5587f-190c-4a61-aa5a-11acfaeb8e65 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:54 devstack sudo[107752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1bc5587f-190c-4a61-aa5a-11acfaeb8e65 1073741824 Sep 28 12:06:54 devstack sudo[107752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d152116d-5f91-4dc5-8b40-8eeb8174607b tempest-VolumeDependencyTests-1874592473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8830c289-906a-4d0e-a2bf-956d049d7e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f664a47-4ffd-41a1-b0ba-65fd3dbd6887', 'volume_size': 1, 'snapshot_id': '965060c4-362a-4426-9758-31c62fe99ab5'}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d152116d-5f91-4dc5-8b40-8eeb8174607b tempest-VolumeDependencyTests-1874592473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09de54e1-c59c-4933-a439-fefb52adbb79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:54 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-d152116d-5f91-4dc5-8b40-8eeb8174607b tempest-VolumeDependencyTests-1874592473 None] Volume volume-5f664a47-4ffd-41a1-b0ba-65fd3dbd6887 (5f664a47-4ffd-41a1-b0ba-65fd3dbd6887): created successfully Sep 28 12:06:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d152116d-5f91-4dc5-8b40-8eeb8174607b tempest-VolumeDependencyTests-1874592473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09de54e1-c59c-4933-a439-fefb52adbb79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d152116d-5f91-4dc5-8b40-8eeb8174607b tempest-VolumeDependencyTests-1874592473 None] Flow 'volume_create_manager' (252384ba-a66b-482f-bad6-57076621b90c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:06:54 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-d152116d-5f91-4dc5-8b40-8eeb8174607b tempest-VolumeDependencyTests-1874592473 None] Created volume successfully. Sep 28 12:06:54 devstack sudo[107752]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2710c87c-976c-4b65-b58b-fd708b0314a9 tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1bc5587f-190c-4a61-aa5a-11acfaeb8e65 1073741824" returned: 0 in 0.424s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2710c87c-976c-4b65-b58b-fd708b0314a9 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1bc5587f-190c-4a61-aa5a-11acfaeb8e65 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:54 devstack sudo[107758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1bc5587f-190c-4a61-aa5a-11acfaeb8e65 Sep 28 12:06:54 devstack sudo[107758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-68776294-2340-465a-95cb-403ec7868254 tempest-VolumeDependencyTests-1874592473 None] Acquiring lock "cinder-965060c4-362a-4426-9758-31c62fe99ab5-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:06:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-68776294-2340-465a-95cb-403ec7868254 tempest-VolumeDependencyTests-1874592473 None] Lock "cinder-965060c4-362a-4426-9758-31c62fe99ab5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:06:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-68776294-2340-465a-95cb-403ec7868254 tempest-VolumeDependencyTests-1874592473 None] Acquiring lock "cinder-quobyte-2aaa7054-f0e9-4648-8ae6-8bccfebae37a" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:06:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-68776294-2340-465a-95cb-403ec7868254 tempest-VolumeDependencyTests-1874592473 None] Lock "cinder-quobyte-2aaa7054-f0e9-4648-8ae6-8bccfebae37a" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:06:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-68776294-2340-465a-95cb-403ec7868254 tempest-VolumeDependencyTests-1874592473 None] Acquiring lock "cinder-quobyte-965060c4-362a-4426-9758-31c62fe99ab5" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:06:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-68776294-2340-465a-95cb-403ec7868254 tempest-VolumeDependencyTests-1874592473 None] Lock "cinder-quobyte-965060c4-362a-4426-9758-31c62fe99ab5" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:06:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-68776294-2340-465a-95cb-403ec7868254 tempest-VolumeDependencyTests-1874592473 None] Deleting offline snapshot 965060c4-362a-4426-9758-31c62fe99ab5 of volume 2aaa7054-f0e9-4648-8ae6-8bccfebae37a {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:06:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-68776294-2340-465a-95cb-403ec7868254 tempest-VolumeDependencyTests-1874592473 None] snapshot_file for this snap is: volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a.965060c4-362a-4426-9758-31c62fe99ab5 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:06:54 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e08f978-ab95-41fb-93ea-7c72aefac56a]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:06:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-68776294-2340-465a-95cb-403ec7868254 tempest-VolumeDependencyTests-1874592473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a.965060c4-362a-4426-9758-31c62fe99ab5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5f939a5c-75b9-465d-88c9-7bcf5609740a tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Acquiring lock "cinder-212c1da5-6f2e-4221-81af-9ec108c83607-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:06:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5f939a5c-75b9-465d-88c9-7bcf5609740a tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Lock "cinder-212c1da5-6f2e-4221-81af-9ec108c83607-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:06:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5f939a5c-75b9-465d-88c9-7bcf5609740a tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Acquiring lock "cinder-quobyte-212c1da5-6f2e-4221-81af-9ec108c83607" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:06:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5f939a5c-75b9-465d-88c9-7bcf5609740a tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Lock "cinder-quobyte-212c1da5-6f2e-4221-81af-9ec108c83607" acquired by "delete_volume" :: waited 0.036s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:06:55 devstack sudo[107758]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2710c87c-976c-4b65-b58b-fd708b0314a9 tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1bc5587f-190c-4a61-aa5a-11acfaeb8e65" returned: 0 in 0.337s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2710c87c-976c-4b65-b58b-fd708b0314a9 tempest-ProjectMemberTests-1312558137 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:06:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2710c87c-976c-4b65-b58b-fd708b0314a9 tempest-ProjectMemberTests-1312558137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c4fbef72-142f-4ee1-b6f8-07f77c04b287 tempest-CinderUnicodeTest-82330997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.635s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c4fbef72-142f-4ee1-b6f8-07f77c04b287 tempest-CinderUnicodeTest-82330997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:06:46Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60bafc7b-7dec-4ee3-9f23-df9cfe73e2d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3373e94b854b452cb8d700d79db0b6e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:06:46Z,use_quota=True,user_id='e8dc974352754f7fafc31e04a4f133e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:06:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-c4fbef72-142f-4ee1-b6f8-07f77c04b287 tempest-CinderUnicodeTest-82330997 None] Creating volume 60bafc7b-7dec-4ee3-9f23-df9cfe73e2d1 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:06:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c4fbef72-142f-4ee1-b6f8-07f77c04b287 tempest-CinderUnicodeTest-82330997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c4fbef72-142f-4ee1-b6f8-07f77c04b287 tempest-CinderUnicodeTest-82330997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:55 devstack sudo[107760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a.965060c4-362a-4426-9758-31c62fe99ab5 Sep 28 12:06:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c4fbef72-142f-4ee1-b6f8-07f77c04b287 tempest-CinderUnicodeTest-82330997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:06:55 devstack sudo[107760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c4fbef72-142f-4ee1-b6f8-07f77c04b287 tempest-CinderUnicodeTest-82330997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:06:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c4fbef72-142f-4ee1-b6f8-07f77c04b287 tempest-CinderUnicodeTest-82330997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c4fbef72-142f-4ee1-b6f8-07f77c04b287 tempest-CinderUnicodeTest-82330997 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:06:55 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-c4fbef72-142f-4ee1-b6f8-07f77c04b287 tempest-CinderUnicodeTest-82330997 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:06:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c4fbef72-142f-4ee1-b6f8-07f77c04b287 tempest-CinderUnicodeTest-82330997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-60bafc7b-7dec-4ee3-9f23-df9cfe73e2d1 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:55 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f488c1-1868-4e3b-841d-ae9c2b38a438]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:06:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5f939a5c-75b9-465d-88c9-7bcf5609740a tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-212c1da5-6f2e-4221-81af-9ec108c83607 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:55 devstack sudo[107763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-60bafc7b-7dec-4ee3-9f23-df9cfe73e2d1 1073741824 Sep 28 12:06:55 devstack sudo[107763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2710c87c-976c-4b65-b58b-fd708b0314a9 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2736e6c-c3f2-4e97-b4ee-844d231a2690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bc5587f-190c-4a61-aa5a-11acfaeb8e65', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2710c87c-976c-4b65-b58b-fd708b0314a9 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (514db9e2-e27e-4c41-a657-cb88fe09662b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:55 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-2710c87c-976c-4b65-b58b-fd708b0314a9 tempest-ProjectMemberTests-1312558137 None] Volume volume-1bc5587f-190c-4a61-aa5a-11acfaeb8e65 (1bc5587f-190c-4a61-aa5a-11acfaeb8e65): created successfully Sep 28 12:06:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2710c87c-976c-4b65-b58b-fd708b0314a9 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (514db9e2-e27e-4c41-a657-cb88fe09662b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2710c87c-976c-4b65-b58b-fd708b0314a9 tempest-ProjectMemberTests-1312558137 None] Flow 'volume_create_manager' (f84d3551-6e06-4ae8-b7a7-16769c818d2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:06:55 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-2710c87c-976c-4b65-b58b-fd708b0314a9 tempest-ProjectMemberTests-1312558137 None] Created volume successfully. Sep 28 12:06:55 devstack sudo[107764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-212c1da5-6f2e-4221-81af-9ec108c83607 Sep 28 12:06:55 devstack sudo[107764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:55 devstack sudo[107760]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-68776294-2340-465a-95cb-403ec7868254 tempest-VolumeDependencyTests-1874592473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a.965060c4-362a-4426-9758-31c62fe99ab5" returned: 0 in 0.464s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-68776294-2340-465a-95cb-403ec7868254 tempest-VolumeDependencyTests-1874592473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:06:55 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[30df243b-beac-4475-8b13-abf26ddf8338]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:06:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-68776294-2340-465a-95cb-403ec7868254 tempest-VolumeDependencyTests-1874592473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:55 devstack sudo[107764]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5f939a5c-75b9-465d-88c9-7bcf5609740a tempest-CreateVolumesFromSourceVolumeTest-213755039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-212c1da5-6f2e-4221-81af-9ec108c83607" returned: 0 in 0.389s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5f939a5c-75b9-465d-88c9-7bcf5609740a tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-212c1da5-6f2e-4221-81af-9ec108c83607 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:55 devstack sudo[107779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-212c1da5-6f2e-4221-81af-9ec108c83607 Sep 28 12:06:55 devstack sudo[107779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:55 devstack sudo[107776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a Sep 28 12:06:55 devstack sudo[107776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:55 devstack sudo[107763]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c4fbef72-142f-4ee1-b6f8-07f77c04b287 tempest-CinderUnicodeTest-82330997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-60bafc7b-7dec-4ee3-9f23-df9cfe73e2d1 1073741824" returned: 0 in 0.495s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c4fbef72-142f-4ee1-b6f8-07f77c04b287 tempest-CinderUnicodeTest-82330997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-60bafc7b-7dec-4ee3-9f23-df9cfe73e2d1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:55 devstack sudo[107782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-60bafc7b-7dec-4ee3-9f23-df9cfe73e2d1 Sep 28 12:06:55 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:55 devstack sudo[107779]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5f939a5c-75b9-465d-88c9-7bcf5609740a tempest-CreateVolumesFromSourceVolumeTest-213755039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-212c1da5-6f2e-4221-81af-9ec108c83607" returned: 0 in 0.340s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5f939a5c-75b9-465d-88c9-7bcf5609740a tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Lock "cinder-quobyte-212c1da5-6f2e-4221-81af-9ec108c83607" released by "delete_volume" :: held 0.806s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:06:55 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-5f939a5c-75b9-465d-88c9-7bcf5609740a tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Created reservations ['79f8ab4d-96ac-4e8f-bbaa-f47cd434355c', 'b88406d1-5d50-485e-92b9-97c33f292e56', '105904b7-a246-409a-8708-95fd038cafa1', 'd89909e3-ff07-47dc-bd44-f718fe76c3d3'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:06:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ad30cf07-de96-4401-a627-785055bb787f tempest-ProjectMemberTests-1312558137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:56 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c4fbef72-142f-4ee1-b6f8-07f77c04b287 tempest-CinderUnicodeTest-82330997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-60bafc7b-7dec-4ee3-9f23-df9cfe73e2d1" returned: 0 in 0.392s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c4fbef72-142f-4ee1-b6f8-07f77c04b287 tempest-CinderUnicodeTest-82330997 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:06:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c4fbef72-142f-4ee1-b6f8-07f77c04b287 tempest-CinderUnicodeTest-82330997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:56 devstack sudo[107776]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ad30cf07-de96-4401-a627-785055bb787f tempest-ProjectMemberTests-1312558137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.064s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-68776294-2340-465a-95cb-403ec7868254 tempest-VolumeDependencyTests-1874592473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a" returned: 0 in 0.639s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-68776294-2340-465a-95cb-403ec7868254 tempest-VolumeDependencyTests-1874592473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a.965060c4-362a-4426-9758-31c62fe99ab5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c4fbef72-142f-4ee1-b6f8-07f77c04b287 tempest-CinderUnicodeTest-82330997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd4dec4d-3740-4345-a582-538a40eae36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60bafc7b-7dec-4ee3-9f23-df9cfe73e2d1', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:56 devstack sudo[107791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a.965060c4-362a-4426-9758-31c62fe99ab5 Sep 28 12:06:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c4fbef72-142f-4ee1-b6f8-07f77c04b287 tempest-CinderUnicodeTest-82330997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e02591a7-1334-499a-a6fb-2c390a6e3e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:56 devstack sudo[107791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-ad30cf07-de96-4401-a627-785055bb787f tempest-ProjectMemberTests-1312558137 None] Creating offline snapshot a637e532-1953-44a2-84b9-9abe67ff5204 of volume 1bc5587f-190c-4a61-aa5a-11acfaeb8e65 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:06:56 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-c4fbef72-142f-4ee1-b6f8-07f77c04b287 tempest-CinderUnicodeTest-82330997 None] Volume volume-60bafc7b-7dec-4ee3-9f23-df9cfe73e2d1 (60bafc7b-7dec-4ee3-9f23-df9cfe73e2d1): created successfully Sep 28 12:06:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c4fbef72-142f-4ee1-b6f8-07f77c04b287 tempest-CinderUnicodeTest-82330997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e02591a7-1334-499a-a6fb-2c390a6e3e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c4fbef72-142f-4ee1-b6f8-07f77c04b287 tempest-CinderUnicodeTest-82330997 None] Flow 'volume_create_manager' (be2bba4f-592e-4f6e-b86e-b8c65edf1258) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:06:56 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4835228-416d-40c8-b985-0aacb0d25763]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:06:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ad30cf07-de96-4401-a627-785055bb787f tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1bc5587f-190c-4a61-aa5a-11acfaeb8e65 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5f939a5c-75b9-465d-88c9-7bcf5609740a tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5f939a5c-75b9-465d-88c9-7bcf5609740a tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5f939a5c-75b9-465d-88c9-7bcf5609740a tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:06:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5f939a5c-75b9-465d-88c9-7bcf5609740a tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:06:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5f939a5c-75b9-465d-88c9-7bcf5609740a tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5f939a5c-75b9-465d-88c9-7bcf5609740a tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1e738493-4beb-4f5b-9da1-2078a1970acc tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Acquiring lock "cinder-43f6d0c3-7d01-4fd1-b7b6-78b5ba12865f-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:06:56 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-c4fbef72-142f-4ee1-b6f8-07f77c04b287 tempest-CinderUnicodeTest-82330997 None] Created volume successfully. Sep 28 12:06:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1e738493-4beb-4f5b-9da1-2078a1970acc tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Lock "cinder-43f6d0c3-7d01-4fd1-b7b6-78b5ba12865f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:06:56 devstack sudo[107794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:06:56 devstack sudo[107794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1e738493-4beb-4f5b-9da1-2078a1970acc tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Acquiring lock "cinder-quobyte-43f6d0c3-7d01-4fd1-b7b6-78b5ba12865f" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:06:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1e738493-4beb-4f5b-9da1-2078a1970acc tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Lock "cinder-quobyte-43f6d0c3-7d01-4fd1-b7b6-78b5ba12865f" acquired by "delete_volume" :: waited 0.028s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:06:56 devstack sudo[107793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1bc5587f-190c-4a61-aa5a-11acfaeb8e65 Sep 28 12:06:56 devstack sudo[107793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:56 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5681371-824a-4797-a59a-0125c2693688]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:06:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1e738493-4beb-4f5b-9da1-2078a1970acc tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-43f6d0c3-7d01-4fd1-b7b6-78b5ba12865f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:56 devstack sudo[107797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-43f6d0c3-7d01-4fd1-b7b6-78b5ba12865f Sep 28 12:06:56 devstack sudo[107797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:56 devstack sudo[107791]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-68776294-2340-465a-95cb-403ec7868254 tempest-VolumeDependencyTests-1874592473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a.965060c4-362a-4426-9758-31c62fe99ab5" returned: 0 in 0.463s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-68776294-2340-465a-95cb-403ec7868254 tempest-VolumeDependencyTests-1874592473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a.965060c4-362a-4426-9758-31c62fe99ab5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:56 devstack sudo[107804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a.965060c4-362a-4426-9758-31c62fe99ab5 Sep 28 12:06:56 devstack sudo[107804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:56 devstack sudo[107794]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5f939a5c-75b9-465d-88c9-7bcf5609740a tempest-CreateVolumesFromSourceVolumeTest-213755039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.427s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:56 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-5f939a5c-75b9-465d-88c9-7bcf5609740a tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:06:56 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-5f939a5c-75b9-465d-88c9-7bcf5609740a tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Deleted volume successfully. Sep 28 12:06:56 devstack sudo[107793]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5f939a5c-75b9-465d-88c9-7bcf5609740a tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Lock "cinder-212c1da5-6f2e-4221-81af-9ec108c83607-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:06:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ad30cf07-de96-4401-a627-785055bb787f tempest-ProjectMemberTests-1312558137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1bc5587f-190c-4a61-aa5a-11acfaeb8e65" returned: 0 in 0.497s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ad30cf07-de96-4401-a627-785055bb787f tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1bc5587f-190c-4a61-aa5a-11acfaeb8e65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1bc5587f-190c-4a61-aa5a-11acfaeb8e65.a637e532-1953-44a2-84b9-9abe67ff5204 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:56 devstack sudo[107808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1bc5587f-190c-4a61-aa5a-11acfaeb8e65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1bc5587f-190c-4a61-aa5a-11acfaeb8e65.a637e532-1953-44a2-84b9-9abe67ff5204 1G Sep 28 12:06:56 devstack sudo[107808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:56 devstack sudo[107804]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-68776294-2340-465a-95cb-403ec7868254 tempest-VolumeDependencyTests-1874592473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a.965060c4-362a-4426-9758-31c62fe99ab5" returned: 0 in 0.283s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:56 devstack sudo[107797]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1e738493-4beb-4f5b-9da1-2078a1970acc tempest-CreateVolumesFromSourceVolumeTest-213755039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-43f6d0c3-7d01-4fd1-b7b6-78b5ba12865f" returned: 0 in 0.476s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1e738493-4beb-4f5b-9da1-2078a1970acc tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-43f6d0c3-7d01-4fd1-b7b6-78b5ba12865f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:56 devstack sudo[107814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-43f6d0c3-7d01-4fd1-b7b6-78b5ba12865f Sep 28 12:06:56 devstack sudo[107814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-68776294-2340-465a-95cb-403ec7868254 tempest-VolumeDependencyTests-1874592473 None] Lock "cinder-quobyte-965060c4-362a-4426-9758-31c62fe99ab5" released by "_delete_snapshot" :: held 2.011s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:06:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-68776294-2340-465a-95cb-403ec7868254 tempest-VolumeDependencyTests-1874592473 None] Lock "cinder-quobyte-2aaa7054-f0e9-4648-8ae6-8bccfebae37a" released by "delete_snapshot" :: held 2.044s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:06:56 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-68776294-2340-465a-95cb-403ec7868254 tempest-VolumeDependencyTests-1874592473 None] Created reservations ['6d1b679e-f853-445d-8e58-018e51f3bc96', '4dd0419a-f887-42a7-a941-19bc0c56ce4e', 'c82a7b7d-f348-4ff9-b7e8-c334db86cd4f', '1d07f8cd-16b4-4397-bc0c-f12cf456cc53'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:06:57 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-68776294-2340-465a-95cb-403ec7868254 tempest-VolumeDependencyTests-1874592473 None] Delete snapshot completed successfully. Sep 28 12:06:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-68776294-2340-465a-95cb-403ec7868254 tempest-VolumeDependencyTests-1874592473 None] Lock "cinder-965060c4-362a-4426-9758-31c62fe99ab5-delete_snapshot" released by "delete_snapshot" :: held 2.223s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:06:57 devstack sudo[107808]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ad30cf07-de96-4401-a627-785055bb787f tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1bc5587f-190c-4a61-aa5a-11acfaeb8e65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1bc5587f-190c-4a61-aa5a-11acfaeb8e65.a637e532-1953-44a2-84b9-9abe67ff5204 1G" returned: 0 in 0.487s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ad30cf07-de96-4401-a627-785055bb787f tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bc5587f-190c-4a61-aa5a-11acfaeb8e65 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1bc5587f-190c-4a61-aa5a-11acfaeb8e65.a637e532-1953-44a2-84b9-9abe67ff5204 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:57 devstack sudo[107821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bc5587f-190c-4a61-aa5a-11acfaeb8e65 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1bc5587f-190c-4a61-aa5a-11acfaeb8e65.a637e532-1953-44a2-84b9-9abe67ff5204 Sep 28 12:06:57 devstack sudo[107821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:57 devstack sudo[107814]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1e738493-4beb-4f5b-9da1-2078a1970acc tempest-CreateVolumesFromSourceVolumeTest-213755039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-43f6d0c3-7d01-4fd1-b7b6-78b5ba12865f" returned: 0 in 0.327s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1e738493-4beb-4f5b-9da1-2078a1970acc tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Lock "cinder-quobyte-43f6d0c3-7d01-4fd1-b7b6-78b5ba12865f" released by "delete_volume" :: held 0.880s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:06:57 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-1e738493-4beb-4f5b-9da1-2078a1970acc tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Created reservations ['addb1900-01ba-4f38-9a33-173a5ba3a401', 'b6db612f-fe90-425b-a024-9966b5d9916d', 'd8b084e5-cadc-4787-bec8-1efa3eeca45c', '63ef6c30-4345-4dd7-8c8d-9d431754b75b'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:06:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1e738493-4beb-4f5b-9da1-2078a1970acc tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1e738493-4beb-4f5b-9da1-2078a1970acc tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1e738493-4beb-4f5b-9da1-2078a1970acc tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:06:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1e738493-4beb-4f5b-9da1-2078a1970acc tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:06:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1e738493-4beb-4f5b-9da1-2078a1970acc tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1e738493-4beb-4f5b-9da1-2078a1970acc tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:57 devstack sudo[107823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:06:57 devstack sudo[107823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:57 devstack sudo[107821]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ad30cf07-de96-4401-a627-785055bb787f tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bc5587f-190c-4a61-aa5a-11acfaeb8e65 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1bc5587f-190c-4a61-aa5a-11acfaeb8e65.a637e532-1953-44a2-84b9-9abe67ff5204" returned: 0 in 0.338s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:57 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-ad30cf07-de96-4401-a627-785055bb787f tempest-ProjectMemberTests-1312558137 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1bc5587f-190c-4a61-aa5a-11acfaeb8e65.a637e532-1953-44a2-84b9-9abe67ff5204 is being set with open permissions: ugo+rw Sep 28 12:06:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ad30cf07-de96-4401-a627-785055bb787f tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1bc5587f-190c-4a61-aa5a-11acfaeb8e65.a637e532-1953-44a2-84b9-9abe67ff5204 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:57 devstack sudo[107828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1bc5587f-190c-4a61-aa5a-11acfaeb8e65.a637e532-1953-44a2-84b9-9abe67ff5204 Sep 28 12:06:57 devstack sudo[107828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:57 devstack sudo[107823]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1e738493-4beb-4f5b-9da1-2078a1970acc tempest-CreateVolumesFromSourceVolumeTest-213755039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.294s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:57 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-1e738493-4beb-4f5b-9da1-2078a1970acc tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:06:57 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-1e738493-4beb-4f5b-9da1-2078a1970acc tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Deleted volume successfully. Sep 28 12:06:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1e738493-4beb-4f5b-9da1-2078a1970acc tempest-CreateVolumesFromSourceVolumeTest-213755039 None] Lock "cinder-43f6d0c3-7d01-4fd1-b7b6-78b5ba12865f-delete_volume" released by "delete_volume" :: held 1.448s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:06:57 devstack sudo[107828]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ad30cf07-de96-4401-a627-785055bb787f tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1bc5587f-190c-4a61-aa5a-11acfaeb8e65.a637e532-1953-44a2-84b9-9abe67ff5204" returned: 0 in 0.300s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:57 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-e82e6740-2f57-4b38-893f-143fb0b6faef tempest-CinderUnicodeTest-82330997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:06:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e82e6740-2f57-4b38-893f-143fb0b6faef tempest-CinderUnicodeTest-82330997 None] Flow 'volume_create_manager' (cf5c3b7b-1c33-49a4-9b26-c64ac8b2e882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:06:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e82e6740-2f57-4b38-893f-143fb0b6faef tempest-CinderUnicodeTest-82330997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be12d164-ae10-416f-86bf-d6e4653333fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ad30cf07-de96-4401-a627-785055bb787f tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1bc5587f-190c-4a61-aa5a-11acfaeb8e65.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e82e6740-2f57-4b38-893f-143fb0b6faef tempest-CinderUnicodeTest-82330997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be12d164-ae10-416f-86bf-d6e4653333fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:06:57Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1299328336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38dad994-9fd9-4650-9793-4d3e320d79b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3373e94b854b452cb8d700d79db0b6e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:06:58Z,use_quota=True,user_id='e8dc974352754f7fafc31e04a4f133e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:57 devstack sudo[107832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1bc5587f-190c-4a61-aa5a-11acfaeb8e65.info Sep 28 12:06:57 devstack sudo[107832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e82e6740-2f57-4b38-893f-143fb0b6faef tempest-CinderUnicodeTest-82330997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4f2dd35-cf7c-42f7-be22-ce46935f2158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e82e6740-2f57-4b38-893f-143fb0b6faef tempest-CinderUnicodeTest-82330997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4f2dd35-cf7c-42f7-be22-ce46935f2158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e82e6740-2f57-4b38-893f-143fb0b6faef tempest-CinderUnicodeTest-82330997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faf7f4f4-6f97-4c72-86d3-b14dc66fbd1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e82e6740-2f57-4b38-893f-143fb0b6faef tempest-CinderUnicodeTest-82330997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faf7f4f4-6f97-4c72-86d3-b14dc66fbd1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38dad994-9fd9-4650-9793-4d3e320d79b2', 'volume_name': 'volume-38dad994-9fd9-4650-9793-4d3e320d79b2', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e82e6740-2f57-4b38-893f-143fb0b6faef tempest-CinderUnicodeTest-82330997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56b3c09c-48fc-4238-92e8-631945fc0d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e82e6740-2f57-4b38-893f-143fb0b6faef tempest-CinderUnicodeTest-82330997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56b3c09c-48fc-4238-92e8-631945fc0d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e82e6740-2f57-4b38-893f-143fb0b6faef tempest-CinderUnicodeTest-82330997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b63e1129-6a20-4b3a-adb9-e7f6a08265ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:57 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-e82e6740-2f57-4b38-893f-143fb0b6faef tempest-CinderUnicodeTest-82330997 None] Volume 38dad994-9fd9-4650-9793-4d3e320d79b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38dad994-9fd9-4650-9793-4d3e320d79b2', 'volume_size': 1} Sep 28 12:06:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e82e6740-2f57-4b38-893f-143fb0b6faef tempest-CinderUnicodeTest-82330997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-022474d6-314d-4d5d-a68c-c5be5f4aec3f tempest-VolumeDependencyTests-1874592473 None] Acquiring lock "cinder-2aaa7054-f0e9-4648-8ae6-8bccfebae37a-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:06:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-022474d6-314d-4d5d-a68c-c5be5f4aec3f tempest-VolumeDependencyTests-1874592473 None] Lock "cinder-2aaa7054-f0e9-4648-8ae6-8bccfebae37a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:06:58 devstack sudo[107832]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ad30cf07-de96-4401-a627-785055bb787f tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1bc5587f-190c-4a61-aa5a-11acfaeb8e65.info" returned: 0 in 0.273s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:58 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-ad30cf07-de96-4401-a627-785055bb787f tempest-ProjectMemberTests-1312558137 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1bc5587f-190c-4a61-aa5a-11acfaeb8e65.info is being set with open permissions: ugo+rw Sep 28 12:06:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ad30cf07-de96-4401-a627-785055bb787f tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1bc5587f-190c-4a61-aa5a-11acfaeb8e65.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-022474d6-314d-4d5d-a68c-c5be5f4aec3f tempest-VolumeDependencyTests-1874592473 None] Acquiring lock "cinder-quobyte-2aaa7054-f0e9-4648-8ae6-8bccfebae37a" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:06:58 devstack sudo[107835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1bc5587f-190c-4a61-aa5a-11acfaeb8e65.info Sep 28 12:06:58 devstack sudo[107835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-022474d6-314d-4d5d-a68c-c5be5f4aec3f tempest-VolumeDependencyTests-1874592473 None] Lock "cinder-quobyte-2aaa7054-f0e9-4648-8ae6-8bccfebae37a" acquired by "delete_volume" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:06:58 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[857ea695-5f73-4966-8575-9213eeb044c7]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:06:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-022474d6-314d-4d5d-a68c-c5be5f4aec3f tempest-VolumeDependencyTests-1874592473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:58 devstack sudo[107837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a Sep 28 12:06:58 devstack sudo[107837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:58 devstack sudo[107835]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ad30cf07-de96-4401-a627-785055bb787f tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1bc5587f-190c-4a61-aa5a-11acfaeb8e65.info" returned: 0 in 0.268s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ad30cf07-de96-4401-a627-785055bb787f tempest-ProjectMemberTests-1312558137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.377s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e82e6740-2f57-4b38-893f-143fb0b6faef tempest-CinderUnicodeTest-82330997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.521s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e82e6740-2f57-4b38-893f-143fb0b6faef tempest-CinderUnicodeTest-82330997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:06:57Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1299328336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38dad994-9fd9-4650-9793-4d3e320d79b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3373e94b854b452cb8d700d79db0b6e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:06:58Z,use_quota=True,user_id='e8dc974352754f7fafc31e04a4f133e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:06:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-e82e6740-2f57-4b38-893f-143fb0b6faef tempest-CinderUnicodeTest-82330997 None] Creating volume 38dad994-9fd9-4650-9793-4d3e320d79b2 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:06:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e82e6740-2f57-4b38-893f-143fb0b6faef tempest-CinderUnicodeTest-82330997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e82e6740-2f57-4b38-893f-143fb0b6faef tempest-CinderUnicodeTest-82330997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e82e6740-2f57-4b38-893f-143fb0b6faef tempest-CinderUnicodeTest-82330997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:06:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e82e6740-2f57-4b38-893f-143fb0b6faef tempest-CinderUnicodeTest-82330997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:06:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e82e6740-2f57-4b38-893f-143fb0b6faef tempest-CinderUnicodeTest-82330997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e82e6740-2f57-4b38-893f-143fb0b6faef tempest-CinderUnicodeTest-82330997 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:06:58 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-e82e6740-2f57-4b38-893f-143fb0b6faef tempest-CinderUnicodeTest-82330997 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:06:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e82e6740-2f57-4b38-893f-143fb0b6faef tempest-CinderUnicodeTest-82330997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-38dad994-9fd9-4650-9793-4d3e320d79b2 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:58 devstack sudo[107840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-38dad994-9fd9-4650-9793-4d3e320d79b2 1073741824 Sep 28 12:06:58 devstack sudo[107840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:58 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-ad30cf07-de96-4401-a627-785055bb787f tempest-ProjectMemberTests-1312558137 None] Create snapshot completed successfully Sep 28 12:06:58 devstack sudo[107837]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-022474d6-314d-4d5d-a68c-c5be5f4aec3f tempest-VolumeDependencyTests-1874592473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a" returned: 0 in 0.404s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-022474d6-314d-4d5d-a68c-c5be5f4aec3f tempest-VolumeDependencyTests-1874592473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:58 devstack sudo[107846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a Sep 28 12:06:58 devstack sudo[107846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:58 devstack sudo[107846]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-022474d6-314d-4d5d-a68c-c5be5f4aec3f tempest-VolumeDependencyTests-1874592473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-2aaa7054-f0e9-4648-8ae6-8bccfebae37a" returned: 0 in 0.289s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-022474d6-314d-4d5d-a68c-c5be5f4aec3f tempest-VolumeDependencyTests-1874592473 None] Lock "cinder-quobyte-2aaa7054-f0e9-4648-8ae6-8bccfebae37a" released by "delete_volume" :: held 0.763s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:06:58 devstack sudo[107840]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e82e6740-2f57-4b38-893f-143fb0b6faef tempest-CinderUnicodeTest-82330997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-38dad994-9fd9-4650-9793-4d3e320d79b2 1073741824" returned: 0 in 0.516s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:59 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-022474d6-314d-4d5d-a68c-c5be5f4aec3f tempest-VolumeDependencyTests-1874592473 None] Created reservations ['4bd3ff12-99ea-44f3-a63c-6f53fe9fd705', 'e0855b29-4883-4535-8f8b-6f41fe9498fb', 'bcbd0fa8-d940-4d5c-924b-d3727dc2750a', '6cb5e630-bdd8-4b2b-a618-36e0734797f0'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:06:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e82e6740-2f57-4b38-893f-143fb0b6faef tempest-CinderUnicodeTest-82330997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-38dad994-9fd9-4650-9793-4d3e320d79b2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:59 devstack sudo[107852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-38dad994-9fd9-4650-9793-4d3e320d79b2 Sep 28 12:06:59 devstack sudo[107852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-022474d6-314d-4d5d-a68c-c5be5f4aec3f tempest-VolumeDependencyTests-1874592473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:06:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-022474d6-314d-4d5d-a68c-c5be5f4aec3f tempest-VolumeDependencyTests-1874592473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:06:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-022474d6-314d-4d5d-a68c-c5be5f4aec3f tempest-VolumeDependencyTests-1874592473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:06:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-022474d6-314d-4d5d-a68c-c5be5f4aec3f tempest-VolumeDependencyTests-1874592473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:06:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-022474d6-314d-4d5d-a68c-c5be5f4aec3f tempest-VolumeDependencyTests-1874592473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-022474d6-314d-4d5d-a68c-c5be5f4aec3f tempest-VolumeDependencyTests-1874592473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-88129916-4070-4780-b8d4-2d21b91ebe7d tempest-ProjectMemberTests-1312558137 None] Acquiring lock "cinder-a637e532-1953-44a2-84b9-9abe67ff5204-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:06:59 devstack sudo[107854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:06:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-88129916-4070-4780-b8d4-2d21b91ebe7d tempest-ProjectMemberTests-1312558137 None] Lock "cinder-a637e532-1953-44a2-84b9-9abe67ff5204-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:06:59 devstack sudo[107854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-88129916-4070-4780-b8d4-2d21b91ebe7d tempest-ProjectMemberTests-1312558137 None] Acquiring lock "cinder-quobyte-1bc5587f-190c-4a61-aa5a-11acfaeb8e65" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:06:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-88129916-4070-4780-b8d4-2d21b91ebe7d tempest-ProjectMemberTests-1312558137 None] Lock "cinder-quobyte-1bc5587f-190c-4a61-aa5a-11acfaeb8e65" acquired by "delete_snapshot" :: waited 0.060s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:06:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-88129916-4070-4780-b8d4-2d21b91ebe7d tempest-ProjectMemberTests-1312558137 None] Acquiring lock "cinder-quobyte-a637e532-1953-44a2-84b9-9abe67ff5204" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:06:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-88129916-4070-4780-b8d4-2d21b91ebe7d tempest-ProjectMemberTests-1312558137 None] Lock "cinder-quobyte-a637e532-1953-44a2-84b9-9abe67ff5204" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:06:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-88129916-4070-4780-b8d4-2d21b91ebe7d tempest-ProjectMemberTests-1312558137 None] Deleting offline snapshot a637e532-1953-44a2-84b9-9abe67ff5204 of volume 1bc5587f-190c-4a61-aa5a-11acfaeb8e65 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:06:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-88129916-4070-4780-b8d4-2d21b91ebe7d tempest-ProjectMemberTests-1312558137 None] snapshot_file for this snap is: volume-1bc5587f-190c-4a61-aa5a-11acfaeb8e65.a637e532-1953-44a2-84b9-9abe67ff5204 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:06:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7b29096f-8ff3-4eb1-b79c-260da56e99fd tempest-VolumeDependencyTests-1874592473 None] Acquiring lock "cinder-5f664a47-4ffd-41a1-b0ba-65fd3dbd6887-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:06:59 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[2991fae0-c511-4221-8800-2634a988f137]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:06:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-88129916-4070-4780-b8d4-2d21b91ebe7d tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1bc5587f-190c-4a61-aa5a-11acfaeb8e65.a637e532-1953-44a2-84b9-9abe67ff5204 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7b29096f-8ff3-4eb1-b79c-260da56e99fd tempest-VolumeDependencyTests-1874592473 None] Lock "cinder-5f664a47-4ffd-41a1-b0ba-65fd3dbd6887-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:06:59 devstack sudo[107852]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e82e6740-2f57-4b38-893f-143fb0b6faef tempest-CinderUnicodeTest-82330997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-38dad994-9fd9-4650-9793-4d3e320d79b2" returned: 0 in 0.402s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e82e6740-2f57-4b38-893f-143fb0b6faef tempest-CinderUnicodeTest-82330997 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:06:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e82e6740-2f57-4b38-893f-143fb0b6faef tempest-CinderUnicodeTest-82330997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:06:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e82e6740-2f57-4b38-893f-143fb0b6faef tempest-CinderUnicodeTest-82330997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b63e1129-6a20-4b3a-adb9-e7f6a08265ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38dad994-9fd9-4650-9793-4d3e320d79b2', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e82e6740-2f57-4b38-893f-143fb0b6faef tempest-CinderUnicodeTest-82330997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a053ce3-86f0-4866-9672-ba10245a0820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:06:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7b29096f-8ff3-4eb1-b79c-260da56e99fd tempest-VolumeDependencyTests-1874592473 None] Acquiring lock "cinder-quobyte-5f664a47-4ffd-41a1-b0ba-65fd3dbd6887" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:06:59 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-e82e6740-2f57-4b38-893f-143fb0b6faef tempest-CinderUnicodeTest-82330997 None] Volume volume-38dad994-9fd9-4650-9793-4d3e320d79b2 (38dad994-9fd9-4650-9793-4d3e320d79b2): created successfully Sep 28 12:06:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e82e6740-2f57-4b38-893f-143fb0b6faef tempest-CinderUnicodeTest-82330997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a053ce3-86f0-4866-9672-ba10245a0820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:06:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e82e6740-2f57-4b38-893f-143fb0b6faef tempest-CinderUnicodeTest-82330997 None] Flow 'volume_create_manager' (cf5c3b7b-1c33-49a4-9b26-c64ac8b2e882) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:06:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7b29096f-8ff3-4eb1-b79c-260da56e99fd tempest-VolumeDependencyTests-1874592473 None] Lock "cinder-quobyte-5f664a47-4ffd-41a1-b0ba-65fd3dbd6887" acquired by "delete_volume" :: waited 0.050s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:06:59 devstack sudo[107857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1bc5587f-190c-4a61-aa5a-11acfaeb8e65.a637e532-1953-44a2-84b9-9abe67ff5204 Sep 28 12:06:59 devstack sudo[107857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:59 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e82e6740-2f57-4b38-893f-143fb0b6faef tempest-CinderUnicodeTest-82330997 None] Created volume successfully. Sep 28 12:06:59 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[966a75e5-5fc0-478d-a409-0f3ef2c9969c]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:06:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7b29096f-8ff3-4eb1-b79c-260da56e99fd tempest-VolumeDependencyTests-1874592473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5f664a47-4ffd-41a1-b0ba-65fd3dbd6887 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:59 devstack sudo[107854]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-022474d6-314d-4d5d-a68c-c5be5f4aec3f tempest-VolumeDependencyTests-1874592473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.458s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:59 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-022474d6-314d-4d5d-a68c-c5be5f4aec3f tempest-VolumeDependencyTests-1874592473 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:06:59 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-022474d6-314d-4d5d-a68c-c5be5f4aec3f tempest-VolumeDependencyTests-1874592473 None] Deleted volume successfully. Sep 28 12:06:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-022474d6-314d-4d5d-a68c-c5be5f4aec3f tempest-VolumeDependencyTests-1874592473 None] Lock "cinder-2aaa7054-f0e9-4648-8ae6-8bccfebae37a-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:06:59 devstack sudo[107860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5f664a47-4ffd-41a1-b0ba-65fd3dbd6887 Sep 28 12:06:59 devstack sudo[107860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:59 devstack sudo[107857]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-88129916-4070-4780-b8d4-2d21b91ebe7d tempest-ProjectMemberTests-1312558137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1bc5587f-190c-4a61-aa5a-11acfaeb8e65.a637e532-1953-44a2-84b9-9abe67ff5204" returned: 0 in 0.480s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-88129916-4070-4780-b8d4-2d21b91ebe7d tempest-ProjectMemberTests-1312558137 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1bc5587f-190c-4a61-aa5a-11acfaeb8e65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:06:59 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf719c1f-391b-499e-9f45-067fecee7384]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:06:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-88129916-4070-4780-b8d4-2d21b91ebe7d tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1bc5587f-190c-4a61-aa5a-11acfaeb8e65 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:00 devstack sudo[107865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1bc5587f-190c-4a61-aa5a-11acfaeb8e65 Sep 28 12:07:00 devstack sudo[107865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:00 devstack sudo[107860]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7b29096f-8ff3-4eb1-b79c-260da56e99fd tempest-VolumeDependencyTests-1874592473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5f664a47-4ffd-41a1-b0ba-65fd3dbd6887" returned: 0 in 0.512s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7b29096f-8ff3-4eb1-b79c-260da56e99fd tempest-VolumeDependencyTests-1874592473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5f664a47-4ffd-41a1-b0ba-65fd3dbd6887 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:00 devstack sudo[107870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5f664a47-4ffd-41a1-b0ba-65fd3dbd6887 Sep 28 12:07:00 devstack sudo[107870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-76ac5cdc-88aa-49c3-a9a4-befbd485980b tempest-CinderUnicodeTest-82330997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:07:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-76ac5cdc-88aa-49c3-a9a4-befbd485980b tempest-CinderUnicodeTest-82330997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:07:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-76ac5cdc-88aa-49c3-a9a4-befbd485980b tempest-CinderUnicodeTest-82330997 None] Creating offline snapshot 94cccbbb-cc9b-47fb-9d47-ecfda0f8720c of volume 38dad994-9fd9-4650-9793-4d3e320d79b2 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:07:00 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d3248a-2fab-484a-88d3-999314440228]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:07:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-76ac5cdc-88aa-49c3-a9a4-befbd485980b tempest-CinderUnicodeTest-82330997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-38dad994-9fd9-4650-9793-4d3e320d79b2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:00 devstack sudo[107865]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-88129916-4070-4780-b8d4-2d21b91ebe7d tempest-ProjectMemberTests-1312558137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1bc5587f-190c-4a61-aa5a-11acfaeb8e65" returned: 0 in 0.482s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-88129916-4070-4780-b8d4-2d21b91ebe7d tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1bc5587f-190c-4a61-aa5a-11acfaeb8e65.a637e532-1953-44a2-84b9-9abe67ff5204 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:00 devstack sudo[107879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1bc5587f-190c-4a61-aa5a-11acfaeb8e65.a637e532-1953-44a2-84b9-9abe67ff5204 Sep 28 12:07:00 devstack sudo[107879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:00 devstack sudo[107876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-38dad994-9fd9-4650-9793-4d3e320d79b2 Sep 28 12:07:00 devstack sudo[107876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:00 devstack sudo[107870]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7b29096f-8ff3-4eb1-b79c-260da56e99fd tempest-VolumeDependencyTests-1874592473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-5f664a47-4ffd-41a1-b0ba-65fd3dbd6887" returned: 0 in 0.402s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7b29096f-8ff3-4eb1-b79c-260da56e99fd tempest-VolumeDependencyTests-1874592473 None] Lock "cinder-quobyte-5f664a47-4ffd-41a1-b0ba-65fd3dbd6887" released by "delete_volume" :: held 0.993s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:07:00 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-7b29096f-8ff3-4eb1-b79c-260da56e99fd tempest-VolumeDependencyTests-1874592473 None] Created reservations ['cfdd9e1a-1ead-41c3-bfdd-e0bc438e5979', '3679efb2-9683-4c57-b2ad-57b70080ee52', '83beac6c-e488-4e6c-8fe3-83695ec1c4de', 'df3654bc-32f5-4d47-8579-1bd4278f7f3f'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:07:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7b29096f-8ff3-4eb1-b79c-260da56e99fd tempest-VolumeDependencyTests-1874592473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:07:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7b29096f-8ff3-4eb1-b79c-260da56e99fd tempest-VolumeDependencyTests-1874592473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:07:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7b29096f-8ff3-4eb1-b79c-260da56e99fd tempest-VolumeDependencyTests-1874592473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:07:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7b29096f-8ff3-4eb1-b79c-260da56e99fd tempest-VolumeDependencyTests-1874592473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:07:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7b29096f-8ff3-4eb1-b79c-260da56e99fd tempest-VolumeDependencyTests-1874592473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:07:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7b29096f-8ff3-4eb1-b79c-260da56e99fd tempest-VolumeDependencyTests-1874592473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:00 devstack sudo[107884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:07:00 devstack sudo[107884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:00 devstack sudo[107876]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-76ac5cdc-88aa-49c3-a9a4-befbd485980b tempest-CinderUnicodeTest-82330997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-38dad994-9fd9-4650-9793-4d3e320d79b2" returned: 0 in 0.472s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-76ac5cdc-88aa-49c3-a9a4-befbd485980b tempest-CinderUnicodeTest-82330997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-38dad994-9fd9-4650-9793-4d3e320d79b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-38dad994-9fd9-4650-9793-4d3e320d79b2.94cccbbb-cc9b-47fb-9d47-ecfda0f8720c 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:00 devstack sudo[107879]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:00 devstack sudo[107890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-38dad994-9fd9-4650-9793-4d3e320d79b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-38dad994-9fd9-4650-9793-4d3e320d79b2.94cccbbb-cc9b-47fb-9d47-ecfda0f8720c 1G Sep 28 12:07:00 devstack sudo[107890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-88129916-4070-4780-b8d4-2d21b91ebe7d tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1bc5587f-190c-4a61-aa5a-11acfaeb8e65.a637e532-1953-44a2-84b9-9abe67ff5204" returned: 0 in 0.459s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-88129916-4070-4780-b8d4-2d21b91ebe7d tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1bc5587f-190c-4a61-aa5a-11acfaeb8e65.a637e532-1953-44a2-84b9-9abe67ff5204 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:00 devstack sudo[107892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1bc5587f-190c-4a61-aa5a-11acfaeb8e65.a637e532-1953-44a2-84b9-9abe67ff5204 Sep 28 12:07:00 devstack sudo[107892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:01 devstack sudo[107884]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7b29096f-8ff3-4eb1-b79c-260da56e99fd tempest-VolumeDependencyTests-1874592473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.325s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:01 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-7b29096f-8ff3-4eb1-b79c-260da56e99fd tempest-VolumeDependencyTests-1874592473 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:07:01 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-7b29096f-8ff3-4eb1-b79c-260da56e99fd tempest-VolumeDependencyTests-1874592473 None] Deleted volume successfully. Sep 28 12:07:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7b29096f-8ff3-4eb1-b79c-260da56e99fd tempest-VolumeDependencyTests-1874592473 None] Lock "cinder-5f664a47-4ffd-41a1-b0ba-65fd3dbd6887-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:07:01 devstack sudo[107892]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-88129916-4070-4780-b8d4-2d21b91ebe7d tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1bc5587f-190c-4a61-aa5a-11acfaeb8e65.a637e532-1953-44a2-84b9-9abe67ff5204" returned: 0 in 0.340s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-88129916-4070-4780-b8d4-2d21b91ebe7d tempest-ProjectMemberTests-1312558137 None] Lock "cinder-quobyte-a637e532-1953-44a2-84b9-9abe67ff5204" released by "_delete_snapshot" :: held 1.964s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:07:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-88129916-4070-4780-b8d4-2d21b91ebe7d tempest-ProjectMemberTests-1312558137 None] Lock "cinder-quobyte-1bc5587f-190c-4a61-aa5a-11acfaeb8e65" released by "delete_snapshot" :: held 1.994s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:07:01 devstack sudo[107890]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-76ac5cdc-88aa-49c3-a9a4-befbd485980b tempest-CinderUnicodeTest-82330997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-38dad994-9fd9-4650-9793-4d3e320d79b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-38dad994-9fd9-4650-9793-4d3e320d79b2.94cccbbb-cc9b-47fb-9d47-ecfda0f8720c 1G" returned: 0 in 0.501s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-76ac5cdc-88aa-49c3-a9a4-befbd485980b tempest-CinderUnicodeTest-82330997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38dad994-9fd9-4650-9793-4d3e320d79b2 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-38dad994-9fd9-4650-9793-4d3e320d79b2.94cccbbb-cc9b-47fb-9d47-ecfda0f8720c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:01 devstack sudo[107900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38dad994-9fd9-4650-9793-4d3e320d79b2 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-38dad994-9fd9-4650-9793-4d3e320d79b2.94cccbbb-cc9b-47fb-9d47-ecfda0f8720c Sep 28 12:07:01 devstack sudo[107900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:01 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-88129916-4070-4780-b8d4-2d21b91ebe7d tempest-ProjectMemberTests-1312558137 None] Created reservations ['2f23d68e-934c-4bad-9c96-9a8fae92c30a', 'ba15c7f0-1d8c-4d30-9a6a-0a98d76c97dd', '8a505c96-56b1-4972-abc5-63f6876d5f49', 'bbb7de8b-0cd5-4f3c-8c50-356cf5dbbd51'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:07:01 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-88129916-4070-4780-b8d4-2d21b91ebe7d tempest-ProjectMemberTests-1312558137 None] Delete snapshot completed successfully. Sep 28 12:07:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-88129916-4070-4780-b8d4-2d21b91ebe7d tempest-ProjectMemberTests-1312558137 None] Lock "cinder-a637e532-1953-44a2-84b9-9abe67ff5204-delete_snapshot" released by "delete_snapshot" :: held 2.299s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:07:01 devstack sudo[107900]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-76ac5cdc-88aa-49c3-a9a4-befbd485980b tempest-CinderUnicodeTest-82330997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38dad994-9fd9-4650-9793-4d3e320d79b2 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-38dad994-9fd9-4650-9793-4d3e320d79b2.94cccbbb-cc9b-47fb-9d47-ecfda0f8720c" returned: 0 in 0.354s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:01 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-76ac5cdc-88aa-49c3-a9a4-befbd485980b tempest-CinderUnicodeTest-82330997 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-38dad994-9fd9-4650-9793-4d3e320d79b2.94cccbbb-cc9b-47fb-9d47-ecfda0f8720c is being set with open permissions: ugo+rw Sep 28 12:07:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-76ac5cdc-88aa-49c3-a9a4-befbd485980b tempest-CinderUnicodeTest-82330997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-38dad994-9fd9-4650-9793-4d3e320d79b2.94cccbbb-cc9b-47fb-9d47-ecfda0f8720c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:01 devstack sudo[107905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-38dad994-9fd9-4650-9793-4d3e320d79b2.94cccbbb-cc9b-47fb-9d47-ecfda0f8720c Sep 28 12:07:01 devstack sudo[107905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:01 devstack sudo[107905]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-76ac5cdc-88aa-49c3-a9a4-befbd485980b tempest-CinderUnicodeTest-82330997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-38dad994-9fd9-4650-9793-4d3e320d79b2.94cccbbb-cc9b-47fb-9d47-ecfda0f8720c" returned: 0 in 0.265s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-76ac5cdc-88aa-49c3-a9a4-befbd485980b tempest-CinderUnicodeTest-82330997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-38dad994-9fd9-4650-9793-4d3e320d79b2.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:02 devstack sudo[107908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-38dad994-9fd9-4650-9793-4d3e320d79b2.info Sep 28 12:07:02 devstack sudo[107908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:02 devstack sudo[107908]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-76ac5cdc-88aa-49c3-a9a4-befbd485980b tempest-CinderUnicodeTest-82330997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-38dad994-9fd9-4650-9793-4d3e320d79b2.info" returned: 0 in 0.283s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:02 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-76ac5cdc-88aa-49c3-a9a4-befbd485980b tempest-CinderUnicodeTest-82330997 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-38dad994-9fd9-4650-9793-4d3e320d79b2.info is being set with open permissions: ugo+rw Sep 28 12:07:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-76ac5cdc-88aa-49c3-a9a4-befbd485980b tempest-CinderUnicodeTest-82330997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-38dad994-9fd9-4650-9793-4d3e320d79b2.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:02 devstack sudo[107911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-38dad994-9fd9-4650-9793-4d3e320d79b2.info Sep 28 12:07:02 devstack sudo[107911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d3d52743-7550-446e-ac94-c6ddb3062c3b tempest-ProjectMemberTests-1312558137 None] Acquiring lock "cinder-1bc5587f-190c-4a61-aa5a-11acfaeb8e65-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:07:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d3d52743-7550-446e-ac94-c6ddb3062c3b tempest-ProjectMemberTests-1312558137 None] Lock "cinder-1bc5587f-190c-4a61-aa5a-11acfaeb8e65-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:07:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d3d52743-7550-446e-ac94-c6ddb3062c3b tempest-ProjectMemberTests-1312558137 None] Acquiring lock "cinder-quobyte-1bc5587f-190c-4a61-aa5a-11acfaeb8e65" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:07:02 devstack sudo[107911]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d3d52743-7550-446e-ac94-c6ddb3062c3b tempest-ProjectMemberTests-1312558137 None] Lock "cinder-quobyte-1bc5587f-190c-4a61-aa5a-11acfaeb8e65" acquired by "delete_volume" :: waited 0.025s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:07:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-76ac5cdc-88aa-49c3-a9a4-befbd485980b tempest-CinderUnicodeTest-82330997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-38dad994-9fd9-4650-9793-4d3e320d79b2.info" returned: 0 in 0.414s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-76ac5cdc-88aa-49c3-a9a4-befbd485980b tempest-CinderUnicodeTest-82330997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.414s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:07:02 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f617c6-bb35-4f5a-8e49-fc7d6a741a27]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:07:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d3d52743-7550-446e-ac94-c6ddb3062c3b tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1bc5587f-190c-4a61-aa5a-11acfaeb8e65 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:02 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-76ac5cdc-88aa-49c3-a9a4-befbd485980b tempest-CinderUnicodeTest-82330997 None] Create snapshot completed successfully Sep 28 12:07:02 devstack sudo[107914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1bc5587f-190c-4a61-aa5a-11acfaeb8e65 Sep 28 12:07:02 devstack sudo[107914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:03 devstack sudo[107914]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d3d52743-7550-446e-ac94-c6ddb3062c3b tempest-ProjectMemberTests-1312558137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1bc5587f-190c-4a61-aa5a-11acfaeb8e65" returned: 0 in 0.434s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d3d52743-7550-446e-ac94-c6ddb3062c3b tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1bc5587f-190c-4a61-aa5a-11acfaeb8e65 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:03 devstack sudo[107920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1bc5587f-190c-4a61-aa5a-11acfaeb8e65 Sep 28 12:07:03 devstack sudo[107920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-123f0a16-8e68-4c79-8e8e-188cb0a93e61 tempest-CinderUnicodeTest-82330997 None] Acquiring lock "cinder-94cccbbb-cc9b-47fb-9d47-ecfda0f8720c-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:07:03 devstack sudo[107920]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d3d52743-7550-446e-ac94-c6ddb3062c3b tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-1bc5587f-190c-4a61-aa5a-11acfaeb8e65" returned: 0 in 0.312s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-123f0a16-8e68-4c79-8e8e-188cb0a93e61 tempest-CinderUnicodeTest-82330997 None] Lock "cinder-94cccbbb-cc9b-47fb-9d47-ecfda0f8720c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:07:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-123f0a16-8e68-4c79-8e8e-188cb0a93e61 tempest-CinderUnicodeTest-82330997 None] Acquiring lock "cinder-quobyte-38dad994-9fd9-4650-9793-4d3e320d79b2" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:07:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d3d52743-7550-446e-ac94-c6ddb3062c3b tempest-ProjectMemberTests-1312558137 None] Lock "cinder-quobyte-1bc5587f-190c-4a61-aa5a-11acfaeb8e65" released by "delete_volume" :: held 0.856s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:07:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-123f0a16-8e68-4c79-8e8e-188cb0a93e61 tempest-CinderUnicodeTest-82330997 None] Lock "cinder-quobyte-38dad994-9fd9-4650-9793-4d3e320d79b2" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:07:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-123f0a16-8e68-4c79-8e8e-188cb0a93e61 tempest-CinderUnicodeTest-82330997 None] Acquiring lock "cinder-quobyte-94cccbbb-cc9b-47fb-9d47-ecfda0f8720c" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:07:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-123f0a16-8e68-4c79-8e8e-188cb0a93e61 tempest-CinderUnicodeTest-82330997 None] Lock "cinder-quobyte-94cccbbb-cc9b-47fb-9d47-ecfda0f8720c" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:07:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-123f0a16-8e68-4c79-8e8e-188cb0a93e61 tempest-CinderUnicodeTest-82330997 None] Deleting offline snapshot 94cccbbb-cc9b-47fb-9d47-ecfda0f8720c of volume 38dad994-9fd9-4650-9793-4d3e320d79b2 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:07:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-123f0a16-8e68-4c79-8e8e-188cb0a93e61 tempest-CinderUnicodeTest-82330997 None] snapshot_file for this snap is: volume-38dad994-9fd9-4650-9793-4d3e320d79b2.94cccbbb-cc9b-47fb-9d47-ecfda0f8720c {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:07:03 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee45514-8c08-43ca-b4df-767c078a55bc]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:07:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-123f0a16-8e68-4c79-8e8e-188cb0a93e61 tempest-CinderUnicodeTest-82330997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-38dad994-9fd9-4650-9793-4d3e320d79b2.94cccbbb-cc9b-47fb-9d47-ecfda0f8720c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:03 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-d3d52743-7550-446e-ac94-c6ddb3062c3b tempest-ProjectMemberTests-1312558137 None] Created reservations ['f21b3c7b-2571-4433-9ddd-2635a166f95b', '7931bac9-7798-4f36-9fa9-d3c4daf82943', 'be380760-a2f5-4418-bce1-0a2cd6d75df9', 'c2c14052-33ba-452e-abcc-5d4702b6d2af'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:07:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d3d52743-7550-446e-ac94-c6ddb3062c3b tempest-ProjectMemberTests-1312558137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:07:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d3d52743-7550-446e-ac94-c6ddb3062c3b tempest-ProjectMemberTests-1312558137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:07:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d3d52743-7550-446e-ac94-c6ddb3062c3b tempest-ProjectMemberTests-1312558137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:07:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d3d52743-7550-446e-ac94-c6ddb3062c3b tempest-ProjectMemberTests-1312558137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:07:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d3d52743-7550-446e-ac94-c6ddb3062c3b tempest-ProjectMemberTests-1312558137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:07:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d3d52743-7550-446e-ac94-c6ddb3062c3b tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:03 devstack sudo[107924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:07:03 devstack sudo[107924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:03 devstack sudo[107923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-38dad994-9fd9-4650-9793-4d3e320d79b2.94cccbbb-cc9b-47fb-9d47-ecfda0f8720c Sep 28 12:07:03 devstack sudo[107923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:03 devstack sudo[107924]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d3d52743-7550-446e-ac94-c6ddb3062c3b tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.278s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:03 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-d3d52743-7550-446e-ac94-c6ddb3062c3b tempest-ProjectMemberTests-1312558137 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:07:03 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-d3d52743-7550-446e-ac94-c6ddb3062c3b tempest-ProjectMemberTests-1312558137 None] Deleted volume successfully. Sep 28 12:07:03 devstack sudo[107923]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-123f0a16-8e68-4c79-8e8e-188cb0a93e61 tempest-CinderUnicodeTest-82330997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-38dad994-9fd9-4650-9793-4d3e320d79b2.94cccbbb-cc9b-47fb-9d47-ecfda0f8720c" returned: 0 in 0.395s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-123f0a16-8e68-4c79-8e8e-188cb0a93e61 tempest-CinderUnicodeTest-82330997 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38dad994-9fd9-4650-9793-4d3e320d79b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:07:04 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d3d52743-7550-446e-ac94-c6ddb3062c3b tempest-ProjectMemberTests-1312558137 None] Lock "cinder-1bc5587f-190c-4a61-aa5a-11acfaeb8e65-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:07:04 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[67161108-b804-451e-8efb-d34386b8b70b]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:07:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-123f0a16-8e68-4c79-8e8e-188cb0a93e61 tempest-CinderUnicodeTest-82330997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-38dad994-9fd9-4650-9793-4d3e320d79b2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:04 devstack sudo[107931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-38dad994-9fd9-4650-9793-4d3e320d79b2 Sep 28 12:07:04 devstack sudo[107931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:04 devstack sudo[107931]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-123f0a16-8e68-4c79-8e8e-188cb0a93e61 tempest-CinderUnicodeTest-82330997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-38dad994-9fd9-4650-9793-4d3e320d79b2" returned: 0 in 0.385s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-123f0a16-8e68-4c79-8e8e-188cb0a93e61 tempest-CinderUnicodeTest-82330997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-38dad994-9fd9-4650-9793-4d3e320d79b2.94cccbbb-cc9b-47fb-9d47-ecfda0f8720c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:04 devstack sudo[107936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-38dad994-9fd9-4650-9793-4d3e320d79b2.94cccbbb-cc9b-47fb-9d47-ecfda0f8720c Sep 28 12:07:04 devstack sudo[107936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:04 devstack sudo[107936]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-123f0a16-8e68-4c79-8e8e-188cb0a93e61 tempest-CinderUnicodeTest-82330997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-38dad994-9fd9-4650-9793-4d3e320d79b2.94cccbbb-cc9b-47fb-9d47-ecfda0f8720c" returned: 0 in 0.453s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-123f0a16-8e68-4c79-8e8e-188cb0a93e61 tempest-CinderUnicodeTest-82330997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-38dad994-9fd9-4650-9793-4d3e320d79b2.94cccbbb-cc9b-47fb-9d47-ecfda0f8720c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:04 devstack sudo[107942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-38dad994-9fd9-4650-9793-4d3e320d79b2.94cccbbb-cc9b-47fb-9d47-ecfda0f8720c Sep 28 12:07:04 devstack sudo[107942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:05 devstack sudo[107942]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-123f0a16-8e68-4c79-8e8e-188cb0a93e61 tempest-CinderUnicodeTest-82330997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-38dad994-9fd9-4650-9793-4d3e320d79b2.94cccbbb-cc9b-47fb-9d47-ecfda0f8720c" returned: 0 in 0.367s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-123f0a16-8e68-4c79-8e8e-188cb0a93e61 tempest-CinderUnicodeTest-82330997 None] Lock "cinder-quobyte-94cccbbb-cc9b-47fb-9d47-ecfda0f8720c" released by "_delete_snapshot" :: held 1.786s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:07:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-123f0a16-8e68-4c79-8e8e-188cb0a93e61 tempest-CinderUnicodeTest-82330997 None] Lock "cinder-quobyte-38dad994-9fd9-4650-9793-4d3e320d79b2" released by "delete_snapshot" :: held 1.835s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:07:05 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bbcc1d1-ac8d-4372-91f8-427f6a6793f9 tempest-ProjectMemberTests-1312558137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:07:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4bbcc1d1-ac8d-4372-91f8-427f6a6793f9 tempest-ProjectMemberTests-1312558137 None] Flow 'volume_create_manager' (cfef6990-146c-4b33-a694-f35adf5be687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:07:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4bbcc1d1-ac8d-4372-91f8-427f6a6793f9 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7405fac5-b327-4dd7-9766-b36b198562a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4bbcc1d1-ac8d-4372-91f8-427f6a6793f9 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7405fac5-b327-4dd7-9766-b36b198562a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1506901871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87444a0e-3cf8-441e-b209-e80def373364,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba606417eb184510b6154fa1a28dce16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:07:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:07:05Z,use_quota=True,user_id='bb30da770afa465f8162e7779a473226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4bbcc1d1-ac8d-4372-91f8-427f6a6793f9 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3c35198-b0eb-4cf2-8b02-a50fa2d91bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4bbcc1d1-ac8d-4372-91f8-427f6a6793f9 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3c35198-b0eb-4cf2-8b02-a50fa2d91bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4bbcc1d1-ac8d-4372-91f8-427f6a6793f9 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48162a76-2e67-41df-a443-d79d581abfad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4bbcc1d1-ac8d-4372-91f8-427f6a6793f9 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48162a76-2e67-41df-a443-d79d581abfad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87444a0e-3cf8-441e-b209-e80def373364', 'volume_name': 'volume-87444a0e-3cf8-441e-b209-e80def373364', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4bbcc1d1-ac8d-4372-91f8-427f6a6793f9 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b948c5d-6ba5-436c-b504-0e8e6d5f589c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4bbcc1d1-ac8d-4372-91f8-427f6a6793f9 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b948c5d-6ba5-436c-b504-0e8e6d5f589c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4bbcc1d1-ac8d-4372-91f8-427f6a6793f9 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f90a88d-66ca-4384-a9f9-66d1cc5a5db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:05 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-4bbcc1d1-ac8d-4372-91f8-427f6a6793f9 tempest-ProjectMemberTests-1312558137 None] Volume 87444a0e-3cf8-441e-b209-e80def373364: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87444a0e-3cf8-441e-b209-e80def373364', 'volume_size': 1} Sep 28 12:07:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4bbcc1d1-ac8d-4372-91f8-427f6a6793f9 tempest-ProjectMemberTests-1312558137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:07:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4bbcc1d1-ac8d-4372-91f8-427f6a6793f9 tempest-ProjectMemberTests-1312558137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:07:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4bbcc1d1-ac8d-4372-91f8-427f6a6793f9 tempest-ProjectMemberTests-1312558137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1506901871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87444a0e-3cf8-441e-b209-e80def373364,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba606417eb184510b6154fa1a28dce16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:07:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:07:05Z,use_quota=True,user_id='bb30da770afa465f8162e7779a473226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:07:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-4bbcc1d1-ac8d-4372-91f8-427f6a6793f9 tempest-ProjectMemberTests-1312558137 None] Creating volume 87444a0e-3cf8-441e-b209-e80def373364 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:07:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4bbcc1d1-ac8d-4372-91f8-427f6a6793f9 tempest-ProjectMemberTests-1312558137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:07:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4bbcc1d1-ac8d-4372-91f8-427f6a6793f9 tempest-ProjectMemberTests-1312558137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:07:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4bbcc1d1-ac8d-4372-91f8-427f6a6793f9 tempest-ProjectMemberTests-1312558137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:07:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4bbcc1d1-ac8d-4372-91f8-427f6a6793f9 tempest-ProjectMemberTests-1312558137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:07:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4bbcc1d1-ac8d-4372-91f8-427f6a6793f9 tempest-ProjectMemberTests-1312558137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:07:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4bbcc1d1-ac8d-4372-91f8-427f6a6793f9 tempest-ProjectMemberTests-1312558137 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:07:05 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-4bbcc1d1-ac8d-4372-91f8-427f6a6793f9 tempest-ProjectMemberTests-1312558137 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:07:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4bbcc1d1-ac8d-4372-91f8-427f6a6793f9 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-87444a0e-3cf8-441e-b209-e80def373364 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:05 devstack sudo[107945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-87444a0e-3cf8-441e-b209-e80def373364 1073741824 Sep 28 12:07:05 devstack sudo[107945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:05 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-123f0a16-8e68-4c79-8e8e-188cb0a93e61 tempest-CinderUnicodeTest-82330997 None] Created reservations ['5d8cdce0-bf7f-45e8-9ad8-1c9d1ea4be9a', 'bc87a9ef-938b-48a0-88e5-7cab58b44061', '832fa330-a1bd-4d8a-bf77-ac94f360dec2', '13fa9c01-b8ad-4897-9563-6c5d044d0cea'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:07:05 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-123f0a16-8e68-4c79-8e8e-188cb0a93e61 tempest-CinderUnicodeTest-82330997 None] Delete snapshot completed successfully. Sep 28 12:07:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-123f0a16-8e68-4c79-8e8e-188cb0a93e61 tempest-CinderUnicodeTest-82330997 None] Lock "cinder-94cccbbb-cc9b-47fb-9d47-ecfda0f8720c-delete_snapshot" released by "delete_snapshot" :: held 2.213s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:07:05 devstack sudo[107945]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4bbcc1d1-ac8d-4372-91f8-427f6a6793f9 tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-87444a0e-3cf8-441e-b209-e80def373364 1073741824" returned: 0 in 0.471s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4bbcc1d1-ac8d-4372-91f8-427f6a6793f9 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-87444a0e-3cf8-441e-b209-e80def373364 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:06 devstack sudo[107951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-87444a0e-3cf8-441e-b209-e80def373364 Sep 28 12:07:06 devstack sudo[107951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:06 devstack sudo[107951]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4bbcc1d1-ac8d-4372-91f8-427f6a6793f9 tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-87444a0e-3cf8-441e-b209-e80def373364" returned: 0 in 0.258s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4bbcc1d1-ac8d-4372-91f8-427f6a6793f9 tempest-ProjectMemberTests-1312558137 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:07:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4bbcc1d1-ac8d-4372-91f8-427f6a6793f9 tempest-ProjectMemberTests-1312558137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:07:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4bbcc1d1-ac8d-4372-91f8-427f6a6793f9 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f90a88d-66ca-4384-a9f9-66d1cc5a5db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87444a0e-3cf8-441e-b209-e80def373364', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4bbcc1d1-ac8d-4372-91f8-427f6a6793f9 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c9826df-224a-4c45-a237-d1a47edf5180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:06 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-4bbcc1d1-ac8d-4372-91f8-427f6a6793f9 tempest-ProjectMemberTests-1312558137 None] Volume volume-87444a0e-3cf8-441e-b209-e80def373364 (87444a0e-3cf8-441e-b209-e80def373364): created successfully Sep 28 12:07:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4bbcc1d1-ac8d-4372-91f8-427f6a6793f9 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c9826df-224a-4c45-a237-d1a47edf5180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4bbcc1d1-ac8d-4372-91f8-427f6a6793f9 tempest-ProjectMemberTests-1312558137 None] Flow 'volume_create_manager' (cfef6990-146c-4b33-a694-f35adf5be687) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:07:06 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-4bbcc1d1-ac8d-4372-91f8-427f6a6793f9 tempest-ProjectMemberTests-1312558137 None] Created volume successfully. Sep 28 12:07:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-418391d6-68e0-49dd-b42d-d63ea7e0c9ea tempest-CinderUnicodeTest-82330997 None] Acquiring lock "cinder-38dad994-9fd9-4650-9793-4d3e320d79b2-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:07:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-418391d6-68e0-49dd-b42d-d63ea7e0c9ea tempest-CinderUnicodeTest-82330997 None] Lock "cinder-38dad994-9fd9-4650-9793-4d3e320d79b2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:07:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-418391d6-68e0-49dd-b42d-d63ea7e0c9ea tempest-CinderUnicodeTest-82330997 None] Acquiring lock "cinder-quobyte-38dad994-9fd9-4650-9793-4d3e320d79b2" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:07:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-418391d6-68e0-49dd-b42d-d63ea7e0c9ea tempest-CinderUnicodeTest-82330997 None] Lock "cinder-quobyte-38dad994-9fd9-4650-9793-4d3e320d79b2" acquired by "delete_volume" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:07:06 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe06a6e-007e-4cac-be98-af9624ad9d7a]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:07:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-418391d6-68e0-49dd-b42d-d63ea7e0c9ea tempest-CinderUnicodeTest-82330997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-38dad994-9fd9-4650-9793-4d3e320d79b2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:06 devstack sudo[107954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-38dad994-9fd9-4650-9793-4d3e320d79b2 Sep 28 12:07:06 devstack sudo[107954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:07 devstack sudo[107954]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-418391d6-68e0-49dd-b42d-d63ea7e0c9ea tempest-CinderUnicodeTest-82330997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-38dad994-9fd9-4650-9793-4d3e320d79b2" returned: 0 in 0.414s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-418391d6-68e0-49dd-b42d-d63ea7e0c9ea tempest-CinderUnicodeTest-82330997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-38dad994-9fd9-4650-9793-4d3e320d79b2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:07 devstack sudo[107959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-38dad994-9fd9-4650-9793-4d3e320d79b2 Sep 28 12:07:07 devstack sudo[107959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:07 devstack sudo[107959]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-418391d6-68e0-49dd-b42d-d63ea7e0c9ea tempest-CinderUnicodeTest-82330997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-38dad994-9fd9-4650-9793-4d3e320d79b2" returned: 0 in 0.294s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-418391d6-68e0-49dd-b42d-d63ea7e0c9ea tempest-CinderUnicodeTest-82330997 None] Lock "cinder-quobyte-38dad994-9fd9-4650-9793-4d3e320d79b2" released by "delete_volume" :: held 0.781s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:07:07 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-418391d6-68e0-49dd-b42d-d63ea7e0c9ea tempest-CinderUnicodeTest-82330997 None] Created reservations ['62848fa9-0a62-4070-9a6e-891524a8ad72', '37e014e0-6819-4a1e-8952-c5f5e11af084', '0f9e9341-5a21-4bf0-ae39-24b733e2e289', 'cc039e82-bbe8-4129-8f6f-f3dd451e6abc'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:07:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-418391d6-68e0-49dd-b42d-d63ea7e0c9ea tempest-CinderUnicodeTest-82330997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:07:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-418391d6-68e0-49dd-b42d-d63ea7e0c9ea tempest-CinderUnicodeTest-82330997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:07:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-418391d6-68e0-49dd-b42d-d63ea7e0c9ea tempest-CinderUnicodeTest-82330997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:07:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-418391d6-68e0-49dd-b42d-d63ea7e0c9ea tempest-CinderUnicodeTest-82330997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:07:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-418391d6-68e0-49dd-b42d-d63ea7e0c9ea tempest-CinderUnicodeTest-82330997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:07:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-418391d6-68e0-49dd-b42d-d63ea7e0c9ea tempest-CinderUnicodeTest-82330997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:07 devstack sudo[107962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:07:07 devstack sudo[107962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:07 devstack sudo[107962]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-418391d6-68e0-49dd-b42d-d63ea7e0c9ea tempest-CinderUnicodeTest-82330997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.311s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:07 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-418391d6-68e0-49dd-b42d-d63ea7e0c9ea tempest-CinderUnicodeTest-82330997 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:07:07 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-418391d6-68e0-49dd-b42d-d63ea7e0c9ea tempest-CinderUnicodeTest-82330997 None] Deleted volume successfully. Sep 28 12:07:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b8d2a7a9-e1e3-414f-8dc6-090f0e38c36c tempest-CinderUnicodeTest-82330997 None] Acquiring lock "cinder-60bafc7b-7dec-4ee3-9f23-df9cfe73e2d1-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:07:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-418391d6-68e0-49dd-b42d-d63ea7e0c9ea tempest-CinderUnicodeTest-82330997 None] Lock "cinder-38dad994-9fd9-4650-9793-4d3e320d79b2-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:07:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b8d2a7a9-e1e3-414f-8dc6-090f0e38c36c tempest-CinderUnicodeTest-82330997 None] Lock "cinder-60bafc7b-7dec-4ee3-9f23-df9cfe73e2d1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:07:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b8d2a7a9-e1e3-414f-8dc6-090f0e38c36c tempest-CinderUnicodeTest-82330997 None] Acquiring lock "cinder-quobyte-60bafc7b-7dec-4ee3-9f23-df9cfe73e2d1" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:07:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b8d2a7a9-e1e3-414f-8dc6-090f0e38c36c tempest-CinderUnicodeTest-82330997 None] Lock "cinder-quobyte-60bafc7b-7dec-4ee3-9f23-df9cfe73e2d1" acquired by "delete_volume" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:07:09 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2bd6112-9450-4585-8012-1dd4a8ab59ed]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:07:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b8d2a7a9-e1e3-414f-8dc6-090f0e38c36c tempest-CinderUnicodeTest-82330997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-60bafc7b-7dec-4ee3-9f23-df9cfe73e2d1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:09 devstack sudo[107967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-60bafc7b-7dec-4ee3-9f23-df9cfe73e2d1 Sep 28 12:07:09 devstack sudo[107967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:10 devstack sudo[107967]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b8d2a7a9-e1e3-414f-8dc6-090f0e38c36c tempest-CinderUnicodeTest-82330997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-60bafc7b-7dec-4ee3-9f23-df9cfe73e2d1" returned: 0 in 0.366s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b8d2a7a9-e1e3-414f-8dc6-090f0e38c36c tempest-CinderUnicodeTest-82330997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-60bafc7b-7dec-4ee3-9f23-df9cfe73e2d1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:10 devstack sudo[107972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-60bafc7b-7dec-4ee3-9f23-df9cfe73e2d1 Sep 28 12:07:10 devstack sudo[107972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:10 devstack sudo[107972]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b8d2a7a9-e1e3-414f-8dc6-090f0e38c36c tempest-CinderUnicodeTest-82330997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-60bafc7b-7dec-4ee3-9f23-df9cfe73e2d1" returned: 0 in 0.255s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:10 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b8d2a7a9-e1e3-414f-8dc6-090f0e38c36c tempest-CinderUnicodeTest-82330997 None] Lock "cinder-quobyte-60bafc7b-7dec-4ee3-9f23-df9cfe73e2d1" released by "delete_volume" :: held 0.664s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:07:10 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:07:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] Flow 'volume_create_manager' (45bc0208-371f-4ad9-aa9c-73bfc1b131ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:07:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c4a1f87-bfd3-4ebc-9987-35f03112770d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c4a1f87-bfd3-4ebc-9987-35f03112770d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:07:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91e89787-f651-4dd2-adbf-b131dc9e9679,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='772148ac7dff46d8b5b7d1554200d264',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:07:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:07:08Z,use_quota=True,user_id='d870f7ffc623460cbaf8219131e89015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39852e4b-1a61-4d75-a031-6562dfd06352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39852e4b-1a61-4d75-a031-6562dfd06352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62931580-b193-477c-acb6-2d1346e6a723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:10 devstack cinder-volume[86916]: DEBUG cinder.image.glance [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] Creating Keystone auth plugin from conf {{(pid=86916) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 12:07:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62931580-b193-477c-acb6-2d1346e6a723) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '91e89787-f651-4dd2-adbf-b131dc9e9679', 'volume_name': 'volume-91e89787-f651-4dd2-adbf-b131dc9e9679', 'volume_size': 1, 'image_id': '1c14f1f5-af46-48fa-a24d-e36e528dd450', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1c14f1f5-af46-48fa-a24d-e36e528dd450', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ab4080133660ea4609d02dae5c9c9a61', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '772148ac7dff46d8b5b7d1554200d264', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b9037ae5c5b5963ac0c6985788387dc8f2814569184bcbf7f3b8f364abe9431d6609c7f3dcc4aa8665fde36384e9c3ed6c9cfc85783b201c64a11201bdaababe', 'id': '1c14f1f5-af46-48fa-a24d-e36e528dd450', 'created_at': datetime.datetime(2026, 9, 28, 10, 7, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 7, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c14f1f5-af46-48fa-a24d-e36e528dd450/file', 'properties': {}}, 'image_service': }' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35f44456-c753-49a2-838c-2b4e8ad3c57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35f44456-c753-49a2-838c-2b4e8ad3c57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bc8969d-1ce2-46c9-abcc-b72897c6c782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:11 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] Volume 91e89787-f651-4dd2-adbf-b131dc9e9679: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-91e89787-f651-4dd2-adbf-b131dc9e9679', 'volume_size': 1, 'image_id': '1c14f1f5-af46-48fa-a24d-e36e528dd450', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1c14f1f5-af46-48fa-a24d-e36e528dd450', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ab4080133660ea4609d02dae5c9c9a61', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '772148ac7dff46d8b5b7d1554200d264', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b9037ae5c5b5963ac0c6985788387dc8f2814569184bcbf7f3b8f364abe9431d6609c7f3dcc4aa8665fde36384e9c3ed6c9cfc85783b201c64a11201bdaababe', 'id': '1c14f1f5-af46-48fa-a24d-e36e528dd450', 'created_at': datetime.datetime(2026, 9, 28, 10, 7, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 7, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c14f1f5-af46-48fa-a24d-e36e528dd450/file', 'properties': {}}, 'image_service': } Sep 28 12:07:11 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] Trying to clone 91e89787-f651-4dd2-adbf-b131dc9e9679 from image 1c14f1f5-af46-48fa-a24d-e36e528dd450 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1c14f1f5-af46-48fa-a24d-e36e528dd450', 'metadata': {}}]). {{(pid=86916) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 12:07:12 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1c14f1f5-af46-48fa-a24d-e36e528dd450_gmlipk4tdevstack@QuobyteHD, size 0.00 MB, duration 1.18 sec {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 12:07:12 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] Image download 0.00 MB at 0.00 MB/s Sep 28 12:07:12 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[723b6268-2dbf-48ad-b4e0-302318c4ce88]: (4, 'raw') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:07:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c14f1f5-af46-48fa-a24d-e36e528dd450_gmlipk4tdevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:12 devstack sudo[107976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c14f1f5-af46-48fa-a24d-e36e528dd450_gmlipk4tdevstack@QuobyteHD Sep 28 12:07:12 devstack sudo[107976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8f5aaf75-93c8-4802-9610-2ad6ef7665fd tempest-ProjectMemberTests-1312558137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:07:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8f5aaf75-93c8-4802-9610-2ad6ef7665fd tempest-ProjectMemberTests-1312558137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:07:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-8f5aaf75-93c8-4802-9610-2ad6ef7665fd tempest-ProjectMemberTests-1312558137 None] Creating offline snapshot 5cef011a-5d49-42e7-a17e-7c4704a0631d of volume 87444a0e-3cf8-441e-b209-e80def373364 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:07:12 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[393b951b-5481-4db5-830a-d3e49796e12f]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:07:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8f5aaf75-93c8-4802-9610-2ad6ef7665fd tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-87444a0e-3cf8-441e-b209-e80def373364 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:12 devstack sudo[107978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-87444a0e-3cf8-441e-b209-e80def373364 Sep 28 12:07:12 devstack sudo[107978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:12 devstack sudo[107976]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c14f1f5-af46-48fa-a24d-e36e528dd450_gmlipk4tdevstack@QuobyteHD" returned: 0 in 0.338s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c14f1f5-af46-48fa-a24d-e36e528dd450_gmlipk4tdevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:12 devstack sudo[107982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c14f1f5-af46-48fa-a24d-e36e528dd450_gmlipk4tdevstack@QuobyteHD Sep 28 12:07:12 devstack sudo[107982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:12 devstack sudo[107978]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8f5aaf75-93c8-4802-9610-2ad6ef7665fd tempest-ProjectMemberTests-1312558137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-87444a0e-3cf8-441e-b209-e80def373364" returned: 0 in 0.353s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8f5aaf75-93c8-4802-9610-2ad6ef7665fd tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-87444a0e-3cf8-441e-b209-e80def373364,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-87444a0e-3cf8-441e-b209-e80def373364.5cef011a-5d49-42e7-a17e-7c4704a0631d 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:12 devstack sudo[107987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-87444a0e-3cf8-441e-b209-e80def373364,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-87444a0e-3cf8-441e-b209-e80def373364.5cef011a-5d49-42e7-a17e-7c4704a0631d 1G Sep 28 12:07:12 devstack sudo[107987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:13 devstack sudo[107982]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c14f1f5-af46-48fa-a24d-e36e528dd450_gmlipk4tdevstack@QuobyteHD" returned: 1 in 0.344s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c14f1f5-af46-48fa-a24d-e36e528dd450_gmlipk4tdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:07:13 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] Temporary image 1c14f1f5-af46-48fa-a24d-e36e528dd450 is fetched for user d870f7ffc623460cbaf8219131e89015. {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 12:07:13 devstack sudo[107987]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8f5aaf75-93c8-4802-9610-2ad6ef7665fd tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-87444a0e-3cf8-441e-b209-e80def373364,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-87444a0e-3cf8-441e-b209-e80def373364.5cef011a-5d49-42e7-a17e-7c4704a0631d 1G" returned: 0 in 0.399s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8f5aaf75-93c8-4802-9610-2ad6ef7665fd tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87444a0e-3cf8-441e-b209-e80def373364 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-87444a0e-3cf8-441e-b209-e80def373364.5cef011a-5d49-42e7-a17e-7c4704a0631d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:13 devstack sudo[107996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87444a0e-3cf8-441e-b209-e80def373364 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-87444a0e-3cf8-441e-b209-e80def373364.5cef011a-5d49-42e7-a17e-7c4704a0631d Sep 28 12:07:13 devstack sudo[107996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:13 devstack sudo[107996]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8f5aaf75-93c8-4802-9610-2ad6ef7665fd tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87444a0e-3cf8-441e-b209-e80def373364 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-87444a0e-3cf8-441e-b209-e80def373364.5cef011a-5d49-42e7-a17e-7c4704a0631d" returned: 0 in 0.297s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:13 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-8f5aaf75-93c8-4802-9610-2ad6ef7665fd tempest-ProjectMemberTests-1312558137 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-87444a0e-3cf8-441e-b209-e80def373364.5cef011a-5d49-42e7-a17e-7c4704a0631d is being set with open permissions: ugo+rw Sep 28 12:07:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8f5aaf75-93c8-4802-9610-2ad6ef7665fd tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-87444a0e-3cf8-441e-b209-e80def373364.5cef011a-5d49-42e7-a17e-7c4704a0631d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:13 devstack sudo[108002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-87444a0e-3cf8-441e-b209-e80def373364.5cef011a-5d49-42e7-a17e-7c4704a0631d Sep 28 12:07:13 devstack sudo[108002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:13 devstack sudo[108002]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8f5aaf75-93c8-4802-9610-2ad6ef7665fd tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-87444a0e-3cf8-441e-b209-e80def373364.5cef011a-5d49-42e7-a17e-7c4704a0631d" returned: 0 in 0.258s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:14 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-b8d2a7a9-e1e3-414f-8dc6-090f0e38c36c tempest-CinderUnicodeTest-82330997 None] Created reservations ['864fc8b0-08a7-4b39-8729-b9d014622af9', 'fafcdc35-d565-44f2-9fb1-dbe1602d86bf', '4fe6972c-763b-4ac9-b786-453b613ed10c', '079c2648-f619-462a-89ce-358719a7fab7'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:07:14 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ca09ae-42cb-4e97-89c3-01f514b0a3de]: (4, 'raw') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:07:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c14f1f5-af46-48fa-a24d-e36e528dd450_gmlipk4tdevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:14 devstack sudo[108041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c14f1f5-af46-48fa-a24d-e36e528dd450_gmlipk4tdevstack@QuobyteHD Sep 28 12:07:14 devstack sudo[108041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8f5aaf75-93c8-4802-9610-2ad6ef7665fd tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-87444a0e-3cf8-441e-b209-e80def373364.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:15 devstack sudo[108043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-87444a0e-3cf8-441e-b209-e80def373364.info Sep 28 12:07:15 devstack sudo[108043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:15 devstack sudo[108041]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c14f1f5-af46-48fa-a24d-e36e528dd450_gmlipk4tdevstack@QuobyteHD" returned: 0 in 0.332s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c14f1f5-af46-48fa-a24d-e36e528dd450_gmlipk4tdevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b8d2a7a9-e1e3-414f-8dc6-090f0e38c36c tempest-CinderUnicodeTest-82330997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:07:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b8d2a7a9-e1e3-414f-8dc6-090f0e38c36c tempest-CinderUnicodeTest-82330997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:07:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b8d2a7a9-e1e3-414f-8dc6-090f0e38c36c tempest-CinderUnicodeTest-82330997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:07:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b8d2a7a9-e1e3-414f-8dc6-090f0e38c36c tempest-CinderUnicodeTest-82330997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:07:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b8d2a7a9-e1e3-414f-8dc6-090f0e38c36c tempest-CinderUnicodeTest-82330997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:07:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b8d2a7a9-e1e3-414f-8dc6-090f0e38c36c tempest-CinderUnicodeTest-82330997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:15 devstack sudo[108048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:07:15 devstack sudo[108048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:15 devstack sudo[108047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c14f1f5-af46-48fa-a24d-e36e528dd450_gmlipk4tdevstack@QuobyteHD Sep 28 12:07:15 devstack sudo[108047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:15 devstack sudo[108043]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8f5aaf75-93c8-4802-9610-2ad6ef7665fd tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-87444a0e-3cf8-441e-b209-e80def373364.info" returned: 0 in 0.346s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:15 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-8f5aaf75-93c8-4802-9610-2ad6ef7665fd tempest-ProjectMemberTests-1312558137 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-87444a0e-3cf8-441e-b209-e80def373364.info is being set with open permissions: ugo+rw Sep 28 12:07:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8f5aaf75-93c8-4802-9610-2ad6ef7665fd tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-87444a0e-3cf8-441e-b209-e80def373364.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:15 devstack sudo[108052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-87444a0e-3cf8-441e-b209-e80def373364.info Sep 28 12:07:15 devstack sudo[108052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:15 devstack sudo[108048]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b8d2a7a9-e1e3-414f-8dc6-090f0e38c36c tempest-CinderUnicodeTest-82330997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.293s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:15 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-b8d2a7a9-e1e3-414f-8dc6-090f0e38c36c tempest-CinderUnicodeTest-82330997 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:07:15 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b8d2a7a9-e1e3-414f-8dc6-090f0e38c36c tempest-CinderUnicodeTest-82330997 None] Deleted volume successfully. Sep 28 12:07:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b8d2a7a9-e1e3-414f-8dc6-090f0e38c36c tempest-CinderUnicodeTest-82330997 None] Lock "cinder-60bafc7b-7dec-4ee3-9f23-df9cfe73e2d1-delete_volume" released by "delete_volume" :: held 7.149s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:07:15 devstack sudo[108047]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c14f1f5-af46-48fa-a24d-e36e528dd450_gmlipk4tdevstack@QuobyteHD" returned: 1 in 0.464s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c14f1f5-af46-48fa-a24d-e36e528dd450_gmlipk4tdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:07:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:07:15 devstack sudo[108052]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8f5aaf75-93c8-4802-9610-2ad6ef7665fd tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-87444a0e-3cf8-441e-b209-e80def373364.info" returned: 0 in 0.297s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8f5aaf75-93c8-4802-9610-2ad6ef7665fd tempest-ProjectMemberTests-1312558137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.097s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:07:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.143s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:07:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:07:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91e89787-f651-4dd2-adbf-b131dc9e9679,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='772148ac7dff46d8b5b7d1554200d264',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:07:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:07:08Z,use_quota=True,user_id='d870f7ffc623460cbaf8219131e89015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:07:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] Creating volume 91e89787-f651-4dd2-adbf-b131dc9e9679 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:07:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:07:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:07:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:07:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:07:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:07:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:07:15 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:07:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-91e89787-f651-4dd2-adbf-b131dc9e9679 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:15 devstack sudo[108059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-91e89787-f651-4dd2-adbf-b131dc9e9679 1073741824 Sep 28 12:07:15 devstack sudo[108059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:15 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-8f5aaf75-93c8-4802-9610-2ad6ef7665fd tempest-ProjectMemberTests-1312558137 None] Create snapshot completed successfully Sep 28 12:07:16 devstack sudo[108059]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-91e89787-f651-4dd2-adbf-b131dc9e9679 1073741824" returned: 0 in 0.487s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-91e89787-f651-4dd2-adbf-b131dc9e9679 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:16 devstack sudo[108066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-91e89787-f651-4dd2-adbf-b131dc9e9679 Sep 28 12:07:16 devstack sudo[108066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6bd2082e-73c6-4a78-8232-37cdbbb5b98b tempest-ProjectMemberTests-1312558137 None] Acquiring lock "cinder-5cef011a-5d49-42e7-a17e-7c4704a0631d-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:07:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6bd2082e-73c6-4a78-8232-37cdbbb5b98b tempest-ProjectMemberTests-1312558137 None] Lock "cinder-5cef011a-5d49-42e7-a17e-7c4704a0631d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:07:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6bd2082e-73c6-4a78-8232-37cdbbb5b98b tempest-ProjectMemberTests-1312558137 None] Acquiring lock "cinder-quobyte-87444a0e-3cf8-441e-b209-e80def373364" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:07:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6bd2082e-73c6-4a78-8232-37cdbbb5b98b tempest-ProjectMemberTests-1312558137 None] Lock "cinder-quobyte-87444a0e-3cf8-441e-b209-e80def373364" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:07:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6bd2082e-73c6-4a78-8232-37cdbbb5b98b tempest-ProjectMemberTests-1312558137 None] Acquiring lock "cinder-quobyte-5cef011a-5d49-42e7-a17e-7c4704a0631d" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:07:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6bd2082e-73c6-4a78-8232-37cdbbb5b98b tempest-ProjectMemberTests-1312558137 None] Lock "cinder-quobyte-5cef011a-5d49-42e7-a17e-7c4704a0631d" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:07:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-6bd2082e-73c6-4a78-8232-37cdbbb5b98b tempest-ProjectMemberTests-1312558137 None] Deleting offline snapshot 5cef011a-5d49-42e7-a17e-7c4704a0631d of volume 87444a0e-3cf8-441e-b209-e80def373364 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:07:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-6bd2082e-73c6-4a78-8232-37cdbbb5b98b tempest-ProjectMemberTests-1312558137 None] snapshot_file for this snap is: volume-87444a0e-3cf8-441e-b209-e80def373364.5cef011a-5d49-42e7-a17e-7c4704a0631d {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:07:16 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[15db5c20-0d7f-4f6d-86c5-0edb493cb236]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:07:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6bd2082e-73c6-4a78-8232-37cdbbb5b98b tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-87444a0e-3cf8-441e-b209-e80def373364.5cef011a-5d49-42e7-a17e-7c4704a0631d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:16 devstack sudo[108066]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-91e89787-f651-4dd2-adbf-b131dc9e9679" returned: 0 in 0.459s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:07:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:07:16 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] Attempting download of 1c14f1f5-af46-48fa-a24d-e36e528dd450 ((None, [{'url': 'file:///opt/stack/data/glance/images/1c14f1f5-af46-48fa-a24d-e36e528dd450', 'metadata': {}}])) to volume 91e89787-f651-4dd2-adbf-b131dc9e9679. {{(pid=86916) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 12:07:16 devstack sudo[108074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-87444a0e-3cf8-441e-b209-e80def373364.5cef011a-5d49-42e7-a17e-7c4704a0631d Sep 28 12:07:16 devstack sudo[108074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:16 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6cf67c6-d12f-4d4b-bb76-3851322cd03a]: (4, 'raw') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:07:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1c14f1f5-af46-48fa-a24d-e36e528dd450_ne0w15pl {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:17 devstack sudo[108077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1c14f1f5-af46-48fa-a24d-e36e528dd450_ne0w15pl Sep 28 12:07:17 devstack sudo[108077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:17 devstack sudo[108074]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6bd2082e-73c6-4a78-8232-37cdbbb5b98b tempest-ProjectMemberTests-1312558137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-87444a0e-3cf8-441e-b209-e80def373364.5cef011a-5d49-42e7-a17e-7c4704a0631d" returned: 0 in 0.500s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-6bd2082e-73c6-4a78-8232-37cdbbb5b98b tempest-ProjectMemberTests-1312558137 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87444a0e-3cf8-441e-b209-e80def373364(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:07:17 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead67484-0f55-4144-8207-3d4131421087]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:07:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6bd2082e-73c6-4a78-8232-37cdbbb5b98b tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-87444a0e-3cf8-441e-b209-e80def373364 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:17 devstack sudo[108077]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1c14f1f5-af46-48fa-a24d-e36e528dd450_ne0w15pl" returned: 0 in 0.484s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1c14f1f5-af46-48fa-a24d-e36e528dd450_ne0w15pl {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:17 devstack sudo[108083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-87444a0e-3cf8-441e-b209-e80def373364 Sep 28 12:07:17 devstack sudo[108083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:17 devstack sudo[108086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1c14f1f5-af46-48fa-a24d-e36e528dd450_ne0w15pl Sep 28 12:07:17 devstack sudo[108086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:17 devstack sudo[108086]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1c14f1f5-af46-48fa-a24d-e36e528dd450_ne0w15pl" returned: 1 in 0.366s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1c14f1f5-af46-48fa-a24d-e36e528dd450_ne0w15pl' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:07:17 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f05e9c-13c7-4e34-8260-9ef7dd0c5704]: (4, 'raw') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:07:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c14f1f5-af46-48fa-a24d-e36e528dd450_gmlipk4tdevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:17 devstack sudo[108083]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6bd2082e-73c6-4a78-8232-37cdbbb5b98b tempest-ProjectMemberTests-1312558137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-87444a0e-3cf8-441e-b209-e80def373364" returned: 0 in 0.519s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6bd2082e-73c6-4a78-8232-37cdbbb5b98b tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-87444a0e-3cf8-441e-b209-e80def373364.5cef011a-5d49-42e7-a17e-7c4704a0631d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:17 devstack sudo[108095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-87444a0e-3cf8-441e-b209-e80def373364.5cef011a-5d49-42e7-a17e-7c4704a0631d Sep 28 12:07:17 devstack sudo[108095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:17 devstack sudo[108094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c14f1f5-af46-48fa-a24d-e36e528dd450_gmlipk4tdevstack@QuobyteHD Sep 28 12:07:17 devstack sudo[108094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:18 devstack sudo[108094]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c14f1f5-af46-48fa-a24d-e36e528dd450_gmlipk4tdevstack@QuobyteHD" returned: 0 in 0.388s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c14f1f5-af46-48fa-a24d-e36e528dd450_gmlipk4tdevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:18 devstack sudo[108095]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6bd2082e-73c6-4a78-8232-37cdbbb5b98b tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-87444a0e-3cf8-441e-b209-e80def373364.5cef011a-5d49-42e7-a17e-7c4704a0631d" returned: 0 in 0.482s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:18 devstack sudo[108104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c14f1f5-af46-48fa-a24d-e36e528dd450_gmlipk4tdevstack@QuobyteHD Sep 28 12:07:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6bd2082e-73c6-4a78-8232-37cdbbb5b98b tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-87444a0e-3cf8-441e-b209-e80def373364.5cef011a-5d49-42e7-a17e-7c4704a0631d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:18 devstack sudo[108104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:18 devstack sudo[108106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-87444a0e-3cf8-441e-b209-e80def373364.5cef011a-5d49-42e7-a17e-7c4704a0631d Sep 28 12:07:18 devstack sudo[108106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:18 devstack sudo[108104]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c14f1f5-af46-48fa-a24d-e36e528dd450_gmlipk4tdevstack@QuobyteHD" returned: 1 in 0.343s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c14f1f5-af46-48fa-a24d-e36e528dd450_gmlipk4tdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:07:18 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] 1c14f1f5-af46-48fa-a24d-e36e528dd450 was raw, converting to qcow2 {{(pid=86916) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 12:07:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1c14f1f5-af46-48fa-a24d-e36e528dd450_gmlipk4tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-91e89787-f651-4dd2-adbf-b131dc9e9679 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:18 devstack sudo[108112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1c14f1f5-af46-48fa-a24d-e36e528dd450_gmlipk4tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-91e89787-f651-4dd2-adbf-b131dc9e9679 Sep 28 12:07:18 devstack sudo[108112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:18 devstack sudo[108106]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6bd2082e-73c6-4a78-8232-37cdbbb5b98b tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-87444a0e-3cf8-441e-b209-e80def373364.5cef011a-5d49-42e7-a17e-7c4704a0631d" returned: 0 in 0.311s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6bd2082e-73c6-4a78-8232-37cdbbb5b98b tempest-ProjectMemberTests-1312558137 None] Lock "cinder-quobyte-5cef011a-5d49-42e7-a17e-7c4704a0631d" released by "_delete_snapshot" :: held 1.981s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:07:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6bd2082e-73c6-4a78-8232-37cdbbb5b98b tempest-ProjectMemberTests-1312558137 None] Lock "cinder-quobyte-87444a0e-3cf8-441e-b209-e80def373364" released by "delete_snapshot" :: held 2.033s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:07:18 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-6bd2082e-73c6-4a78-8232-37cdbbb5b98b tempest-ProjectMemberTests-1312558137 None] Created reservations ['922fe531-c785-4c7c-9363-cbc9c12cbcf1', '1117fc82-6e36-4e94-ab82-37cd8ca6bfa0', '17a8d8af-6ad6-4ad2-b491-15e9134286c7', 'bbc55124-dbe6-4a9a-b19e-3ee187e52a61'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:07:18 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-6bd2082e-73c6-4a78-8232-37cdbbb5b98b tempest-ProjectMemberTests-1312558137 None] Delete snapshot completed successfully. Sep 28 12:07:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6bd2082e-73c6-4a78-8232-37cdbbb5b98b tempest-ProjectMemberTests-1312558137 None] Lock "cinder-5cef011a-5d49-42e7-a17e-7c4704a0631d-delete_snapshot" released by "delete_snapshot" :: held 2.265s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:07:19 devstack sudo[108112]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1c14f1f5-af46-48fa-a24d-e36e528dd450_gmlipk4tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-91e89787-f651-4dd2-adbf-b131dc9e9679" returned: 0 in 0.663s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:19 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1c14f1f5-af46-48fa-a24d-e36e528dd450_gmlipk4tdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-91e89787-f651-4dd2-adbf-b131dc9e9679 {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:07:19 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 12:07:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-91e89787-f651-4dd2-adbf-b131dc9e9679 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:19 devstack sudo[108118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-91e89787-f651-4dd2-adbf-b131dc9e9679 1G Sep 28 12:07:19 devstack sudo[108118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:19 devstack sudo[108118]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-91e89787-f651-4dd2-adbf-b131dc9e9679 1G" returned: 0 in 0.363s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:19 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] Downloaded image 1c14f1f5-af46-48fa-a24d-e36e528dd450 ((None, [{'url': 'file:///opt/stack/data/glance/images/1c14f1f5-af46-48fa-a24d-e36e528dd450', 'metadata': {}}])) to volume 91e89787-f651-4dd2-adbf-b131dc9e9679 successfully. {{(pid=86916) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 12:07:19 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] Temporary image 1c14f1f5-af46-48fa-a24d-e36e528dd450 for user d870f7ffc623460cbaf8219131e89015 is deleted. {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 12:07:19 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] Marking volume 91e89787-f651-4dd2-adbf-b131dc9e9679 as bootable. {{(pid=86916) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 12:07:19 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] Copying metadata from image 1c14f1f5-af46-48fa-a24d-e36e528dd450 to 91e89787-f651-4dd2-adbf-b131dc9e9679. {{(pid=86916) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 12:07:19 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] Creating volume glance metadata for volume 91e89787-f651-4dd2-adbf-b131dc9e9679 backed by image 1c14f1f5-af46-48fa-a24d-e36e528dd450 with: {'image_id': '1c14f1f5-af46-48fa-a24d-e36e528dd450', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'ab4080133660ea4609d02dae5c9c9a61', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86916) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 12:07:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bc8969d-1ce2-46c9-abcc-b72897c6c782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91e89787-f651-4dd2-adbf-b131dc9e9679', 'volume_size': 1, 'image_id': '1c14f1f5-af46-48fa-a24d-e36e528dd450', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1c14f1f5-af46-48fa-a24d-e36e528dd450', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ab4080133660ea4609d02dae5c9c9a61', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '772148ac7dff46d8b5b7d1554200d264', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b9037ae5c5b5963ac0c6985788387dc8f2814569184bcbf7f3b8f364abe9431d6609c7f3dcc4aa8665fde36384e9c3ed6c9cfc85783b201c64a11201bdaababe', 'id': '1c14f1f5-af46-48fa-a24d-e36e528dd450', 'created_at': datetime.datetime(2026, 9, 28, 10, 7, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 7, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c14f1f5-af46-48fa-a24d-e36e528dd450/file', 'properties': {}}, 'image_service': }' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d1c6703-294d-4acc-9a44-89ff2c2acdb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:19 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] Volume volume-91e89787-f651-4dd2-adbf-b131dc9e9679 (91e89787-f651-4dd2-adbf-b131dc9e9679): created successfully Sep 28 12:07:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d1c6703-294d-4acc-9a44-89ff2c2acdb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] Flow 'volume_create_manager' (45bc0208-371f-4ad9-aa9c-73bfc1b131ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:07:19 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-79a569db-b91e-45af-b330-e911d3389c35 tempest-VolumeImageDependencyTests-1459954381 None] Created volume successfully. Sep 28 12:07:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-37b5b015-7651-443c-8d9a-d018805d3c29 tempest-ProjectMemberTests-1312558137 None] Acquiring lock "cinder-87444a0e-3cf8-441e-b209-e80def373364-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:07:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-37b5b015-7651-443c-8d9a-d018805d3c29 tempest-ProjectMemberTests-1312558137 None] Lock "cinder-87444a0e-3cf8-441e-b209-e80def373364-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:07:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-37b5b015-7651-443c-8d9a-d018805d3c29 tempest-ProjectMemberTests-1312558137 None] Acquiring lock "cinder-quobyte-87444a0e-3cf8-441e-b209-e80def373364" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:07:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-37b5b015-7651-443c-8d9a-d018805d3c29 tempest-ProjectMemberTests-1312558137 None] Lock "cinder-quobyte-87444a0e-3cf8-441e-b209-e80def373364" acquired by "delete_volume" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:07:19 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[831b1d7d-e9a7-4d15-b200-8608a2cf871d]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:07:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-37b5b015-7651-443c-8d9a-d018805d3c29 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-87444a0e-3cf8-441e-b209-e80def373364 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:20 devstack sudo[108124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-87444a0e-3cf8-441e-b209-e80def373364 Sep 28 12:07:20 devstack sudo[108124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-89ef9111-ec22-4d45-981e-0bfae75ff02e tempest-ProjectAdminTests-1616603812 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.2163124084473, 'free_capacity_gb': 1775.2163124084473, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86916) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 12:07:20 devstack sudo[108124]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-37b5b015-7651-443c-8d9a-d018805d3c29 tempest-ProjectMemberTests-1312558137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-87444a0e-3cf8-441e-b209-e80def373364" returned: 0 in 0.448s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-37b5b015-7651-443c-8d9a-d018805d3c29 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-87444a0e-3cf8-441e-b209-e80def373364 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:20 devstack sudo[108129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-87444a0e-3cf8-441e-b209-e80def373364 Sep 28 12:07:20 devstack sudo[108129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:20 devstack sudo[108129]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-37b5b015-7651-443c-8d9a-d018805d3c29 tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-87444a0e-3cf8-441e-b209-e80def373364" returned: 0 in 0.303s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-37b5b015-7651-443c-8d9a-d018805d3c29 tempest-ProjectMemberTests-1312558137 None] Lock "cinder-quobyte-87444a0e-3cf8-441e-b209-e80def373364" released by "delete_volume" :: held 0.846s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:07:20 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-37b5b015-7651-443c-8d9a-d018805d3c29 tempest-ProjectMemberTests-1312558137 None] Created reservations ['3b695ac7-4084-4caf-bfa1-18731bd022cc', '5640eef2-5041-40cf-9ec9-5fcab8bb5ef6', 'f3533cb7-b1ee-44d7-af9f-56ada84a7d4c', '7c7fd766-05a4-4e79-a8be-0e9c7f7ca27d'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:07:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-37b5b015-7651-443c-8d9a-d018805d3c29 tempest-ProjectMemberTests-1312558137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:07:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-37b5b015-7651-443c-8d9a-d018805d3c29 tempest-ProjectMemberTests-1312558137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:07:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-37b5b015-7651-443c-8d9a-d018805d3c29 tempest-ProjectMemberTests-1312558137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:07:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-37b5b015-7651-443c-8d9a-d018805d3c29 tempest-ProjectMemberTests-1312558137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:07:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-37b5b015-7651-443c-8d9a-d018805d3c29 tempest-ProjectMemberTests-1312558137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:07:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-37b5b015-7651-443c-8d9a-d018805d3c29 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-81c95127-323b-477b-97ff-7f107c3496ef tempest-VolumeImageDependencyTests-1459954381 None] Acquiring lock "cinder-91e89787-f651-4dd2-adbf-b131dc9e9679-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:07:20 devstack sudo[108133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:07:20 devstack sudo[108133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-81c95127-323b-477b-97ff-7f107c3496ef tempest-VolumeImageDependencyTests-1459954381 None] Lock "cinder-91e89787-f651-4dd2-adbf-b131dc9e9679-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:07:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-81c95127-323b-477b-97ff-7f107c3496ef tempest-VolumeImageDependencyTests-1459954381 None] Acquiring lock "cinder-quobyte-91e89787-f651-4dd2-adbf-b131dc9e9679" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:07:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-81c95127-323b-477b-97ff-7f107c3496ef tempest-VolumeImageDependencyTests-1459954381 None] Lock "cinder-quobyte-91e89787-f651-4dd2-adbf-b131dc9e9679" acquired by "delete_volume" :: waited 0.029s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:07:21 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f3d8ca-e867-4391-86dc-a8e44bd0f6dc]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:07:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-81c95127-323b-477b-97ff-7f107c3496ef tempest-VolumeImageDependencyTests-1459954381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-91e89787-f651-4dd2-adbf-b131dc9e9679 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:21 devstack sudo[108135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-91e89787-f651-4dd2-adbf-b131dc9e9679 Sep 28 12:07:21 devstack sudo[108135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:21 devstack sudo[108133]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-37b5b015-7651-443c-8d9a-d018805d3c29 tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.438s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:21 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-37b5b015-7651-443c-8d9a-d018805d3c29 tempest-ProjectMemberTests-1312558137 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:07:21 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-37b5b015-7651-443c-8d9a-d018805d3c29 tempest-ProjectMemberTests-1312558137 None] Deleted volume successfully. Sep 28 12:07:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-37b5b015-7651-443c-8d9a-d018805d3c29 tempest-ProjectMemberTests-1312558137 None] Lock "cinder-87444a0e-3cf8-441e-b209-e80def373364-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:07:21 devstack sudo[108135]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-81c95127-323b-477b-97ff-7f107c3496ef tempest-VolumeImageDependencyTests-1459954381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-91e89787-f651-4dd2-adbf-b131dc9e9679" returned: 0 in 0.513s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-81c95127-323b-477b-97ff-7f107c3496ef tempest-VolumeImageDependencyTests-1459954381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-91e89787-f651-4dd2-adbf-b131dc9e9679 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:21 devstack sudo[108141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-91e89787-f651-4dd2-adbf-b131dc9e9679 Sep 28 12:07:21 devstack sudo[108141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:21 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-05ffb8a7-a038-454f-b44d-cfbbf18e6b6f tempest-ProjectMemberTests-1312558137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:07:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-05ffb8a7-a038-454f-b44d-cfbbf18e6b6f tempest-ProjectMemberTests-1312558137 None] Flow 'volume_create_manager' (b387e519-1f5a-44a0-92bc-c9d841338f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:07:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-05ffb8a7-a038-454f-b44d-cfbbf18e6b6f tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d184e61-84da-4dd0-8069-3ea0e2b80928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-05ffb8a7-a038-454f-b44d-cfbbf18e6b6f tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d184e61-84da-4dd0-8069-3ea0e2b80928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1744464157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75e6c9b2-5952-4ed9-86c9-3902770e5090,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba606417eb184510b6154fa1a28dce16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:07:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:07:22Z,use_quota=True,user_id='bb30da770afa465f8162e7779a473226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-05ffb8a7-a038-454f-b44d-cfbbf18e6b6f tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2aa4bbc-343a-4825-8e87-d3bf11252123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-05ffb8a7-a038-454f-b44d-cfbbf18e6b6f tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2aa4bbc-343a-4825-8e87-d3bf11252123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-05ffb8a7-a038-454f-b44d-cfbbf18e6b6f tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aac44249-5092-4e58-b541-f0eaa9cbc871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-05ffb8a7-a038-454f-b44d-cfbbf18e6b6f tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aac44249-5092-4e58-b541-f0eaa9cbc871) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75e6c9b2-5952-4ed9-86c9-3902770e5090', 'volume_name': 'volume-75e6c9b2-5952-4ed9-86c9-3902770e5090', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-05ffb8a7-a038-454f-b44d-cfbbf18e6b6f tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce84d0c0-a3ca-44f8-8bcd-828cfc77e680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-05ffb8a7-a038-454f-b44d-cfbbf18e6b6f tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce84d0c0-a3ca-44f8-8bcd-828cfc77e680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-05ffb8a7-a038-454f-b44d-cfbbf18e6b6f tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89034be5-0dea-4312-a372-991860e53a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:21 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-05ffb8a7-a038-454f-b44d-cfbbf18e6b6f tempest-ProjectMemberTests-1312558137 None] Volume 75e6c9b2-5952-4ed9-86c9-3902770e5090: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75e6c9b2-5952-4ed9-86c9-3902770e5090', 'volume_size': 1} Sep 28 12:07:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-05ffb8a7-a038-454f-b44d-cfbbf18e6b6f tempest-ProjectMemberTests-1312558137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:07:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-05ffb8a7-a038-454f-b44d-cfbbf18e6b6f tempest-ProjectMemberTests-1312558137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:07:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-05ffb8a7-a038-454f-b44d-cfbbf18e6b6f tempest-ProjectMemberTests-1312558137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1744464157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75e6c9b2-5952-4ed9-86c9-3902770e5090,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba606417eb184510b6154fa1a28dce16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:07:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:07:22Z,use_quota=True,user_id='bb30da770afa465f8162e7779a473226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:07:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-05ffb8a7-a038-454f-b44d-cfbbf18e6b6f tempest-ProjectMemberTests-1312558137 None] Creating volume 75e6c9b2-5952-4ed9-86c9-3902770e5090 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:07:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-05ffb8a7-a038-454f-b44d-cfbbf18e6b6f tempest-ProjectMemberTests-1312558137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:07:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-05ffb8a7-a038-454f-b44d-cfbbf18e6b6f tempest-ProjectMemberTests-1312558137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:07:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-05ffb8a7-a038-454f-b44d-cfbbf18e6b6f tempest-ProjectMemberTests-1312558137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:07:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-05ffb8a7-a038-454f-b44d-cfbbf18e6b6f tempest-ProjectMemberTests-1312558137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:07:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-05ffb8a7-a038-454f-b44d-cfbbf18e6b6f tempest-ProjectMemberTests-1312558137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:07:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-05ffb8a7-a038-454f-b44d-cfbbf18e6b6f tempest-ProjectMemberTests-1312558137 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:07:21 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-05ffb8a7-a038-454f-b44d-cfbbf18e6b6f tempest-ProjectMemberTests-1312558137 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:07:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-05ffb8a7-a038-454f-b44d-cfbbf18e6b6f tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-75e6c9b2-5952-4ed9-86c9-3902770e5090 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:21 devstack sudo[108144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-75e6c9b2-5952-4ed9-86c9-3902770e5090 1073741824 Sep 28 12:07:21 devstack sudo[108144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:21 devstack sudo[108141]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-81c95127-323b-477b-97ff-7f107c3496ef tempest-VolumeImageDependencyTests-1459954381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-91e89787-f651-4dd2-adbf-b131dc9e9679" returned: 0 in 0.334s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-81c95127-323b-477b-97ff-7f107c3496ef tempest-VolumeImageDependencyTests-1459954381 None] Lock "cinder-quobyte-91e89787-f651-4dd2-adbf-b131dc9e9679" released by "delete_volume" :: held 0.921s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:07:21 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-81c95127-323b-477b-97ff-7f107c3496ef tempest-VolumeImageDependencyTests-1459954381 None] Created reservations ['83c80433-8465-4aa0-969d-939c549f8dba', 'ec6da8df-9dd4-43ec-908e-a8463835ca7b', 'e4da9786-9a4f-46d6-ae41-4216410d8af8', '05adda93-aa0b-468c-bca1-2b4d69ec16b8'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:07:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-81c95127-323b-477b-97ff-7f107c3496ef tempest-VolumeImageDependencyTests-1459954381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:07:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-81c95127-323b-477b-97ff-7f107c3496ef tempest-VolumeImageDependencyTests-1459954381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:07:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-81c95127-323b-477b-97ff-7f107c3496ef tempest-VolumeImageDependencyTests-1459954381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:07:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-81c95127-323b-477b-97ff-7f107c3496ef tempest-VolumeImageDependencyTests-1459954381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:07:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-81c95127-323b-477b-97ff-7f107c3496ef tempest-VolumeImageDependencyTests-1459954381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:07:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-81c95127-323b-477b-97ff-7f107c3496ef tempest-VolumeImageDependencyTests-1459954381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:22 devstack sudo[108148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:07:22 devstack sudo[108148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:22 devstack sudo[108144]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-05ffb8a7-a038-454f-b44d-cfbbf18e6b6f tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-75e6c9b2-5952-4ed9-86c9-3902770e5090 1073741824" returned: 0 in 0.579s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:22 devstack sudo[108148]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-81c95127-323b-477b-97ff-7f107c3496ef tempest-VolumeImageDependencyTests-1459954381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.334s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:22 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-81c95127-323b-477b-97ff-7f107c3496ef tempest-VolumeImageDependencyTests-1459954381 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:07:22 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-81c95127-323b-477b-97ff-7f107c3496ef tempest-VolumeImageDependencyTests-1459954381 None] Deleted volume successfully. Sep 28 12:07:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-81c95127-323b-477b-97ff-7f107c3496ef tempest-VolumeImageDependencyTests-1459954381 None] Lock "cinder-91e89787-f651-4dd2-adbf-b131dc9e9679-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:07:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-05ffb8a7-a038-454f-b44d-cfbbf18e6b6f tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-75e6c9b2-5952-4ed9-86c9-3902770e5090 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:22 devstack sudo[108153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-75e6c9b2-5952-4ed9-86c9-3902770e5090 Sep 28 12:07:22 devstack sudo[108153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:22 devstack sudo[108153]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-05ffb8a7-a038-454f-b44d-cfbbf18e6b6f tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-75e6c9b2-5952-4ed9-86c9-3902770e5090" returned: 0 in 0.326s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-05ffb8a7-a038-454f-b44d-cfbbf18e6b6f tempest-ProjectMemberTests-1312558137 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:07:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-05ffb8a7-a038-454f-b44d-cfbbf18e6b6f tempest-ProjectMemberTests-1312558137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:07:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-05ffb8a7-a038-454f-b44d-cfbbf18e6b6f tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89034be5-0dea-4312-a372-991860e53a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75e6c9b2-5952-4ed9-86c9-3902770e5090', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-05ffb8a7-a038-454f-b44d-cfbbf18e6b6f tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbda05e9-1fd8-474d-99ca-f63d2a83ac17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:22 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-05ffb8a7-a038-454f-b44d-cfbbf18e6b6f tempest-ProjectMemberTests-1312558137 None] Volume volume-75e6c9b2-5952-4ed9-86c9-3902770e5090 (75e6c9b2-5952-4ed9-86c9-3902770e5090): created successfully Sep 28 12:07:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-05ffb8a7-a038-454f-b44d-cfbbf18e6b6f tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbda05e9-1fd8-474d-99ca-f63d2a83ac17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-05ffb8a7-a038-454f-b44d-cfbbf18e6b6f tempest-ProjectMemberTests-1312558137 None] Flow 'volume_create_manager' (b387e519-1f5a-44a0-92bc-c9d841338f51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:07:22 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-05ffb8a7-a038-454f-b44d-cfbbf18e6b6f tempest-ProjectMemberTests-1312558137 None] Created volume successfully. Sep 28 12:07:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-99baef10-25dd-4c19-8712-16152d0cdb3e tempest-ProjectMemberTests-1312558137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:07:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-99baef10-25dd-4c19-8712-16152d0cdb3e tempest-ProjectMemberTests-1312558137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:07:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-99baef10-25dd-4c19-8712-16152d0cdb3e tempest-ProjectMemberTests-1312558137 None] Creating offline snapshot 0e9b7825-f199-4b53-aa91-75aff2d5c545 of volume 75e6c9b2-5952-4ed9-86c9-3902770e5090 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:07:24 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9b0e72-3876-4348-8ccc-4d8a57f3a4c6]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:07:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-99baef10-25dd-4c19-8712-16152d0cdb3e tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-75e6c9b2-5952-4ed9-86c9-3902770e5090 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:24 devstack sudo[108156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-75e6c9b2-5952-4ed9-86c9-3902770e5090 Sep 28 12:07:24 devstack sudo[108156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:24 devstack sudo[108156]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-99baef10-25dd-4c19-8712-16152d0cdb3e tempest-ProjectMemberTests-1312558137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-75e6c9b2-5952-4ed9-86c9-3902770e5090" returned: 0 in 0.398s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-99baef10-25dd-4c19-8712-16152d0cdb3e tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-75e6c9b2-5952-4ed9-86c9-3902770e5090,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-75e6c9b2-5952-4ed9-86c9-3902770e5090.0e9b7825-f199-4b53-aa91-75aff2d5c545 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:24 devstack sudo[108161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-75e6c9b2-5952-4ed9-86c9-3902770e5090,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-75e6c9b2-5952-4ed9-86c9-3902770e5090.0e9b7825-f199-4b53-aa91-75aff2d5c545 1G Sep 28 12:07:24 devstack sudo[108161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:25 devstack sudo[108161]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-99baef10-25dd-4c19-8712-16152d0cdb3e tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-75e6c9b2-5952-4ed9-86c9-3902770e5090,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-75e6c9b2-5952-4ed9-86c9-3902770e5090.0e9b7825-f199-4b53-aa91-75aff2d5c545 1G" returned: 0 in 0.582s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-99baef10-25dd-4c19-8712-16152d0cdb3e tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75e6c9b2-5952-4ed9-86c9-3902770e5090 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-75e6c9b2-5952-4ed9-86c9-3902770e5090.0e9b7825-f199-4b53-aa91-75aff2d5c545 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:25 devstack sudo[108167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75e6c9b2-5952-4ed9-86c9-3902770e5090 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-75e6c9b2-5952-4ed9-86c9-3902770e5090.0e9b7825-f199-4b53-aa91-75aff2d5c545 Sep 28 12:07:25 devstack sudo[108167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:25 devstack sudo[108167]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-99baef10-25dd-4c19-8712-16152d0cdb3e tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75e6c9b2-5952-4ed9-86c9-3902770e5090 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-75e6c9b2-5952-4ed9-86c9-3902770e5090.0e9b7825-f199-4b53-aa91-75aff2d5c545" returned: 0 in 0.423s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:25 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-99baef10-25dd-4c19-8712-16152d0cdb3e tempest-ProjectMemberTests-1312558137 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-75e6c9b2-5952-4ed9-86c9-3902770e5090.0e9b7825-f199-4b53-aa91-75aff2d5c545 is being set with open permissions: ugo+rw Sep 28 12:07:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-99baef10-25dd-4c19-8712-16152d0cdb3e tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-75e6c9b2-5952-4ed9-86c9-3902770e5090.0e9b7825-f199-4b53-aa91-75aff2d5c545 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:25 devstack sudo[108173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-75e6c9b2-5952-4ed9-86c9-3902770e5090.0e9b7825-f199-4b53-aa91-75aff2d5c545 Sep 28 12:07:25 devstack sudo[108173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:25 devstack sudo[108173]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-99baef10-25dd-4c19-8712-16152d0cdb3e tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-75e6c9b2-5952-4ed9-86c9-3902770e5090.0e9b7825-f199-4b53-aa91-75aff2d5c545" returned: 0 in 0.311s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-99baef10-25dd-4c19-8712-16152d0cdb3e tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-75e6c9b2-5952-4ed9-86c9-3902770e5090.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:25 devstack sudo[108176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-75e6c9b2-5952-4ed9-86c9-3902770e5090.info Sep 28 12:07:25 devstack sudo[108176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:26 devstack sudo[108176]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-99baef10-25dd-4c19-8712-16152d0cdb3e tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-75e6c9b2-5952-4ed9-86c9-3902770e5090.info" returned: 0 in 0.267s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:26 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-99baef10-25dd-4c19-8712-16152d0cdb3e tempest-ProjectMemberTests-1312558137 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-75e6c9b2-5952-4ed9-86c9-3902770e5090.info is being set with open permissions: ugo+rw Sep 28 12:07:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-99baef10-25dd-4c19-8712-16152d0cdb3e tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-75e6c9b2-5952-4ed9-86c9-3902770e5090.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:26 devstack sudo[108179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-75e6c9b2-5952-4ed9-86c9-3902770e5090.info Sep 28 12:07:26 devstack sudo[108179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:26 devstack sudo[108179]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-99baef10-25dd-4c19-8712-16152d0cdb3e tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-75e6c9b2-5952-4ed9-86c9-3902770e5090.info" returned: 0 in 0.325s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-99baef10-25dd-4c19-8712-16152d0cdb3e tempest-ProjectMemberTests-1312558137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.410s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:07:26 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-99baef10-25dd-4c19-8712-16152d0cdb3e tempest-ProjectMemberTests-1312558137 None] Create snapshot completed successfully Sep 28 12:07:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-48042d82-0de3-488c-adbf-7501138e9003 tempest-ProjectMemberTests-1312558137 None] Acquiring lock "cinder-0e9b7825-f199-4b53-aa91-75aff2d5c545-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:07:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-48042d82-0de3-488c-adbf-7501138e9003 tempest-ProjectMemberTests-1312558137 None] Lock "cinder-0e9b7825-f199-4b53-aa91-75aff2d5c545-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:07:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-48042d82-0de3-488c-adbf-7501138e9003 tempest-ProjectMemberTests-1312558137 None] Acquiring lock "cinder-quobyte-75e6c9b2-5952-4ed9-86c9-3902770e5090" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:07:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-48042d82-0de3-488c-adbf-7501138e9003 tempest-ProjectMemberTests-1312558137 None] Lock "cinder-quobyte-75e6c9b2-5952-4ed9-86c9-3902770e5090" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:07:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-48042d82-0de3-488c-adbf-7501138e9003 tempest-ProjectMemberTests-1312558137 None] Acquiring lock "cinder-quobyte-0e9b7825-f199-4b53-aa91-75aff2d5c545" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:07:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-48042d82-0de3-488c-adbf-7501138e9003 tempest-ProjectMemberTests-1312558137 None] Lock "cinder-quobyte-0e9b7825-f199-4b53-aa91-75aff2d5c545" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:07:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-48042d82-0de3-488c-adbf-7501138e9003 tempest-ProjectMemberTests-1312558137 None] Deleting offline snapshot 0e9b7825-f199-4b53-aa91-75aff2d5c545 of volume 75e6c9b2-5952-4ed9-86c9-3902770e5090 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:07:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-48042d82-0de3-488c-adbf-7501138e9003 tempest-ProjectMemberTests-1312558137 None] snapshot_file for this snap is: volume-75e6c9b2-5952-4ed9-86c9-3902770e5090.0e9b7825-f199-4b53-aa91-75aff2d5c545 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:07:27 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb66b589-8b51-45d0-be7e-d6dfa61862a0]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:07:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-48042d82-0de3-488c-adbf-7501138e9003 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-75e6c9b2-5952-4ed9-86c9-3902770e5090.0e9b7825-f199-4b53-aa91-75aff2d5c545 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:27 devstack sudo[108182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-75e6c9b2-5952-4ed9-86c9-3902770e5090.0e9b7825-f199-4b53-aa91-75aff2d5c545 Sep 28 12:07:27 devstack sudo[108182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:27 devstack sudo[108182]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-48042d82-0de3-488c-adbf-7501138e9003 tempest-ProjectMemberTests-1312558137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-75e6c9b2-5952-4ed9-86c9-3902770e5090.0e9b7825-f199-4b53-aa91-75aff2d5c545" returned: 0 in 0.510s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-48042d82-0de3-488c-adbf-7501138e9003 tempest-ProjectMemberTests-1312558137 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75e6c9b2-5952-4ed9-86c9-3902770e5090(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:07:27 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca815aed-14eb-4b33-aa88-4d0ea7309d01]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:07:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-48042d82-0de3-488c-adbf-7501138e9003 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-75e6c9b2-5952-4ed9-86c9-3902770e5090 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:28 devstack sudo[108187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-75e6c9b2-5952-4ed9-86c9-3902770e5090 Sep 28 12:07:28 devstack sudo[108187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:28 devstack sudo[108187]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-48042d82-0de3-488c-adbf-7501138e9003 tempest-ProjectMemberTests-1312558137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-75e6c9b2-5952-4ed9-86c9-3902770e5090" returned: 0 in 0.651s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-48042d82-0de3-488c-adbf-7501138e9003 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-75e6c9b2-5952-4ed9-86c9-3902770e5090.0e9b7825-f199-4b53-aa91-75aff2d5c545 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:28 devstack sudo[108193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-75e6c9b2-5952-4ed9-86c9-3902770e5090.0e9b7825-f199-4b53-aa91-75aff2d5c545 Sep 28 12:07:28 devstack sudo[108193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:29 devstack sudo[108193]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-48042d82-0de3-488c-adbf-7501138e9003 tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-75e6c9b2-5952-4ed9-86c9-3902770e5090.0e9b7825-f199-4b53-aa91-75aff2d5c545" returned: 0 in 0.447s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-48042d82-0de3-488c-adbf-7501138e9003 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-75e6c9b2-5952-4ed9-86c9-3902770e5090.0e9b7825-f199-4b53-aa91-75aff2d5c545 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:29 devstack sudo[108199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-75e6c9b2-5952-4ed9-86c9-3902770e5090.0e9b7825-f199-4b53-aa91-75aff2d5c545 Sep 28 12:07:29 devstack sudo[108199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:29 devstack sudo[108199]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-48042d82-0de3-488c-adbf-7501138e9003 tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-75e6c9b2-5952-4ed9-86c9-3902770e5090.0e9b7825-f199-4b53-aa91-75aff2d5c545" returned: 0 in 0.360s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-48042d82-0de3-488c-adbf-7501138e9003 tempest-ProjectMemberTests-1312558137 None] Lock "cinder-quobyte-0e9b7825-f199-4b53-aa91-75aff2d5c545" released by "_delete_snapshot" :: held 2.114s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:07:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-48042d82-0de3-488c-adbf-7501138e9003 tempest-ProjectMemberTests-1312558137 None] Lock "cinder-quobyte-75e6c9b2-5952-4ed9-86c9-3902770e5090" released by "delete_snapshot" :: held 2.147s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:07:29 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-48042d82-0de3-488c-adbf-7501138e9003 tempest-ProjectMemberTests-1312558137 None] Created reservations ['b9dad44d-663c-4acc-9617-d9934a5f24e0', 'bcee477c-d434-4641-bedf-542f0517a59d', '1a1a6c2f-b8e8-4acf-aeea-6fa0f84769e2', 'e1720eab-ecf2-4b78-8e59-d300a263ff41'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:07:29 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-48042d82-0de3-488c-adbf-7501138e9003 tempest-ProjectMemberTests-1312558137 None] Delete snapshot completed successfully. Sep 28 12:07:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-48042d82-0de3-488c-adbf-7501138e9003 tempest-ProjectMemberTests-1312558137 None] Lock "cinder-0e9b7825-f199-4b53-aa91-75aff2d5c545-delete_snapshot" released by "delete_snapshot" :: held 2.474s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:07:29 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-63ba4381-a7a1-4fd2-8e9b-fc5e15e9c1e2 tempest-ProjectReaderTests-215039770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:07:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-63ba4381-a7a1-4fd2-8e9b-fc5e15e9c1e2 tempest-ProjectReaderTests-215039770 None] Flow 'volume_create_manager' (9e91b7f7-5f7d-4d25-8a9c-b67f584b92f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:07:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-63ba4381-a7a1-4fd2-8e9b-fc5e15e9c1e2 tempest-ProjectReaderTests-215039770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd1225be-77f1-439f-91e9-0ac70e73e775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-63ba4381-a7a1-4fd2-8e9b-fc5e15e9c1e2 tempest-ProjectReaderTests-215039770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd1225be-77f1-439f-91e9-0ac70e73e775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:07:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-784232482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8820d02f-759b-4cff-8553-57588ed1f4d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0967a03b26444a099e6a835bf5318cd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:07:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:07:30Z,use_quota=True,user_id='15e36ceca64444e0a9bfeb42495fbb44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-63ba4381-a7a1-4fd2-8e9b-fc5e15e9c1e2 tempest-ProjectReaderTests-215039770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebd65bfd-19dd-4100-9b7b-0ccb9a405233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-63ba4381-a7a1-4fd2-8e9b-fc5e15e9c1e2 tempest-ProjectReaderTests-215039770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebd65bfd-19dd-4100-9b7b-0ccb9a405233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-63ba4381-a7a1-4fd2-8e9b-fc5e15e9c1e2 tempest-ProjectReaderTests-215039770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0847ccea-1760-4309-b376-4ee4c31de636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-63ba4381-a7a1-4fd2-8e9b-fc5e15e9c1e2 tempest-ProjectReaderTests-215039770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0847ccea-1760-4309-b376-4ee4c31de636) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8820d02f-759b-4cff-8553-57588ed1f4d4', 'volume_name': 'volume-8820d02f-759b-4cff-8553-57588ed1f4d4', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-63ba4381-a7a1-4fd2-8e9b-fc5e15e9c1e2 tempest-ProjectReaderTests-215039770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bf23c6d-1d55-4352-9d95-f00c0592d089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-63ba4381-a7a1-4fd2-8e9b-fc5e15e9c1e2 tempest-ProjectReaderTests-215039770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bf23c6d-1d55-4352-9d95-f00c0592d089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-63ba4381-a7a1-4fd2-8e9b-fc5e15e9c1e2 tempest-ProjectReaderTests-215039770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (accc4556-8c2c-4724-9748-2e37d8287359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:30 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-63ba4381-a7a1-4fd2-8e9b-fc5e15e9c1e2 tempest-ProjectReaderTests-215039770 None] Volume 8820d02f-759b-4cff-8553-57588ed1f4d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8820d02f-759b-4cff-8553-57588ed1f4d4', 'volume_size': 1} Sep 28 12:07:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-63ba4381-a7a1-4fd2-8e9b-fc5e15e9c1e2 tempest-ProjectReaderTests-215039770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:07:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-63ba4381-a7a1-4fd2-8e9b-fc5e15e9c1e2 tempest-ProjectReaderTests-215039770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:07:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-63ba4381-a7a1-4fd2-8e9b-fc5e15e9c1e2 tempest-ProjectReaderTests-215039770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:07:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-784232482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8820d02f-759b-4cff-8553-57588ed1f4d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0967a03b26444a099e6a835bf5318cd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:07:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:07:30Z,use_quota=True,user_id='15e36ceca64444e0a9bfeb42495fbb44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:07:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-63ba4381-a7a1-4fd2-8e9b-fc5e15e9c1e2 tempest-ProjectReaderTests-215039770 None] Creating volume 8820d02f-759b-4cff-8553-57588ed1f4d4 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:07:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-63ba4381-a7a1-4fd2-8e9b-fc5e15e9c1e2 tempest-ProjectReaderTests-215039770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:07:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-63ba4381-a7a1-4fd2-8e9b-fc5e15e9c1e2 tempest-ProjectReaderTests-215039770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:07:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-63ba4381-a7a1-4fd2-8e9b-fc5e15e9c1e2 tempest-ProjectReaderTests-215039770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:07:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-63ba4381-a7a1-4fd2-8e9b-fc5e15e9c1e2 tempest-ProjectReaderTests-215039770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:07:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-63ba4381-a7a1-4fd2-8e9b-fc5e15e9c1e2 tempest-ProjectReaderTests-215039770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:07:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-63ba4381-a7a1-4fd2-8e9b-fc5e15e9c1e2 tempest-ProjectReaderTests-215039770 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:07:30 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-63ba4381-a7a1-4fd2-8e9b-fc5e15e9c1e2 tempest-ProjectReaderTests-215039770 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:07:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-63ba4381-a7a1-4fd2-8e9b-fc5e15e9c1e2 tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8820d02f-759b-4cff-8553-57588ed1f4d4 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:30 devstack sudo[108203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8820d02f-759b-4cff-8553-57588ed1f4d4 1073741824 Sep 28 12:07:30 devstack sudo[108203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:30 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-db4f9a83-e916-487f-bc5d-375cf6d0af23 tempest-ProjectMemberTests-1312558137 None] Acquiring lock "cinder-75e6c9b2-5952-4ed9-86c9-3902770e5090-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:07:30 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-db4f9a83-e916-487f-bc5d-375cf6d0af23 tempest-ProjectMemberTests-1312558137 None] Lock "cinder-75e6c9b2-5952-4ed9-86c9-3902770e5090-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:07:30 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:UPDATE=260,cinder:DELETE=26,cinder:SELECT=196,cinder:INSERT=73 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:07:30 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=203,cinder:UPDATE=280,cinder:INSERT=71,cinder:DELETE=17 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:07:30 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-db4f9a83-e916-487f-bc5d-375cf6d0af23 tempest-ProjectMemberTests-1312558137 None] Acquiring lock "cinder-quobyte-75e6c9b2-5952-4ed9-86c9-3902770e5090" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:07:30 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-db4f9a83-e916-487f-bc5d-375cf6d0af23 tempest-ProjectMemberTests-1312558137 None] Lock "cinder-quobyte-75e6c9b2-5952-4ed9-86c9-3902770e5090" acquired by "delete_volume" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:07:30 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[51728ca2-b06f-4615-a245-6c72de6f0bfc]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:07:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-db4f9a83-e916-487f-bc5d-375cf6d0af23 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-75e6c9b2-5952-4ed9-86c9-3902770e5090 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:30 devstack sudo[108203]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-63ba4381-a7a1-4fd2-8e9b-fc5e15e9c1e2 tempest-ProjectReaderTests-215039770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8820d02f-759b-4cff-8553-57588ed1f4d4 1073741824" returned: 0 in 0.694s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-63ba4381-a7a1-4fd2-8e9b-fc5e15e9c1e2 tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8820d02f-759b-4cff-8553-57588ed1f4d4 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:30 devstack sudo[108210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8820d02f-759b-4cff-8553-57588ed1f4d4 Sep 28 12:07:30 devstack sudo[108210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:30 devstack sudo[108209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-75e6c9b2-5952-4ed9-86c9-3902770e5090 Sep 28 12:07:30 devstack sudo[108209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:31 devstack sudo[108210]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-63ba4381-a7a1-4fd2-8e9b-fc5e15e9c1e2 tempest-ProjectReaderTests-215039770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8820d02f-759b-4cff-8553-57588ed1f4d4" returned: 0 in 0.326s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:31 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-63ba4381-a7a1-4fd2-8e9b-fc5e15e9c1e2 tempest-ProjectReaderTests-215039770 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:07:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-63ba4381-a7a1-4fd2-8e9b-fc5e15e9c1e2 tempest-ProjectReaderTests-215039770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:07:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-63ba4381-a7a1-4fd2-8e9b-fc5e15e9c1e2 tempest-ProjectReaderTests-215039770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (accc4556-8c2c-4724-9748-2e37d8287359) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8820d02f-759b-4cff-8553-57588ed1f4d4', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-63ba4381-a7a1-4fd2-8e9b-fc5e15e9c1e2 tempest-ProjectReaderTests-215039770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1bba45e-3527-42b2-b97e-585f9bda9662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:31 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-63ba4381-a7a1-4fd2-8e9b-fc5e15e9c1e2 tempest-ProjectReaderTests-215039770 None] Volume volume-8820d02f-759b-4cff-8553-57588ed1f4d4 (8820d02f-759b-4cff-8553-57588ed1f4d4): created successfully Sep 28 12:07:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-63ba4381-a7a1-4fd2-8e9b-fc5e15e9c1e2 tempest-ProjectReaderTests-215039770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1bba45e-3527-42b2-b97e-585f9bda9662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:31 devstack sudo[108209]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-63ba4381-a7a1-4fd2-8e9b-fc5e15e9c1e2 tempest-ProjectReaderTests-215039770 None] Flow 'volume_create_manager' (9e91b7f7-5f7d-4d25-8a9c-b67f584b92f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:07:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-db4f9a83-e916-487f-bc5d-375cf6d0af23 tempest-ProjectMemberTests-1312558137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-75e6c9b2-5952-4ed9-86c9-3902770e5090" returned: 0 in 0.453s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-db4f9a83-e916-487f-bc5d-375cf6d0af23 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-75e6c9b2-5952-4ed9-86c9-3902770e5090 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:31 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-63ba4381-a7a1-4fd2-8e9b-fc5e15e9c1e2 tempest-ProjectReaderTests-215039770 None] Created volume successfully. Sep 28 12:07:31 devstack sudo[108217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-75e6c9b2-5952-4ed9-86c9-3902770e5090 Sep 28 12:07:31 devstack sudo[108217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:31 devstack sudo[108217]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-db4f9a83-e916-487f-bc5d-375cf6d0af23 tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-75e6c9b2-5952-4ed9-86c9-3902770e5090" returned: 0 in 0.265s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-db4f9a83-e916-487f-bc5d-375cf6d0af23 tempest-ProjectMemberTests-1312558137 None] Lock "cinder-quobyte-75e6c9b2-5952-4ed9-86c9-3902770e5090" released by "delete_volume" :: held 0.797s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:07:31 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-db4f9a83-e916-487f-bc5d-375cf6d0af23 tempest-ProjectMemberTests-1312558137 None] Created reservations ['b25f24ee-6722-4bf5-bd35-fe7eb7dc3df0', '1dc670a5-156d-4539-aefa-e64c4d827e1a', '7d6fd135-4e08-45b7-9efa-08195fec050d', '30b27864-382d-4f18-ba80-800185b79988'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:07:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-db4f9a83-e916-487f-bc5d-375cf6d0af23 tempest-ProjectMemberTests-1312558137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:07:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-db4f9a83-e916-487f-bc5d-375cf6d0af23 tempest-ProjectMemberTests-1312558137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:07:31 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-db4f9a83-e916-487f-bc5d-375cf6d0af23 tempest-ProjectMemberTests-1312558137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:07:31 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-db4f9a83-e916-487f-bc5d-375cf6d0af23 tempest-ProjectMemberTests-1312558137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:07:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-db4f9a83-e916-487f-bc5d-375cf6d0af23 tempest-ProjectMemberTests-1312558137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:07:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-db4f9a83-e916-487f-bc5d-375cf6d0af23 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:31 devstack sudo[108220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:07:31 devstack sudo[108220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:31 devstack sudo[108220]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-db4f9a83-e916-487f-bc5d-375cf6d0af23 tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.319s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:31 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-db4f9a83-e916-487f-bc5d-375cf6d0af23 tempest-ProjectMemberTests-1312558137 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:07:31 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-db4f9a83-e916-487f-bc5d-375cf6d0af23 tempest-ProjectMemberTests-1312558137 None] Deleted volume successfully. Sep 28 12:07:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-db4f9a83-e916-487f-bc5d-375cf6d0af23 tempest-ProjectMemberTests-1312558137 None] Lock "cinder-75e6c9b2-5952-4ed9-86c9-3902770e5090-delete_volume" released by "delete_volume" :: held 1.417s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:07:32 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-75c395c2-cb3d-4f9a-bf7f-5fbdb5185898 tempest-ProjectReaderTests-557580954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:07:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-75c395c2-cb3d-4f9a-bf7f-5fbdb5185898 tempest-ProjectReaderTests-557580954 None] Flow 'volume_create_manager' (e090d7a8-fe6f-4cd2-bff9-099c91414227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:07:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-75c395c2-cb3d-4f9a-bf7f-5fbdb5185898 tempest-ProjectReaderTests-557580954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ed20af0-561f-44cf-add9-f35d43ebe878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-75c395c2-cb3d-4f9a-bf7f-5fbdb5185898 tempest-ProjectReaderTests-557580954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ed20af0-561f-44cf-add9-f35d43ebe878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:07:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-28847877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f578c08-94d4-4bda-9122-6259207abaa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afe615eebccf4a148ad67970e3d30228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:07:32Z,use_quota=True,user_id='b0347f4754c34b9281c76a29fed9bb54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-75c395c2-cb3d-4f9a-bf7f-5fbdb5185898 tempest-ProjectReaderTests-557580954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2284010-2f7d-49c6-aa37-9e7ab2fc29a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-75c395c2-cb3d-4f9a-bf7f-5fbdb5185898 tempest-ProjectReaderTests-557580954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2284010-2f7d-49c6-aa37-9e7ab2fc29a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-75c395c2-cb3d-4f9a-bf7f-5fbdb5185898 tempest-ProjectReaderTests-557580954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8fc36c9-a678-48c3-9cbd-4c96a2e62cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-75c395c2-cb3d-4f9a-bf7f-5fbdb5185898 tempest-ProjectReaderTests-557580954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8fc36c9-a678-48c3-9cbd-4c96a2e62cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f578c08-94d4-4bda-9122-6259207abaa1', 'volume_name': 'volume-9f578c08-94d4-4bda-9122-6259207abaa1', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-75c395c2-cb3d-4f9a-bf7f-5fbdb5185898 tempest-ProjectReaderTests-557580954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1b31829-a722-476f-9eaf-7f6526ad0dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-75c395c2-cb3d-4f9a-bf7f-5fbdb5185898 tempest-ProjectReaderTests-557580954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1b31829-a722-476f-9eaf-7f6526ad0dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-75c395c2-cb3d-4f9a-bf7f-5fbdb5185898 tempest-ProjectReaderTests-557580954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9c281e5-3f10-429f-b8df-94a701310d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:32 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-75c395c2-cb3d-4f9a-bf7f-5fbdb5185898 tempest-ProjectReaderTests-557580954 None] Volume 9f578c08-94d4-4bda-9122-6259207abaa1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f578c08-94d4-4bda-9122-6259207abaa1', 'volume_size': 1} Sep 28 12:07:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-75c395c2-cb3d-4f9a-bf7f-5fbdb5185898 tempest-ProjectReaderTests-557580954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:07:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-75c395c2-cb3d-4f9a-bf7f-5fbdb5185898 tempest-ProjectReaderTests-557580954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:07:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-75c395c2-cb3d-4f9a-bf7f-5fbdb5185898 tempest-ProjectReaderTests-557580954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:07:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-28847877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f578c08-94d4-4bda-9122-6259207abaa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afe615eebccf4a148ad67970e3d30228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:07:32Z,use_quota=True,user_id='b0347f4754c34b9281c76a29fed9bb54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:07:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-75c395c2-cb3d-4f9a-bf7f-5fbdb5185898 tempest-ProjectReaderTests-557580954 None] Creating volume 9f578c08-94d4-4bda-9122-6259207abaa1 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:07:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-75c395c2-cb3d-4f9a-bf7f-5fbdb5185898 tempest-ProjectReaderTests-557580954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:07:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-75c395c2-cb3d-4f9a-bf7f-5fbdb5185898 tempest-ProjectReaderTests-557580954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:07:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-75c395c2-cb3d-4f9a-bf7f-5fbdb5185898 tempest-ProjectReaderTests-557580954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:07:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-75c395c2-cb3d-4f9a-bf7f-5fbdb5185898 tempest-ProjectReaderTests-557580954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:07:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-75c395c2-cb3d-4f9a-bf7f-5fbdb5185898 tempest-ProjectReaderTests-557580954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:07:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-75c395c2-cb3d-4f9a-bf7f-5fbdb5185898 tempest-ProjectReaderTests-557580954 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:07:32 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-75c395c2-cb3d-4f9a-bf7f-5fbdb5185898 tempest-ProjectReaderTests-557580954 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:07:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-75c395c2-cb3d-4f9a-bf7f-5fbdb5185898 tempest-ProjectReaderTests-557580954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9f578c08-94d4-4bda-9122-6259207abaa1 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:32 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-e58663e7-d743-44a9-b59a-ba9de88b32ac tempest-ProjectMemberTests-1312558137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:07:32 devstack sudo[108223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9f578c08-94d4-4bda-9122-6259207abaa1 1073741824 Sep 28 12:07:32 devstack sudo[108223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e58663e7-d743-44a9-b59a-ba9de88b32ac tempest-ProjectMemberTests-1312558137 None] Flow 'volume_create_manager' (c90a7543-15cf-4dd3-88d4-1b7ae1caa7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:07:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e58663e7-d743-44a9-b59a-ba9de88b32ac tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ddba00e-e500-4127-94d0-ffb56f5a514d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d2595d87-0b99-4bbc-8721-4f17149ba526 tempest-ProjectReaderTests-215039770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:07:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e58663e7-d743-44a9-b59a-ba9de88b32ac tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ddba00e-e500-4127-94d0-ffb56f5a514d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:07:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1666851785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5f0d215-1deb-436a-b662-022ddc66479f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba606417eb184510b6154fa1a28dce16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:07:33Z,use_quota=True,user_id='bb30da770afa465f8162e7779a473226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e58663e7-d743-44a9-b59a-ba9de88b32ac tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5b13494-14e6-4513-bd13-cde45f96b22f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e58663e7-d743-44a9-b59a-ba9de88b32ac tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5b13494-14e6-4513-bd13-cde45f96b22f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e58663e7-d743-44a9-b59a-ba9de88b32ac tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc4326a6-3b62-4227-bdc4-3ad8cd621c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e58663e7-d743-44a9-b59a-ba9de88b32ac tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc4326a6-3b62-4227-bdc4-3ad8cd621c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5f0d215-1deb-436a-b662-022ddc66479f', 'volume_name': 'volume-f5f0d215-1deb-436a-b662-022ddc66479f', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e58663e7-d743-44a9-b59a-ba9de88b32ac tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b3d9b89-e912-49fa-abe4-57d2ead8ca63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e58663e7-d743-44a9-b59a-ba9de88b32ac tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b3d9b89-e912-49fa-abe4-57d2ead8ca63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e58663e7-d743-44a9-b59a-ba9de88b32ac tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc35d6f4-8ede-4949-8946-af863cc73b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:32 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-e58663e7-d743-44a9-b59a-ba9de88b32ac tempest-ProjectMemberTests-1312558137 None] Volume f5f0d215-1deb-436a-b662-022ddc66479f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5f0d215-1deb-436a-b662-022ddc66479f', 'volume_size': 1} Sep 28 12:07:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e58663e7-d743-44a9-b59a-ba9de88b32ac tempest-ProjectMemberTests-1312558137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:07:33 devstack sudo[108223]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-75c395c2-cb3d-4f9a-bf7f-5fbdb5185898 tempest-ProjectReaderTests-557580954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9f578c08-94d4-4bda-9122-6259207abaa1 1073741824" returned: 0 in 0.566s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-75c395c2-cb3d-4f9a-bf7f-5fbdb5185898 tempest-ProjectReaderTests-557580954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9f578c08-94d4-4bda-9122-6259207abaa1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:33 devstack sudo[108229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9f578c08-94d4-4bda-9122-6259207abaa1 Sep 28 12:07:33 devstack sudo[108229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:33 devstack sudo[108229]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-75c395c2-cb3d-4f9a-bf7f-5fbdb5185898 tempest-ProjectReaderTests-557580954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9f578c08-94d4-4bda-9122-6259207abaa1" returned: 0 in 0.294s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-75c395c2-cb3d-4f9a-bf7f-5fbdb5185898 tempest-ProjectReaderTests-557580954 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:07:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-75c395c2-cb3d-4f9a-bf7f-5fbdb5185898 tempest-ProjectReaderTests-557580954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:07:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d2595d87-0b99-4bbc-8721-4f17149ba526 tempest-ProjectReaderTests-215039770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.873s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:07:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-75c395c2-cb3d-4f9a-bf7f-5fbdb5185898 tempest-ProjectReaderTests-557580954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9c281e5-3f10-429f-b8df-94a701310d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f578c08-94d4-4bda-9122-6259207abaa1', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-75c395c2-cb3d-4f9a-bf7f-5fbdb5185898 tempest-ProjectReaderTests-557580954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (297e22fa-0555-4013-9a02-719f844b8fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-d2595d87-0b99-4bbc-8721-4f17149ba526 tempest-ProjectReaderTests-215039770 None] Creating offline snapshot 4c56ac69-6878-4cfd-b265-9d081bab8c4c of volume 8820d02f-759b-4cff-8553-57588ed1f4d4 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:07:33 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-75c395c2-cb3d-4f9a-bf7f-5fbdb5185898 tempest-ProjectReaderTests-557580954 None] Volume volume-9f578c08-94d4-4bda-9122-6259207abaa1 (9f578c08-94d4-4bda-9122-6259207abaa1): created successfully Sep 28 12:07:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-75c395c2-cb3d-4f9a-bf7f-5fbdb5185898 tempest-ProjectReaderTests-557580954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (297e22fa-0555-4013-9a02-719f844b8fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-75c395c2-cb3d-4f9a-bf7f-5fbdb5185898 tempest-ProjectReaderTests-557580954 None] Flow 'volume_create_manager' (e090d7a8-fe6f-4cd2-bff9-099c91414227) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:07:33 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b52bee-12bc-47b8-beb3-7e2f83768b0e]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:07:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d2595d87-0b99-4bbc-8721-4f17149ba526 tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8820d02f-759b-4cff-8553-57588ed1f4d4 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:33 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-75c395c2-cb3d-4f9a-bf7f-5fbdb5185898 tempest-ProjectReaderTests-557580954 None] Created volume successfully. Sep 28 12:07:33 devstack sudo[108232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8820d02f-759b-4cff-8553-57588ed1f4d4 Sep 28 12:07:33 devstack sudo[108232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:34 devstack sudo[108232]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d2595d87-0b99-4bbc-8721-4f17149ba526 tempest-ProjectReaderTests-215039770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8820d02f-759b-4cff-8553-57588ed1f4d4" returned: 0 in 0.408s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d2595d87-0b99-4bbc-8721-4f17149ba526 tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8820d02f-759b-4cff-8553-57588ed1f4d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8820d02f-759b-4cff-8553-57588ed1f4d4.4c56ac69-6878-4cfd-b265-9d081bab8c4c 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:34 devstack sudo[108237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8820d02f-759b-4cff-8553-57588ed1f4d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8820d02f-759b-4cff-8553-57588ed1f4d4.4c56ac69-6878-4cfd-b265-9d081bab8c4c 1G Sep 28 12:07:34 devstack sudo[108237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:34 devstack sudo[108237]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d2595d87-0b99-4bbc-8721-4f17149ba526 tempest-ProjectReaderTests-215039770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8820d02f-759b-4cff-8553-57588ed1f4d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8820d02f-759b-4cff-8553-57588ed1f4d4.4c56ac69-6878-4cfd-b265-9d081bab8c4c 1G" returned: 0 in 0.495s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d2595d87-0b99-4bbc-8721-4f17149ba526 tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8820d02f-759b-4cff-8553-57588ed1f4d4 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8820d02f-759b-4cff-8553-57588ed1f4d4.4c56ac69-6878-4cfd-b265-9d081bab8c4c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:34 devstack sudo[108243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8820d02f-759b-4cff-8553-57588ed1f4d4 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8820d02f-759b-4cff-8553-57588ed1f4d4.4c56ac69-6878-4cfd-b265-9d081bab8c4c Sep 28 12:07:34 devstack sudo[108243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4cb774df-e61d-4553-9736-5d9a5ea22a2c tempest-ProjectReaderTests-557580954 None] Acquiring lock "cinder-9f578c08-94d4-4bda-9122-6259207abaa1-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:07:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4cb774df-e61d-4553-9736-5d9a5ea22a2c tempest-ProjectReaderTests-557580954 None] Lock "cinder-9f578c08-94d4-4bda-9122-6259207abaa1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:07:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4cb774df-e61d-4553-9736-5d9a5ea22a2c tempest-ProjectReaderTests-557580954 None] Acquiring lock "cinder-quobyte-9f578c08-94d4-4bda-9122-6259207abaa1" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:07:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4cb774df-e61d-4553-9736-5d9a5ea22a2c tempest-ProjectReaderTests-557580954 None] Lock "cinder-quobyte-9f578c08-94d4-4bda-9122-6259207abaa1" acquired by "delete_volume" :: waited 0.024s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:07:34 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ed5a8b-ce04-4f6c-9f49-cf2d28885ab3]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:07:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4cb774df-e61d-4553-9736-5d9a5ea22a2c tempest-ProjectReaderTests-557580954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9f578c08-94d4-4bda-9122-6259207abaa1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:34 devstack sudo[108245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9f578c08-94d4-4bda-9122-6259207abaa1 Sep 28 12:07:34 devstack sudo[108245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:34 devstack sudo[108243]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d2595d87-0b99-4bbc-8721-4f17149ba526 tempest-ProjectReaderTests-215039770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8820d02f-759b-4cff-8553-57588ed1f4d4 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8820d02f-759b-4cff-8553-57588ed1f4d4.4c56ac69-6878-4cfd-b265-9d081bab8c4c" returned: 0 in 0.367s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:34 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-d2595d87-0b99-4bbc-8721-4f17149ba526 tempest-ProjectReaderTests-215039770 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8820d02f-759b-4cff-8553-57588ed1f4d4.4c56ac69-6878-4cfd-b265-9d081bab8c4c is being set with open permissions: ugo+rw Sep 28 12:07:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d2595d87-0b99-4bbc-8721-4f17149ba526 tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8820d02f-759b-4cff-8553-57588ed1f4d4.4c56ac69-6878-4cfd-b265-9d081bab8c4c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:35 devstack sudo[108250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8820d02f-759b-4cff-8553-57588ed1f4d4.4c56ac69-6878-4cfd-b265-9d081bab8c4c Sep 28 12:07:35 devstack sudo[108250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:35 devstack sudo[108245]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4cb774df-e61d-4553-9736-5d9a5ea22a2c tempest-ProjectReaderTests-557580954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9f578c08-94d4-4bda-9122-6259207abaa1" returned: 0 in 0.411s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4cb774df-e61d-4553-9736-5d9a5ea22a2c tempest-ProjectReaderTests-557580954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9f578c08-94d4-4bda-9122-6259207abaa1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:35 devstack sudo[108256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9f578c08-94d4-4bda-9122-6259207abaa1 Sep 28 12:07:35 devstack sudo[108256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:35 devstack sudo[108250]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d2595d87-0b99-4bbc-8721-4f17149ba526 tempest-ProjectReaderTests-215039770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8820d02f-759b-4cff-8553-57588ed1f4d4.4c56ac69-6878-4cfd-b265-9d081bab8c4c" returned: 0 in 0.279s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d2595d87-0b99-4bbc-8721-4f17149ba526 tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8820d02f-759b-4cff-8553-57588ed1f4d4.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:35 devstack sudo[108258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8820d02f-759b-4cff-8553-57588ed1f4d4.info Sep 28 12:07:35 devstack sudo[108258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:35 devstack sudo[108256]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4cb774df-e61d-4553-9736-5d9a5ea22a2c tempest-ProjectReaderTests-557580954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-9f578c08-94d4-4bda-9122-6259207abaa1" returned: 0 in 0.280s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4cb774df-e61d-4553-9736-5d9a5ea22a2c tempest-ProjectReaderTests-557580954 None] Lock "cinder-quobyte-9f578c08-94d4-4bda-9122-6259207abaa1" released by "delete_volume" :: held 0.741s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:07:35 devstack sudo[108258]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d2595d87-0b99-4bbc-8721-4f17149ba526 tempest-ProjectReaderTests-215039770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8820d02f-759b-4cff-8553-57588ed1f4d4.info" returned: 0 in 0.287s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:35 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-d2595d87-0b99-4bbc-8721-4f17149ba526 tempest-ProjectReaderTests-215039770 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8820d02f-759b-4cff-8553-57588ed1f4d4.info is being set with open permissions: ugo+rw Sep 28 12:07:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d2595d87-0b99-4bbc-8721-4f17149ba526 tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8820d02f-759b-4cff-8553-57588ed1f4d4.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:35 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-4cb774df-e61d-4553-9736-5d9a5ea22a2c tempest-ProjectReaderTests-557580954 None] Created reservations ['8cd92a59-5935-4354-877e-61fe5470a05c', '4f1030ac-3739-4489-897f-e2ca2bbfaa19', 'd8a0d128-a92f-4260-907c-0bec035b4b94', '95363860-3cc0-463f-b5ee-d2781c74880c'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:07:35 devstack sudo[108262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8820d02f-759b-4cff-8553-57588ed1f4d4.info Sep 28 12:07:35 devstack sudo[108262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4cb774df-e61d-4553-9736-5d9a5ea22a2c tempest-ProjectReaderTests-557580954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:07:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4cb774df-e61d-4553-9736-5d9a5ea22a2c tempest-ProjectReaderTests-557580954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:07:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4cb774df-e61d-4553-9736-5d9a5ea22a2c tempest-ProjectReaderTests-557580954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:07:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4cb774df-e61d-4553-9736-5d9a5ea22a2c tempest-ProjectReaderTests-557580954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:07:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4cb774df-e61d-4553-9736-5d9a5ea22a2c tempest-ProjectReaderTests-557580954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:07:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4cb774df-e61d-4553-9736-5d9a5ea22a2c tempest-ProjectReaderTests-557580954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:35 devstack sudo[108264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:07:35 devstack sudo[108264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:35 devstack sudo[108262]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d2595d87-0b99-4bbc-8721-4f17149ba526 tempest-ProjectReaderTests-215039770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8820d02f-759b-4cff-8553-57588ed1f4d4.info" returned: 0 in 0.355s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d2595d87-0b99-4bbc-8721-4f17149ba526 tempest-ProjectReaderTests-215039770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.320s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:07:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e58663e7-d743-44a9-b59a-ba9de88b32ac tempest-ProjectMemberTests-1312558137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.143s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:07:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e58663e7-d743-44a9-b59a-ba9de88b32ac tempest-ProjectMemberTests-1312558137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:07:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1666851785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5f0d215-1deb-436a-b662-022ddc66479f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba606417eb184510b6154fa1a28dce16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:07:33Z,use_quota=True,user_id='bb30da770afa465f8162e7779a473226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:07:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-e58663e7-d743-44a9-b59a-ba9de88b32ac tempest-ProjectMemberTests-1312558137 None] Creating volume f5f0d215-1deb-436a-b662-022ddc66479f {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:07:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e58663e7-d743-44a9-b59a-ba9de88b32ac tempest-ProjectMemberTests-1312558137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:07:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e58663e7-d743-44a9-b59a-ba9de88b32ac tempest-ProjectMemberTests-1312558137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:07:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e58663e7-d743-44a9-b59a-ba9de88b32ac tempest-ProjectMemberTests-1312558137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:07:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e58663e7-d743-44a9-b59a-ba9de88b32ac tempest-ProjectMemberTests-1312558137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:07:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e58663e7-d743-44a9-b59a-ba9de88b32ac tempest-ProjectMemberTests-1312558137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:07:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e58663e7-d743-44a9-b59a-ba9de88b32ac tempest-ProjectMemberTests-1312558137 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:07:36 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-e58663e7-d743-44a9-b59a-ba9de88b32ac tempest-ProjectMemberTests-1312558137 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:07:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e58663e7-d743-44a9-b59a-ba9de88b32ac tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f5f0d215-1deb-436a-b662-022ddc66479f 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:36 devstack sudo[108264]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4cb774df-e61d-4553-9736-5d9a5ea22a2c tempest-ProjectReaderTests-557580954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.331s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:36 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-4cb774df-e61d-4553-9736-5d9a5ea22a2c tempest-ProjectReaderTests-557580954 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:07:36 devstack sudo[108268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f5f0d215-1deb-436a-b662-022ddc66479f 1073741824 Sep 28 12:07:36 devstack sudo[108268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:36 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-4cb774df-e61d-4553-9736-5d9a5ea22a2c tempest-ProjectReaderTests-557580954 None] Deleted volume successfully. Sep 28 12:07:36 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-d2595d87-0b99-4bbc-8721-4f17149ba526 tempest-ProjectReaderTests-215039770 None] Create snapshot completed successfully Sep 28 12:07:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4cb774df-e61d-4553-9736-5d9a5ea22a2c tempest-ProjectReaderTests-557580954 None] Lock "cinder-9f578c08-94d4-4bda-9122-6259207abaa1-delete_volume" released by "delete_volume" :: held 1.375s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:07:36 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2106b04-ea77-4719-b854-2e6aec2740e3 tempest-ProjectReaderTests-557580954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:07:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f2106b04-ea77-4719-b854-2e6aec2740e3 tempest-ProjectReaderTests-557580954 None] Flow 'volume_create_manager' (16ab0b07-2cc9-42da-a364-7bee07e7572e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:07:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f2106b04-ea77-4719-b854-2e6aec2740e3 tempest-ProjectReaderTests-557580954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83016ba4-9c54-4d1c-9e22-a5a932a625f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:36 devstack sudo[108268]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e58663e7-d743-44a9-b59a-ba9de88b32ac tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f5f0d215-1deb-436a-b662-022ddc66479f 1073741824" returned: 0 in 0.673s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f2106b04-ea77-4719-b854-2e6aec2740e3 tempest-ProjectReaderTests-557580954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83016ba4-9c54-4d1c-9e22-a5a932a625f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2009970293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a59e2185-1600-4590-ba61-e07f53fa76e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afe615eebccf4a148ad67970e3d30228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:07:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:07:37Z,use_quota=True,user_id='b0347f4754c34b9281c76a29fed9bb54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f2106b04-ea77-4719-b854-2e6aec2740e3 tempest-ProjectReaderTests-557580954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ade00608-dcc5-4ab0-89a8-5c1af8ea8d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f2106b04-ea77-4719-b854-2e6aec2740e3 tempest-ProjectReaderTests-557580954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ade00608-dcc5-4ab0-89a8-5c1af8ea8d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f2106b04-ea77-4719-b854-2e6aec2740e3 tempest-ProjectReaderTests-557580954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4737d77-ef84-423f-8c91-d24544a257b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f2106b04-ea77-4719-b854-2e6aec2740e3 tempest-ProjectReaderTests-557580954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4737d77-ef84-423f-8c91-d24544a257b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a59e2185-1600-4590-ba61-e07f53fa76e0', 'volume_name': 'volume-a59e2185-1600-4590-ba61-e07f53fa76e0', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f2106b04-ea77-4719-b854-2e6aec2740e3 tempest-ProjectReaderTests-557580954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ccd85e8-ab56-49f4-b4d7-cc0bc1a0936f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f2106b04-ea77-4719-b854-2e6aec2740e3 tempest-ProjectReaderTests-557580954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ccd85e8-ab56-49f4-b4d7-cc0bc1a0936f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f2106b04-ea77-4719-b854-2e6aec2740e3 tempest-ProjectReaderTests-557580954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2ac07d0-c31a-4936-b9fa-893ac05b15aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:36 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-f2106b04-ea77-4719-b854-2e6aec2740e3 tempest-ProjectReaderTests-557580954 None] Volume a59e2185-1600-4590-ba61-e07f53fa76e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a59e2185-1600-4590-ba61-e07f53fa76e0', 'volume_size': 1} Sep 28 12:07:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f2106b04-ea77-4719-b854-2e6aec2740e3 tempest-ProjectReaderTests-557580954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:07:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e58663e7-d743-44a9-b59a-ba9de88b32ac tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f5f0d215-1deb-436a-b662-022ddc66479f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:36 devstack sudo[108274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f5f0d215-1deb-436a-b662-022ddc66479f Sep 28 12:07:36 devstack sudo[108274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:37 devstack sudo[108274]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e58663e7-d743-44a9-b59a-ba9de88b32ac tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f5f0d215-1deb-436a-b662-022ddc66479f" returned: 0 in 0.289s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e58663e7-d743-44a9-b59a-ba9de88b32ac tempest-ProjectMemberTests-1312558137 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:07:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e58663e7-d743-44a9-b59a-ba9de88b32ac tempest-ProjectMemberTests-1312558137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:07:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f2106b04-ea77-4719-b854-2e6aec2740e3 tempest-ProjectReaderTests-557580954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.324s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:07:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f2106b04-ea77-4719-b854-2e6aec2740e3 tempest-ProjectReaderTests-557580954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2009970293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a59e2185-1600-4590-ba61-e07f53fa76e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afe615eebccf4a148ad67970e3d30228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:07:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:07:37Z,use_quota=True,user_id='b0347f4754c34b9281c76a29fed9bb54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:07:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-f2106b04-ea77-4719-b854-2e6aec2740e3 tempest-ProjectReaderTests-557580954 None] Creating volume a59e2185-1600-4590-ba61-e07f53fa76e0 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:07:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f2106b04-ea77-4719-b854-2e6aec2740e3 tempest-ProjectReaderTests-557580954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:07:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f2106b04-ea77-4719-b854-2e6aec2740e3 tempest-ProjectReaderTests-557580954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:07:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f2106b04-ea77-4719-b854-2e6aec2740e3 tempest-ProjectReaderTests-557580954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:07:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f2106b04-ea77-4719-b854-2e6aec2740e3 tempest-ProjectReaderTests-557580954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:07:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f2106b04-ea77-4719-b854-2e6aec2740e3 tempest-ProjectReaderTests-557580954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:07:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f2106b04-ea77-4719-b854-2e6aec2740e3 tempest-ProjectReaderTests-557580954 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:07:37 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-f2106b04-ea77-4719-b854-2e6aec2740e3 tempest-ProjectReaderTests-557580954 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:07:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f2106b04-ea77-4719-b854-2e6aec2740e3 tempest-ProjectReaderTests-557580954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a59e2185-1600-4590-ba61-e07f53fa76e0 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-abd5deba-ac7e-42cb-9d60-84aaf3770513 tempest-ProjectReaderTests-215039770 None] Acquiring lock "cinder-4c56ac69-6878-4cfd-b265-9d081bab8c4c-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:07:37 devstack sudo[108277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a59e2185-1600-4590-ba61-e07f53fa76e0 1073741824 Sep 28 12:07:37 devstack sudo[108277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e58663e7-d743-44a9-b59a-ba9de88b32ac tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc35d6f4-8ede-4949-8946-af863cc73b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5f0d215-1deb-436a-b662-022ddc66479f', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e58663e7-d743-44a9-b59a-ba9de88b32ac tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (412923c5-90a1-46c3-a89c-67cd6708a321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-abd5deba-ac7e-42cb-9d60-84aaf3770513 tempest-ProjectReaderTests-215039770 None] Lock "cinder-4c56ac69-6878-4cfd-b265-9d081bab8c4c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:07:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-abd5deba-ac7e-42cb-9d60-84aaf3770513 tempest-ProjectReaderTests-215039770 None] Acquiring lock "cinder-quobyte-8820d02f-759b-4cff-8553-57588ed1f4d4" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:07:37 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-e58663e7-d743-44a9-b59a-ba9de88b32ac tempest-ProjectMemberTests-1312558137 None] Volume volume-f5f0d215-1deb-436a-b662-022ddc66479f (f5f0d215-1deb-436a-b662-022ddc66479f): created successfully Sep 28 12:07:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e58663e7-d743-44a9-b59a-ba9de88b32ac tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (412923c5-90a1-46c3-a89c-67cd6708a321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e58663e7-d743-44a9-b59a-ba9de88b32ac tempest-ProjectMemberTests-1312558137 None] Flow 'volume_create_manager' (c90a7543-15cf-4dd3-88d4-1b7ae1caa7ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:07:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-abd5deba-ac7e-42cb-9d60-84aaf3770513 tempest-ProjectReaderTests-215039770 None] Lock "cinder-quobyte-8820d02f-759b-4cff-8553-57588ed1f4d4" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:07:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-abd5deba-ac7e-42cb-9d60-84aaf3770513 tempest-ProjectReaderTests-215039770 None] Acquiring lock "cinder-quobyte-4c56ac69-6878-4cfd-b265-9d081bab8c4c" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:07:37 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e58663e7-d743-44a9-b59a-ba9de88b32ac tempest-ProjectMemberTests-1312558137 None] Created volume successfully. Sep 28 12:07:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-abd5deba-ac7e-42cb-9d60-84aaf3770513 tempest-ProjectReaderTests-215039770 None] Lock "cinder-quobyte-4c56ac69-6878-4cfd-b265-9d081bab8c4c" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:07:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-abd5deba-ac7e-42cb-9d60-84aaf3770513 tempest-ProjectReaderTests-215039770 None] Deleting offline snapshot 4c56ac69-6878-4cfd-b265-9d081bab8c4c of volume 8820d02f-759b-4cff-8553-57588ed1f4d4 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:07:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-abd5deba-ac7e-42cb-9d60-84aaf3770513 tempest-ProjectReaderTests-215039770 None] snapshot_file for this snap is: volume-8820d02f-759b-4cff-8553-57588ed1f4d4.4c56ac69-6878-4cfd-b265-9d081bab8c4c {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:07:37 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[08feefcc-7bc3-4e11-b59c-883ef6d359ed]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:07:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-abd5deba-ac7e-42cb-9d60-84aaf3770513 tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8820d02f-759b-4cff-8553-57588ed1f4d4.4c56ac69-6878-4cfd-b265-9d081bab8c4c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:37 devstack sudo[108279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8820d02f-759b-4cff-8553-57588ed1f4d4.4c56ac69-6878-4cfd-b265-9d081bab8c4c Sep 28 12:07:37 devstack sudo[108279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:37 devstack sudo[108277]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f2106b04-ea77-4719-b854-2e6aec2740e3 tempest-ProjectReaderTests-557580954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a59e2185-1600-4590-ba61-e07f53fa76e0 1073741824" returned: 0 in 0.535s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f2106b04-ea77-4719-b854-2e6aec2740e3 tempest-ProjectReaderTests-557580954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a59e2185-1600-4590-ba61-e07f53fa76e0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:37 devstack sudo[108288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a59e2185-1600-4590-ba61-e07f53fa76e0 Sep 28 12:07:37 devstack sudo[108288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:37 devstack sudo[108279]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-abd5deba-ac7e-42cb-9d60-84aaf3770513 tempest-ProjectReaderTests-215039770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8820d02f-759b-4cff-8553-57588ed1f4d4.4c56ac69-6878-4cfd-b265-9d081bab8c4c" returned: 0 in 0.455s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-abd5deba-ac7e-42cb-9d60-84aaf3770513 tempest-ProjectReaderTests-215039770 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8820d02f-759b-4cff-8553-57588ed1f4d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:07:37 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[5228cc6b-a81a-439b-9d80-322ae2178585]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:07:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-abd5deba-ac7e-42cb-9d60-84aaf3770513 tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8820d02f-759b-4cff-8553-57588ed1f4d4 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:37 devstack sudo[108290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8820d02f-759b-4cff-8553-57588ed1f4d4 Sep 28 12:07:37 devstack sudo[108290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:37 devstack sudo[108288]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f2106b04-ea77-4719-b854-2e6aec2740e3 tempest-ProjectReaderTests-557580954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a59e2185-1600-4590-ba61-e07f53fa76e0" returned: 0 in 0.340s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f2106b04-ea77-4719-b854-2e6aec2740e3 tempest-ProjectReaderTests-557580954 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:07:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f2106b04-ea77-4719-b854-2e6aec2740e3 tempest-ProjectReaderTests-557580954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:07:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f2106b04-ea77-4719-b854-2e6aec2740e3 tempest-ProjectReaderTests-557580954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2ac07d0-c31a-4936-b9fa-893ac05b15aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a59e2185-1600-4590-ba61-e07f53fa76e0', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f2106b04-ea77-4719-b854-2e6aec2740e3 tempest-ProjectReaderTests-557580954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ad2986a-4f3c-4861-bb84-56019919798f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ad57483a-ac72-4912-8c95-2d70f81e8aee tempest-ProjectMemberTests-1312558137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:07:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ad57483a-ac72-4912-8c95-2d70f81e8aee tempest-ProjectMemberTests-1312558137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:07:38 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-f2106b04-ea77-4719-b854-2e6aec2740e3 tempest-ProjectReaderTests-557580954 None] Volume volume-a59e2185-1600-4590-ba61-e07f53fa76e0 (a59e2185-1600-4590-ba61-e07f53fa76e0): created successfully Sep 28 12:07:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f2106b04-ea77-4719-b854-2e6aec2740e3 tempest-ProjectReaderTests-557580954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ad2986a-4f3c-4861-bb84-56019919798f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f2106b04-ea77-4719-b854-2e6aec2740e3 tempest-ProjectReaderTests-557580954 None] Flow 'volume_create_manager' (16ab0b07-2cc9-42da-a364-7bee07e7572e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:07:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-ad57483a-ac72-4912-8c95-2d70f81e8aee tempest-ProjectMemberTests-1312558137 None] Creating offline snapshot d5b9e29d-f53c-4bd4-991b-c8afec9574ca of volume f5f0d215-1deb-436a-b662-022ddc66479f {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:07:38 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-f2106b04-ea77-4719-b854-2e6aec2740e3 tempest-ProjectReaderTests-557580954 None] Created volume successfully. Sep 28 12:07:38 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee19d7d-e106-4f95-ab05-a16e2b37a00f]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:07:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ad57483a-ac72-4912-8c95-2d70f81e8aee tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f5f0d215-1deb-436a-b662-022ddc66479f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:38 devstack sudo[108290]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-abd5deba-ac7e-42cb-9d60-84aaf3770513 tempest-ProjectReaderTests-215039770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8820d02f-759b-4cff-8553-57588ed1f4d4" returned: 0 in 0.504s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-abd5deba-ac7e-42cb-9d60-84aaf3770513 tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8820d02f-759b-4cff-8553-57588ed1f4d4.4c56ac69-6878-4cfd-b265-9d081bab8c4c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:38 devstack sudo[108294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f5f0d215-1deb-436a-b662-022ddc66479f Sep 28 12:07:38 devstack sudo[108294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:38 devstack sudo[108297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8820d02f-759b-4cff-8553-57588ed1f4d4.4c56ac69-6878-4cfd-b265-9d081bab8c4c Sep 28 12:07:38 devstack sudo[108297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:38 devstack sudo[108294]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:38 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:07:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:07:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:07:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:07:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:07:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:07:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ad57483a-ac72-4912-8c95-2d70f81e8aee tempest-ProjectMemberTests-1312558137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f5f0d215-1deb-436a-b662-022ddc66479f" returned: 0 in 0.549s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ad57483a-ac72-4912-8c95-2d70f81e8aee tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f5f0d215-1deb-436a-b662-022ddc66479f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f5f0d215-1deb-436a-b662-022ddc66479f.d5b9e29d-f53c-4bd4-991b-c8afec9574ca 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:38 devstack sudo[108306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:07:38 devstack sudo[108306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:38 devstack sudo[108307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f5f0d215-1deb-436a-b662-022ddc66479f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f5f0d215-1deb-436a-b662-022ddc66479f.d5b9e29d-f53c-4bd4-991b-c8afec9574ca 1G Sep 28 12:07:38 devstack sudo[108307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5ddcaec0-802a-468e-b8e4-338544466913 tempest-ProjectReaderTests-557580954 None] Acquiring lock "cinder-a59e2185-1600-4590-ba61-e07f53fa76e0-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:07:38 devstack sudo[108297]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-abd5deba-ac7e-42cb-9d60-84aaf3770513 tempest-ProjectReaderTests-215039770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8820d02f-759b-4cff-8553-57588ed1f4d4.4c56ac69-6878-4cfd-b265-9d081bab8c4c" returned: 0 in 0.528s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-abd5deba-ac7e-42cb-9d60-84aaf3770513 tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8820d02f-759b-4cff-8553-57588ed1f4d4.4c56ac69-6878-4cfd-b265-9d081bab8c4c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5ddcaec0-802a-468e-b8e4-338544466913 tempest-ProjectReaderTests-557580954 None] Lock "cinder-a59e2185-1600-4590-ba61-e07f53fa76e0-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:07:38 devstack sudo[108310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8820d02f-759b-4cff-8553-57588ed1f4d4.4c56ac69-6878-4cfd-b265-9d081bab8c4c Sep 28 12:07:38 devstack sudo[108310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:38 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3e2e4a9-bd61-4c31-bf73-64379edf71eb tempest-ProjectReaderTests-2142964066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:07:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d3e2e4a9-bd61-4c31-bf73-64379edf71eb tempest-ProjectReaderTests-2142964066 None] Flow 'volume_create_manager' (e6739c21-2744-41fe-a9d6-49bafa60f026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:07:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d3e2e4a9-bd61-4c31-bf73-64379edf71eb tempest-ProjectReaderTests-2142964066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (675e5984-064d-477c-a2e1-da7310e72936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5ddcaec0-802a-468e-b8e4-338544466913 tempest-ProjectReaderTests-557580954 None] Acquiring lock "cinder-quobyte-a59e2185-1600-4590-ba61-e07f53fa76e0" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:07:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d3e2e4a9-bd61-4c31-bf73-64379edf71eb tempest-ProjectReaderTests-2142964066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (675e5984-064d-477c-a2e1-da7310e72936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-402731599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b017f0b3-8693-4ee9-b6d5-919951df1708,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='863150ed474142089a12a5bb71fbf6ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:07:39Z,use_quota=True,user_id='6e9cefa9e8394d4d9745c2cbc591a90c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d3e2e4a9-bd61-4c31-bf73-64379edf71eb tempest-ProjectReaderTests-2142964066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (539889c3-3d9b-42d4-a3bf-90bc9e6bb885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d3e2e4a9-bd61-4c31-bf73-64379edf71eb tempest-ProjectReaderTests-2142964066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (539889c3-3d9b-42d4-a3bf-90bc9e6bb885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d3e2e4a9-bd61-4c31-bf73-64379edf71eb tempest-ProjectReaderTests-2142964066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (411554d1-260d-4ff3-9dca-d2a878fcf14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d3e2e4a9-bd61-4c31-bf73-64379edf71eb tempest-ProjectReaderTests-2142964066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (411554d1-260d-4ff3-9dca-d2a878fcf14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b017f0b3-8693-4ee9-b6d5-919951df1708', 'volume_name': 'volume-b017f0b3-8693-4ee9-b6d5-919951df1708', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:39 devstack sudo[108306]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d3e2e4a9-bd61-4c31-bf73-64379edf71eb tempest-ProjectReaderTests-2142964066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e5df3a5-cc40-440e-99c2-beb30f93184a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d3e2e4a9-bd61-4c31-bf73-64379edf71eb tempest-ProjectReaderTests-2142964066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e5df3a5-cc40-440e-99c2-beb30f93184a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d3e2e4a9-bd61-4c31-bf73-64379edf71eb tempest-ProjectReaderTests-2142964066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24a35285-d253-4bac-8711-cd9eedf26b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:39 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-d3e2e4a9-bd61-4c31-bf73-64379edf71eb tempest-ProjectReaderTests-2142964066 None] Volume b017f0b3-8693-4ee9-b6d5-919951df1708: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b017f0b3-8693-4ee9-b6d5-919951df1708', 'volume_size': 1} Sep 28 12:07:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d3e2e4a9-bd61-4c31-bf73-64379edf71eb tempest-ProjectReaderTests-2142964066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:07:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5ddcaec0-802a-468e-b8e4-338544466913 tempest-ProjectReaderTests-557580954 None] Lock "cinder-quobyte-a59e2185-1600-4590-ba61-e07f53fa76e0" acquired by "delete_volume" :: waited 0.105s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:07:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.445s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:39 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:07:39 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:07:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] thread count: 28 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:07:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] thread info: [<_MainThread(MainThread, started 135408582168704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:07:39 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[d693af8d-1d80-470c-bd66-ed0771d3fbd6]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:07:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5ddcaec0-802a-468e-b8e4-338544466913 tempest-ProjectReaderTests-557580954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a59e2185-1600-4590-ba61-e07f53fa76e0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:39 devstack sudo[108310]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-abd5deba-ac7e-42cb-9d60-84aaf3770513 tempest-ProjectReaderTests-215039770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8820d02f-759b-4cff-8553-57588ed1f4d4.4c56ac69-6878-4cfd-b265-9d081bab8c4c" returned: 0 in 0.381s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-abd5deba-ac7e-42cb-9d60-84aaf3770513 tempest-ProjectReaderTests-215039770 None] Lock "cinder-quobyte-4c56ac69-6878-4cfd-b265-9d081bab8c4c" released by "_delete_snapshot" :: held 2.027s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:07:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-abd5deba-ac7e-42cb-9d60-84aaf3770513 tempest-ProjectReaderTests-215039770 None] Lock "cinder-quobyte-8820d02f-759b-4cff-8553-57588ed1f4d4" released by "delete_snapshot" :: held 2.066s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:07:39 devstack sudo[108307]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ad57483a-ac72-4912-8c95-2d70f81e8aee tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f5f0d215-1deb-436a-b662-022ddc66479f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f5f0d215-1deb-436a-b662-022ddc66479f.d5b9e29d-f53c-4bd4-991b-c8afec9574ca 1G" returned: 0 in 0.577s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ad57483a-ac72-4912-8c95-2d70f81e8aee tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5f0d215-1deb-436a-b662-022ddc66479f -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f5f0d215-1deb-436a-b662-022ddc66479f.d5b9e29d-f53c-4bd4-991b-c8afec9574ca {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:39 devstack sudo[108316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a59e2185-1600-4590-ba61-e07f53fa76e0 Sep 28 12:07:39 devstack sudo[108316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:39 devstack sudo[108320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5f0d215-1deb-436a-b662-022ddc66479f -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f5f0d215-1deb-436a-b662-022ddc66479f.d5b9e29d-f53c-4bd4-991b-c8afec9574ca Sep 28 12:07:39 devstack sudo[108320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:39 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-abd5deba-ac7e-42cb-9d60-84aaf3770513 tempest-ProjectReaderTests-215039770 None] Created reservations ['e4f2a5ac-31de-4062-9a5b-ed516c939dd0', 'f69eab3a-06d7-435a-bf9d-c5434c93a73f', 'ced33441-3c69-4650-939b-a98a4cfd0c51', '51ff7b5b-bcba-4384-b6ba-1b251257b57f'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:07:39 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-abd5deba-ac7e-42cb-9d60-84aaf3770513 tempest-ProjectReaderTests-215039770 None] Delete snapshot completed successfully. Sep 28 12:07:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-abd5deba-ac7e-42cb-9d60-84aaf3770513 tempest-ProjectReaderTests-215039770 None] Lock "cinder-4c56ac69-6878-4cfd-b265-9d081bab8c4c-delete_snapshot" released by "delete_snapshot" :: held 2.256s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:07:39 devstack sudo[108316]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5ddcaec0-802a-468e-b8e4-338544466913 tempest-ProjectReaderTests-557580954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a59e2185-1600-4590-ba61-e07f53fa76e0" returned: 0 in 0.406s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5ddcaec0-802a-468e-b8e4-338544466913 tempest-ProjectReaderTests-557580954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a59e2185-1600-4590-ba61-e07f53fa76e0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:39 devstack sudo[108327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a59e2185-1600-4590-ba61-e07f53fa76e0 Sep 28 12:07:39 devstack sudo[108327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:39 devstack sudo[108320]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ad57483a-ac72-4912-8c95-2d70f81e8aee tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5f0d215-1deb-436a-b662-022ddc66479f -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f5f0d215-1deb-436a-b662-022ddc66479f.d5b9e29d-f53c-4bd4-991b-c8afec9574ca" returned: 0 in 0.345s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:39 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-ad57483a-ac72-4912-8c95-2d70f81e8aee tempest-ProjectMemberTests-1312558137 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f5f0d215-1deb-436a-b662-022ddc66479f.d5b9e29d-f53c-4bd4-991b-c8afec9574ca is being set with open permissions: ugo+rw Sep 28 12:07:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ad57483a-ac72-4912-8c95-2d70f81e8aee tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f5f0d215-1deb-436a-b662-022ddc66479f.d5b9e29d-f53c-4bd4-991b-c8afec9574ca {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:39 devstack sudo[108331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f5f0d215-1deb-436a-b662-022ddc66479f.d5b9e29d-f53c-4bd4-991b-c8afec9574ca Sep 28 12:07:39 devstack sudo[108331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:39 devstack sudo[108327]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5ddcaec0-802a-468e-b8e4-338544466913 tempest-ProjectReaderTests-557580954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-a59e2185-1600-4590-ba61-e07f53fa76e0" returned: 0 in 0.270s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5ddcaec0-802a-468e-b8e4-338544466913 tempest-ProjectReaderTests-557580954 None] Lock "cinder-quobyte-a59e2185-1600-4590-ba61-e07f53fa76e0" released by "delete_volume" :: held 0.734s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:07:39 devstack sudo[108331]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:39 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-5ddcaec0-802a-468e-b8e4-338544466913 tempest-ProjectReaderTests-557580954 None] Created reservations ['ecbc555d-53b6-446f-bef5-a36a7dc64ef9', '8494bbe7-e793-4e84-9787-c289e22e051e', 'eacc3ba1-c70c-4b80-b73d-793c547f492a', 'bd8eecfe-1243-4aba-a002-e101ed82785f'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:07:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ad57483a-ac72-4912-8c95-2d70f81e8aee tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f5f0d215-1deb-436a-b662-022ddc66479f.d5b9e29d-f53c-4bd4-991b-c8afec9574ca" returned: 0 in 0.274s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ad57483a-ac72-4912-8c95-2d70f81e8aee tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f5f0d215-1deb-436a-b662-022ddc66479f.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:39 devstack sudo[108335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f5f0d215-1deb-436a-b662-022ddc66479f.info Sep 28 12:07:39 devstack sudo[108335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5ddcaec0-802a-468e-b8e4-338544466913 tempest-ProjectReaderTests-557580954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:07:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5ddcaec0-802a-468e-b8e4-338544466913 tempest-ProjectReaderTests-557580954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:07:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5ddcaec0-802a-468e-b8e4-338544466913 tempest-ProjectReaderTests-557580954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:07:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5ddcaec0-802a-468e-b8e4-338544466913 tempest-ProjectReaderTests-557580954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:07:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5ddcaec0-802a-468e-b8e4-338544466913 tempest-ProjectReaderTests-557580954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:07:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5ddcaec0-802a-468e-b8e4-338544466913 tempest-ProjectReaderTests-557580954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:40 devstack sudo[108337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:07:40 devstack sudo[108337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:40 devstack sudo[108335]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ad57483a-ac72-4912-8c95-2d70f81e8aee tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f5f0d215-1deb-436a-b662-022ddc66479f.info" returned: 0 in 0.316s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:40 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-ad57483a-ac72-4912-8c95-2d70f81e8aee tempest-ProjectMemberTests-1312558137 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f5f0d215-1deb-436a-b662-022ddc66479f.info is being set with open permissions: ugo+rw Sep 28 12:07:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ad57483a-ac72-4912-8c95-2d70f81e8aee tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f5f0d215-1deb-436a-b662-022ddc66479f.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:40 devstack sudo[108337]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5ddcaec0-802a-468e-b8e4-338544466913 tempest-ProjectReaderTests-557580954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.282s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:40 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-5ddcaec0-802a-468e-b8e4-338544466913 tempest-ProjectReaderTests-557580954 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:07:40 devstack sudo[108341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f5f0d215-1deb-436a-b662-022ddc66479f.info Sep 28 12:07:40 devstack sudo[108341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:40 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-5ddcaec0-802a-468e-b8e4-338544466913 tempest-ProjectReaderTests-557580954 None] Deleted volume successfully. Sep 28 12:07:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5ddcaec0-802a-468e-b8e4-338544466913 tempest-ProjectReaderTests-557580954 None] Lock "cinder-a59e2185-1600-4590-ba61-e07f53fa76e0-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:07:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6accf309-5f32-4e8c-928a-e0202ef61bd8 tempest-ProjectReaderTests-215039770 None] Acquiring lock "cinder-8820d02f-759b-4cff-8553-57588ed1f4d4-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:07:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6accf309-5f32-4e8c-928a-e0202ef61bd8 tempest-ProjectReaderTests-215039770 None] Lock "cinder-8820d02f-759b-4cff-8553-57588ed1f4d4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:07:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6accf309-5f32-4e8c-928a-e0202ef61bd8 tempest-ProjectReaderTests-215039770 None] Acquiring lock "cinder-quobyte-8820d02f-759b-4cff-8553-57588ed1f4d4" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:07:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6accf309-5f32-4e8c-928a-e0202ef61bd8 tempest-ProjectReaderTests-215039770 None] Lock "cinder-quobyte-8820d02f-759b-4cff-8553-57588ed1f4d4" acquired by "delete_volume" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:07:40 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[5adbc7e0-fdbe-4a2b-8f81-e2de57975577]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:07:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6accf309-5f32-4e8c-928a-e0202ef61bd8 tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8820d02f-759b-4cff-8553-57588ed1f4d4 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:40 devstack sudo[108344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8820d02f-759b-4cff-8553-57588ed1f4d4 Sep 28 12:07:40 devstack sudo[108344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:40 devstack sudo[108341]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ad57483a-ac72-4912-8c95-2d70f81e8aee tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f5f0d215-1deb-436a-b662-022ddc66479f.info" returned: 0 in 0.325s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ad57483a-ac72-4912-8c95-2d70f81e8aee tempest-ProjectMemberTests-1312558137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.551s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:07:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d3e2e4a9-bd61-4c31-bf73-64379edf71eb tempest-ProjectReaderTests-2142964066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.511s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:07:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d3e2e4a9-bd61-4c31-bf73-64379edf71eb tempest-ProjectReaderTests-2142964066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-402731599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b017f0b3-8693-4ee9-b6d5-919951df1708,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='863150ed474142089a12a5bb71fbf6ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:07:39Z,use_quota=True,user_id='6e9cefa9e8394d4d9745c2cbc591a90c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:07:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-d3e2e4a9-bd61-4c31-bf73-64379edf71eb tempest-ProjectReaderTests-2142964066 None] Creating volume b017f0b3-8693-4ee9-b6d5-919951df1708 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:07:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d3e2e4a9-bd61-4c31-bf73-64379edf71eb tempest-ProjectReaderTests-2142964066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:07:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d3e2e4a9-bd61-4c31-bf73-64379edf71eb tempest-ProjectReaderTests-2142964066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:07:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d3e2e4a9-bd61-4c31-bf73-64379edf71eb tempest-ProjectReaderTests-2142964066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:07:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d3e2e4a9-bd61-4c31-bf73-64379edf71eb tempest-ProjectReaderTests-2142964066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:07:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d3e2e4a9-bd61-4c31-bf73-64379edf71eb tempest-ProjectReaderTests-2142964066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:07:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d3e2e4a9-bd61-4c31-bf73-64379edf71eb tempest-ProjectReaderTests-2142964066 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:07:40 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-d3e2e4a9-bd61-4c31-bf73-64379edf71eb tempest-ProjectReaderTests-2142964066 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:07:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d3e2e4a9-bd61-4c31-bf73-64379edf71eb tempest-ProjectReaderTests-2142964066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b017f0b3-8693-4ee9-b6d5-919951df1708 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:40 devstack sudo[108347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b017f0b3-8693-4ee9-b6d5-919951df1708 1073741824 Sep 28 12:07:40 devstack sudo[108347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:40 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-ad57483a-ac72-4912-8c95-2d70f81e8aee tempest-ProjectMemberTests-1312558137 None] Create snapshot completed successfully Sep 28 12:07:40 devstack sudo[108344]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6accf309-5f32-4e8c-928a-e0202ef61bd8 tempest-ProjectReaderTests-215039770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8820d02f-759b-4cff-8553-57588ed1f4d4" returned: 0 in 0.391s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6accf309-5f32-4e8c-928a-e0202ef61bd8 tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8820d02f-759b-4cff-8553-57588ed1f4d4 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:40 devstack sudo[108352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8820d02f-759b-4cff-8553-57588ed1f4d4 Sep 28 12:07:40 devstack sudo[108352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:41 devstack sudo[108352]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6accf309-5f32-4e8c-928a-e0202ef61bd8 tempest-ProjectReaderTests-215039770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8820d02f-759b-4cff-8553-57588ed1f4d4" returned: 0 in 0.324s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6accf309-5f32-4e8c-928a-e0202ef61bd8 tempest-ProjectReaderTests-215039770 None] Lock "cinder-quobyte-8820d02f-759b-4cff-8553-57588ed1f4d4" released by "delete_volume" :: held 0.789s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:07:41 devstack sudo[108347]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2fbcc2ff-d7ff-4374-adf1-e38177a7e53e tempest-ProjectMemberTests-1312558137 None] Acquiring lock "cinder-d5b9e29d-f53c-4bd4-991b-c8afec9574ca-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:07:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d3e2e4a9-bd61-4c31-bf73-64379edf71eb tempest-ProjectReaderTests-2142964066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b017f0b3-8693-4ee9-b6d5-919951df1708 1073741824" returned: 0 in 0.608s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2fbcc2ff-d7ff-4374-adf1-e38177a7e53e tempest-ProjectMemberTests-1312558137 None] Lock "cinder-d5b9e29d-f53c-4bd4-991b-c8afec9574ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:07:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2fbcc2ff-d7ff-4374-adf1-e38177a7e53e tempest-ProjectMemberTests-1312558137 None] Acquiring lock "cinder-quobyte-f5f0d215-1deb-436a-b662-022ddc66479f" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:07:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2fbcc2ff-d7ff-4374-adf1-e38177a7e53e tempest-ProjectMemberTests-1312558137 None] Lock "cinder-quobyte-f5f0d215-1deb-436a-b662-022ddc66479f" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:07:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2fbcc2ff-d7ff-4374-adf1-e38177a7e53e tempest-ProjectMemberTests-1312558137 None] Acquiring lock "cinder-quobyte-d5b9e29d-f53c-4bd4-991b-c8afec9574ca" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:07:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2fbcc2ff-d7ff-4374-adf1-e38177a7e53e tempest-ProjectMemberTests-1312558137 None] Lock "cinder-quobyte-d5b9e29d-f53c-4bd4-991b-c8afec9574ca" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:07:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-2fbcc2ff-d7ff-4374-adf1-e38177a7e53e tempest-ProjectMemberTests-1312558137 None] Deleting offline snapshot d5b9e29d-f53c-4bd4-991b-c8afec9574ca of volume f5f0d215-1deb-436a-b662-022ddc66479f {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:07:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-2fbcc2ff-d7ff-4374-adf1-e38177a7e53e tempest-ProjectMemberTests-1312558137 None] snapshot_file for this snap is: volume-f5f0d215-1deb-436a-b662-022ddc66479f.d5b9e29d-f53c-4bd4-991b-c8afec9574ca {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:07:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d3e2e4a9-bd61-4c31-bf73-64379edf71eb tempest-ProjectReaderTests-2142964066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b017f0b3-8693-4ee9-b6d5-919951df1708 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:41 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f66a06-978b-4cfa-9f38-55f7ca45cd4a]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:07:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2fbcc2ff-d7ff-4374-adf1-e38177a7e53e tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f5f0d215-1deb-436a-b662-022ddc66479f.d5b9e29d-f53c-4bd4-991b-c8afec9574ca {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:41 devstack sudo[108358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b017f0b3-8693-4ee9-b6d5-919951df1708 Sep 28 12:07:41 devstack sudo[108358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:41 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-6accf309-5f32-4e8c-928a-e0202ef61bd8 tempest-ProjectReaderTests-215039770 None] Created reservations ['a355db97-4040-4465-82f4-abba9e8ec8f7', '09392ef9-4c25-4c6d-a2ac-b309e32e67a3', 'cec0d741-4b90-4a17-b1b1-7dfccb611916', 'e84871e3-2185-4338-8925-a2232b693d50'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:07:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6accf309-5f32-4e8c-928a-e0202ef61bd8 tempest-ProjectReaderTests-215039770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:07:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6accf309-5f32-4e8c-928a-e0202ef61bd8 tempest-ProjectReaderTests-215039770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:07:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6accf309-5f32-4e8c-928a-e0202ef61bd8 tempest-ProjectReaderTests-215039770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:07:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6accf309-5f32-4e8c-928a-e0202ef61bd8 tempest-ProjectReaderTests-215039770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:07:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6accf309-5f32-4e8c-928a-e0202ef61bd8 tempest-ProjectReaderTests-215039770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:07:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6accf309-5f32-4e8c-928a-e0202ef61bd8 tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:41 devstack sudo[108360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f5f0d215-1deb-436a-b662-022ddc66479f.d5b9e29d-f53c-4bd4-991b-c8afec9574ca Sep 28 12:07:41 devstack sudo[108360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:41 devstack sudo[108362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:07:41 devstack sudo[108362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:41 devstack sudo[108358]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d3e2e4a9-bd61-4c31-bf73-64379edf71eb tempest-ProjectReaderTests-2142964066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b017f0b3-8693-4ee9-b6d5-919951df1708" returned: 0 in 0.393s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d3e2e4a9-bd61-4c31-bf73-64379edf71eb tempest-ProjectReaderTests-2142964066 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:07:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d3e2e4a9-bd61-4c31-bf73-64379edf71eb tempest-ProjectReaderTests-2142964066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:07:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d3e2e4a9-bd61-4c31-bf73-64379edf71eb tempest-ProjectReaderTests-2142964066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24a35285-d253-4bac-8711-cd9eedf26b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b017f0b3-8693-4ee9-b6d5-919951df1708', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d3e2e4a9-bd61-4c31-bf73-64379edf71eb tempest-ProjectReaderTests-2142964066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a145d022-c7fd-439d-9389-29224532f3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:41 devstack sudo[108360]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:41 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-d3e2e4a9-bd61-4c31-bf73-64379edf71eb tempest-ProjectReaderTests-2142964066 None] Volume volume-b017f0b3-8693-4ee9-b6d5-919951df1708 (b017f0b3-8693-4ee9-b6d5-919951df1708): created successfully Sep 28 12:07:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d3e2e4a9-bd61-4c31-bf73-64379edf71eb tempest-ProjectReaderTests-2142964066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a145d022-c7fd-439d-9389-29224532f3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d3e2e4a9-bd61-4c31-bf73-64379edf71eb tempest-ProjectReaderTests-2142964066 None] Flow 'volume_create_manager' (e6739c21-2744-41fe-a9d6-49bafa60f026) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:07:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2fbcc2ff-d7ff-4374-adf1-e38177a7e53e tempest-ProjectMemberTests-1312558137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f5f0d215-1deb-436a-b662-022ddc66479f.d5b9e29d-f53c-4bd4-991b-c8afec9574ca" returned: 0 in 0.499s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-2fbcc2ff-d7ff-4374-adf1-e38177a7e53e tempest-ProjectMemberTests-1312558137 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5f0d215-1deb-436a-b662-022ddc66479f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:07:41 devstack sudo[108362]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6accf309-5f32-4e8c-928a-e0202ef61bd8 tempest-ProjectReaderTests-215039770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.406s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:41 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-6accf309-5f32-4e8c-928a-e0202ef61bd8 tempest-ProjectReaderTests-215039770 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:07:41 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5d0406-b2dd-4eda-ad4a-35af604147db]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:07:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2fbcc2ff-d7ff-4374-adf1-e38177a7e53e tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f5f0d215-1deb-436a-b662-022ddc66479f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:41 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-d3e2e4a9-bd61-4c31-bf73-64379edf71eb tempest-ProjectReaderTests-2142964066 None] Created volume successfully. Sep 28 12:07:41 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-6accf309-5f32-4e8c-928a-e0202ef61bd8 tempest-ProjectReaderTests-215039770 None] Deleted volume successfully. Sep 28 12:07:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6accf309-5f32-4e8c-928a-e0202ef61bd8 tempest-ProjectReaderTests-215039770 None] Lock "cinder-8820d02f-759b-4cff-8553-57588ed1f4d4-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:07:42 devstack sudo[108369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f5f0d215-1deb-436a-b662-022ddc66479f Sep 28 12:07:42 devstack sudo[108369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:42 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-d14029cc-a8d6-4581-80e4-9fd4784ae05e tempest-ProjectReaderTests-215039770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:07:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d14029cc-a8d6-4581-80e4-9fd4784ae05e tempest-ProjectReaderTests-215039770 None] Flow 'volume_create_manager' (aed8ab9b-e0db-46ad-bd6b-4b6ec6a11500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:07:42 devstack sudo[108369]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d14029cc-a8d6-4581-80e4-9fd4784ae05e tempest-ProjectReaderTests-215039770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e38d1ad-9c24-4328-bf8d-81cdff95a337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d14029cc-a8d6-4581-80e4-9fd4784ae05e tempest-ProjectReaderTests-215039770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e38d1ad-9c24-4328-bf8d-81cdff95a337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:07:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1751020761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baa62038-ead1-4728-836c-45de945c95c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0967a03b26444a099e6a835bf5318cd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:07:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:07:42Z,use_quota=True,user_id='15e36ceca64444e0a9bfeb42495fbb44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d14029cc-a8d6-4581-80e4-9fd4784ae05e tempest-ProjectReaderTests-215039770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf7da375-6d3c-48e9-a635-87a71d9b062b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d14029cc-a8d6-4581-80e4-9fd4784ae05e tempest-ProjectReaderTests-215039770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf7da375-6d3c-48e9-a635-87a71d9b062b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d14029cc-a8d6-4581-80e4-9fd4784ae05e tempest-ProjectReaderTests-215039770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (244c5208-8250-4116-b72c-1679b492bf0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d14029cc-a8d6-4581-80e4-9fd4784ae05e tempest-ProjectReaderTests-215039770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (244c5208-8250-4116-b72c-1679b492bf0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'baa62038-ead1-4728-836c-45de945c95c3', 'volume_name': 'volume-baa62038-ead1-4728-836c-45de945c95c3', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d14029cc-a8d6-4581-80e4-9fd4784ae05e tempest-ProjectReaderTests-215039770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8092c106-c792-40ef-9f4e-e62cda3a0e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d14029cc-a8d6-4581-80e4-9fd4784ae05e tempest-ProjectReaderTests-215039770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8092c106-c792-40ef-9f4e-e62cda3a0e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d14029cc-a8d6-4581-80e4-9fd4784ae05e tempest-ProjectReaderTests-215039770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f446748-26af-4e6a-94da-33d9dc924d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:42 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-d14029cc-a8d6-4581-80e4-9fd4784ae05e tempest-ProjectReaderTests-215039770 None] Volume baa62038-ead1-4728-836c-45de945c95c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-baa62038-ead1-4728-836c-45de945c95c3', 'volume_size': 1} Sep 28 12:07:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d14029cc-a8d6-4581-80e4-9fd4784ae05e tempest-ProjectReaderTests-215039770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:07:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d14029cc-a8d6-4581-80e4-9fd4784ae05e tempest-ProjectReaderTests-215039770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:07:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d14029cc-a8d6-4581-80e4-9fd4784ae05e tempest-ProjectReaderTests-215039770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:07:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1751020761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baa62038-ead1-4728-836c-45de945c95c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0967a03b26444a099e6a835bf5318cd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:07:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:07:42Z,use_quota=True,user_id='15e36ceca64444e0a9bfeb42495fbb44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:07:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-d14029cc-a8d6-4581-80e4-9fd4784ae05e tempest-ProjectReaderTests-215039770 None] Creating volume baa62038-ead1-4728-836c-45de945c95c3 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:07:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d14029cc-a8d6-4581-80e4-9fd4784ae05e tempest-ProjectReaderTests-215039770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:07:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d14029cc-a8d6-4581-80e4-9fd4784ae05e tempest-ProjectReaderTests-215039770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:07:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d14029cc-a8d6-4581-80e4-9fd4784ae05e tempest-ProjectReaderTests-215039770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:07:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d14029cc-a8d6-4581-80e4-9fd4784ae05e tempest-ProjectReaderTests-215039770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:07:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d14029cc-a8d6-4581-80e4-9fd4784ae05e tempest-ProjectReaderTests-215039770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:07:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d14029cc-a8d6-4581-80e4-9fd4784ae05e tempest-ProjectReaderTests-215039770 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:07:42 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-d14029cc-a8d6-4581-80e4-9fd4784ae05e tempest-ProjectReaderTests-215039770 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:07:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d14029cc-a8d6-4581-80e4-9fd4784ae05e tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-baa62038-ead1-4728-836c-45de945c95c3 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2fbcc2ff-d7ff-4374-adf1-e38177a7e53e tempest-ProjectMemberTests-1312558137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f5f0d215-1deb-436a-b662-022ddc66479f" returned: 0 in 0.553s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2fbcc2ff-d7ff-4374-adf1-e38177a7e53e tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f5f0d215-1deb-436a-b662-022ddc66479f.d5b9e29d-f53c-4bd4-991b-c8afec9574ca {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:42 devstack sudo[108374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-baa62038-ead1-4728-836c-45de945c95c3 1073741824 Sep 28 12:07:42 devstack sudo[108374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:42 devstack sudo[108375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f5f0d215-1deb-436a-b662-022ddc66479f.d5b9e29d-f53c-4bd4-991b-c8afec9574ca Sep 28 12:07:42 devstack sudo[108375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:42 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a5af98f7-b467-434c-a3e0-b987dd66f7fa tempest-ProjectReaderTests-2142964066 None] Acquiring lock "cinder-b017f0b3-8693-4ee9-b6d5-919951df1708-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:07:42 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a5af98f7-b467-434c-a3e0-b987dd66f7fa tempest-ProjectReaderTests-2142964066 None] Lock "cinder-b017f0b3-8693-4ee9-b6d5-919951df1708-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:07:42 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a5af98f7-b467-434c-a3e0-b987dd66f7fa tempest-ProjectReaderTests-2142964066 None] Acquiring lock "cinder-quobyte-b017f0b3-8693-4ee9-b6d5-919951df1708" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:07:42 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a5af98f7-b467-434c-a3e0-b987dd66f7fa tempest-ProjectReaderTests-2142964066 None] Lock "cinder-quobyte-b017f0b3-8693-4ee9-b6d5-919951df1708" acquired by "delete_volume" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:07:42 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[be579c6c-99b5-46e3-ad4e-2224de8115d4]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:07:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a5af98f7-b467-434c-a3e0-b987dd66f7fa tempest-ProjectReaderTests-2142964066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b017f0b3-8693-4ee9-b6d5-919951df1708 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:42 devstack sudo[108378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b017f0b3-8693-4ee9-b6d5-919951df1708 Sep 28 12:07:42 devstack sudo[108378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:42 devstack sudo[108375]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2fbcc2ff-d7ff-4374-adf1-e38177a7e53e tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f5f0d215-1deb-436a-b662-022ddc66479f.d5b9e29d-f53c-4bd4-991b-c8afec9574ca" returned: 0 in 0.509s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2fbcc2ff-d7ff-4374-adf1-e38177a7e53e tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f5f0d215-1deb-436a-b662-022ddc66479f.d5b9e29d-f53c-4bd4-991b-c8afec9574ca {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:43 devstack sudo[108388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f5f0d215-1deb-436a-b662-022ddc66479f.d5b9e29d-f53c-4bd4-991b-c8afec9574ca Sep 28 12:07:43 devstack sudo[108388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:43 devstack sudo[108374]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d14029cc-a8d6-4581-80e4-9fd4784ae05e tempest-ProjectReaderTests-215039770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-baa62038-ead1-4728-836c-45de945c95c3 1073741824" returned: 0 in 0.583s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d14029cc-a8d6-4581-80e4-9fd4784ae05e tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-baa62038-ead1-4728-836c-45de945c95c3 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:43 devstack sudo[108394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-baa62038-ead1-4728-836c-45de945c95c3 Sep 28 12:07:43 devstack sudo[108394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:43 devstack sudo[108378]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a5af98f7-b467-434c-a3e0-b987dd66f7fa tempest-ProjectReaderTests-2142964066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b017f0b3-8693-4ee9-b6d5-919951df1708" returned: 0 in 0.469s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a5af98f7-b467-434c-a3e0-b987dd66f7fa tempest-ProjectReaderTests-2142964066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b017f0b3-8693-4ee9-b6d5-919951df1708 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:43 devstack sudo[108396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b017f0b3-8693-4ee9-b6d5-919951df1708 Sep 28 12:07:43 devstack sudo[108396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:43 devstack sudo[108388]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2fbcc2ff-d7ff-4374-adf1-e38177a7e53e tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f5f0d215-1deb-436a-b662-022ddc66479f.d5b9e29d-f53c-4bd4-991b-c8afec9574ca" returned: 0 in 0.403s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:43 devstack sudo[108394]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d14029cc-a8d6-4581-80e4-9fd4784ae05e tempest-ProjectReaderTests-215039770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-baa62038-ead1-4728-836c-45de945c95c3" returned: 0 in 0.336s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d14029cc-a8d6-4581-80e4-9fd4784ae05e tempest-ProjectReaderTests-215039770 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:07:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d14029cc-a8d6-4581-80e4-9fd4784ae05e tempest-ProjectReaderTests-215039770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:07:43 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2fbcc2ff-d7ff-4374-adf1-e38177a7e53e tempest-ProjectMemberTests-1312558137 None] Lock "cinder-quobyte-d5b9e29d-f53c-4bd4-991b-c8afec9574ca" released by "_delete_snapshot" :: held 2.122s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:07:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d14029cc-a8d6-4581-80e4-9fd4784ae05e tempest-ProjectReaderTests-215039770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f446748-26af-4e6a-94da-33d9dc924d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-baa62038-ead1-4728-836c-45de945c95c3', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d14029cc-a8d6-4581-80e4-9fd4784ae05e tempest-ProjectReaderTests-215039770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (564830c1-0703-422d-b8e2-7eb13483ed97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:43 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2fbcc2ff-d7ff-4374-adf1-e38177a7e53e tempest-ProjectMemberTests-1312558137 None] Lock "cinder-quobyte-f5f0d215-1deb-436a-b662-022ddc66479f" released by "delete_snapshot" :: held 2.170s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:07:43 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-d14029cc-a8d6-4581-80e4-9fd4784ae05e tempest-ProjectReaderTests-215039770 None] Volume volume-baa62038-ead1-4728-836c-45de945c95c3 (baa62038-ead1-4728-836c-45de945c95c3): created successfully Sep 28 12:07:43 devstack sudo[108396]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d14029cc-a8d6-4581-80e4-9fd4784ae05e tempest-ProjectReaderTests-215039770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (564830c1-0703-422d-b8e2-7eb13483ed97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d14029cc-a8d6-4581-80e4-9fd4784ae05e tempest-ProjectReaderTests-215039770 None] Flow 'volume_create_manager' (aed8ab9b-e0db-46ad-bd6b-4b6ec6a11500) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:07:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a5af98f7-b467-434c-a3e0-b987dd66f7fa tempest-ProjectReaderTests-2142964066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b017f0b3-8693-4ee9-b6d5-919951df1708" returned: 0 in 0.344s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:43 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a5af98f7-b467-434c-a3e0-b987dd66f7fa tempest-ProjectReaderTests-2142964066 None] Lock "cinder-quobyte-b017f0b3-8693-4ee9-b6d5-919951df1708" released by "delete_volume" :: held 0.874s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:07:43 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-d14029cc-a8d6-4581-80e4-9fd4784ae05e tempest-ProjectReaderTests-215039770 None] Created volume successfully. Sep 28 12:07:43 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-2fbcc2ff-d7ff-4374-adf1-e38177a7e53e tempest-ProjectMemberTests-1312558137 None] Created reservations ['608cd606-a913-4f37-a57f-c68f3ca6070f', '4b205da9-9870-4101-9bda-e5b5e1690bf9', '1626298d-d5e7-4382-b6d6-7d4e8dee8123', 'a3130daa-3a1d-4ee8-95af-91480bdf9134'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:07:43 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-a5af98f7-b467-434c-a3e0-b987dd66f7fa tempest-ProjectReaderTests-2142964066 None] Created reservations ['7366d959-bdfc-4db2-aa5f-6e14f7fe0b47', '5d81ab4c-abf6-4fe2-96b0-bcefcaec362d', '17fa176c-5568-4a50-ba41-ce44199a31ce', 'bbba3c7f-e105-4149-a020-9962f33dfed6'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:07:43 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-2fbcc2ff-d7ff-4374-adf1-e38177a7e53e tempest-ProjectMemberTests-1312558137 None] Delete snapshot completed successfully. Sep 28 12:07:43 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2fbcc2ff-d7ff-4374-adf1-e38177a7e53e tempest-ProjectMemberTests-1312558137 None] Lock "cinder-d5b9e29d-f53c-4bd4-991b-c8afec9574ca-delete_snapshot" released by "delete_snapshot" :: held 2.505s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:07:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a5af98f7-b467-434c-a3e0-b987dd66f7fa tempest-ProjectReaderTests-2142964066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:07:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a5af98f7-b467-434c-a3e0-b987dd66f7fa tempest-ProjectReaderTests-2142964066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:07:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a5af98f7-b467-434c-a3e0-b987dd66f7fa tempest-ProjectReaderTests-2142964066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:07:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a5af98f7-b467-434c-a3e0-b987dd66f7fa tempest-ProjectReaderTests-2142964066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:07:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a5af98f7-b467-434c-a3e0-b987dd66f7fa tempest-ProjectReaderTests-2142964066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:07:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a5af98f7-b467-434c-a3e0-b987dd66f7fa tempest-ProjectReaderTests-2142964066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:43 devstack sudo[108401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:07:43 devstack sudo[108401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:44 devstack sudo[108401]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a5af98f7-b467-434c-a3e0-b987dd66f7fa tempest-ProjectReaderTests-2142964066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.251s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:44 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a5af98f7-b467-434c-a3e0-b987dd66f7fa tempest-ProjectReaderTests-2142964066 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:07:44 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-a5af98f7-b467-434c-a3e0-b987dd66f7fa tempest-ProjectReaderTests-2142964066 None] Deleted volume successfully. Sep 28 12:07:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a5af98f7-b467-434c-a3e0-b987dd66f7fa tempest-ProjectReaderTests-2142964066 None] Lock "cinder-b017f0b3-8693-4ee9-b6d5-919951df1708-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:07:44 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ab70dd5-5c1d-43bf-994c-b4f283403cdd tempest-ProjectReaderTests-2142964066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:07:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1ab70dd5-5c1d-43bf-994c-b4f283403cdd tempest-ProjectReaderTests-2142964066 None] Flow 'volume_create_manager' (9e42c726-3bf5-47f6-85bd-d689d7a53cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:07:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1ab70dd5-5c1d-43bf-994c-b4f283403cdd tempest-ProjectReaderTests-2142964066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b7fff6e-6ee7-405a-9c14-822de7007e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1ab70dd5-5c1d-43bf-994c-b4f283403cdd tempest-ProjectReaderTests-2142964066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b7fff6e-6ee7-405a-9c14-822de7007e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:07:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-266815667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=494c186d-6beb-45fb-bc7d-249c410229a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='863150ed474142089a12a5bb71fbf6ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:07:44Z,use_quota=True,user_id='6e9cefa9e8394d4d9745c2cbc591a90c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1ab70dd5-5c1d-43bf-994c-b4f283403cdd tempest-ProjectReaderTests-2142964066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (553451c1-5444-4037-8bf0-820b66f151e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1ab70dd5-5c1d-43bf-994c-b4f283403cdd tempest-ProjectReaderTests-2142964066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (553451c1-5444-4037-8bf0-820b66f151e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1ab70dd5-5c1d-43bf-994c-b4f283403cdd tempest-ProjectReaderTests-2142964066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a97a73ec-9370-44db-a8ae-e37bf81b86f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1ab70dd5-5c1d-43bf-994c-b4f283403cdd tempest-ProjectReaderTests-2142964066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a97a73ec-9370-44db-a8ae-e37bf81b86f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '494c186d-6beb-45fb-bc7d-249c410229a2', 'volume_name': 'volume-494c186d-6beb-45fb-bc7d-249c410229a2', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1ab70dd5-5c1d-43bf-994c-b4f283403cdd tempest-ProjectReaderTests-2142964066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5734ab0f-c4b6-45ce-a021-8b96edd45a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1ab70dd5-5c1d-43bf-994c-b4f283403cdd tempest-ProjectReaderTests-2142964066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5734ab0f-c4b6-45ce-a021-8b96edd45a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1ab70dd5-5c1d-43bf-994c-b4f283403cdd tempest-ProjectReaderTests-2142964066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f49ed95b-4221-45bb-911f-a7bde5f8f936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:44 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-1ab70dd5-5c1d-43bf-994c-b4f283403cdd tempest-ProjectReaderTests-2142964066 None] Volume 494c186d-6beb-45fb-bc7d-249c410229a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-494c186d-6beb-45fb-bc7d-249c410229a2', 'volume_size': 1} Sep 28 12:07:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1ab70dd5-5c1d-43bf-994c-b4f283403cdd tempest-ProjectReaderTests-2142964066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:07:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1ab70dd5-5c1d-43bf-994c-b4f283403cdd tempest-ProjectReaderTests-2142964066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:07:44 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1ab70dd5-5c1d-43bf-994c-b4f283403cdd tempest-ProjectReaderTests-2142964066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:07:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-266815667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=494c186d-6beb-45fb-bc7d-249c410229a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='863150ed474142089a12a5bb71fbf6ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:07:44Z,use_quota=True,user_id='6e9cefa9e8394d4d9745c2cbc591a90c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:07:44 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-1ab70dd5-5c1d-43bf-994c-b4f283403cdd tempest-ProjectReaderTests-2142964066 None] Creating volume 494c186d-6beb-45fb-bc7d-249c410229a2 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:07:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1ab70dd5-5c1d-43bf-994c-b4f283403cdd tempest-ProjectReaderTests-2142964066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:07:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1ab70dd5-5c1d-43bf-994c-b4f283403cdd tempest-ProjectReaderTests-2142964066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:07:44 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1ab70dd5-5c1d-43bf-994c-b4f283403cdd tempest-ProjectReaderTests-2142964066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:07:44 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1ab70dd5-5c1d-43bf-994c-b4f283403cdd tempest-ProjectReaderTests-2142964066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:07:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1ab70dd5-5c1d-43bf-994c-b4f283403cdd tempest-ProjectReaderTests-2142964066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:07:44 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1ab70dd5-5c1d-43bf-994c-b4f283403cdd tempest-ProjectReaderTests-2142964066 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:07:44 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-1ab70dd5-5c1d-43bf-994c-b4f283403cdd tempest-ProjectReaderTests-2142964066 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:07:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1ab70dd5-5c1d-43bf-994c-b4f283403cdd tempest-ProjectReaderTests-2142964066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-494c186d-6beb-45fb-bc7d-249c410229a2 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:44 devstack sudo[108404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-494c186d-6beb-45fb-bc7d-249c410229a2 1073741824 Sep 28 12:07:44 devstack sudo[108404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-cd0b0bde-870d-4d5c-8b73-6b59d473665a tempest-ProjectMemberTests-1312558137 None] Acquiring lock "cinder-f5f0d215-1deb-436a-b662-022ddc66479f-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:07:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-cd0b0bde-870d-4d5c-8b73-6b59d473665a tempest-ProjectMemberTests-1312558137 None] Lock "cinder-f5f0d215-1deb-436a-b662-022ddc66479f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:07:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-cd0b0bde-870d-4d5c-8b73-6b59d473665a tempest-ProjectMemberTests-1312558137 None] Acquiring lock "cinder-quobyte-f5f0d215-1deb-436a-b662-022ddc66479f" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:07:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-eeaffc8a-3ad5-4e13-81e6-f0bdaa0144aa tempest-ProjectReaderTests-215039770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:07:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-cd0b0bde-870d-4d5c-8b73-6b59d473665a tempest-ProjectMemberTests-1312558137 None] Lock "cinder-quobyte-f5f0d215-1deb-436a-b662-022ddc66479f" acquired by "delete_volume" :: waited 0.024s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:07:44 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb30e99-9050-46fa-bce5-9b7b65eddbcf]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:07:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cd0b0bde-870d-4d5c-8b73-6b59d473665a tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f5f0d215-1deb-436a-b662-022ddc66479f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:44 devstack sudo[108409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f5f0d215-1deb-436a-b662-022ddc66479f Sep 28 12:07:44 devstack sudo[108409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:44 devstack sudo[108404]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1ab70dd5-5c1d-43bf-994c-b4f283403cdd tempest-ProjectReaderTests-2142964066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-494c186d-6beb-45fb-bc7d-249c410229a2 1073741824" returned: 0 in 0.496s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1ab70dd5-5c1d-43bf-994c-b4f283403cdd tempest-ProjectReaderTests-2142964066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-494c186d-6beb-45fb-bc7d-249c410229a2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:44 devstack sudo[108412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-494c186d-6beb-45fb-bc7d-249c410229a2 Sep 28 12:07:44 devstack sudo[108412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:45 devstack sudo[108409]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cd0b0bde-870d-4d5c-8b73-6b59d473665a tempest-ProjectMemberTests-1312558137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f5f0d215-1deb-436a-b662-022ddc66479f" returned: 0 in 0.417s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cd0b0bde-870d-4d5c-8b73-6b59d473665a tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f5f0d215-1deb-436a-b662-022ddc66479f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:45 devstack sudo[108417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f5f0d215-1deb-436a-b662-022ddc66479f Sep 28 12:07:45 devstack sudo[108417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:45 devstack sudo[108412]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1ab70dd5-5c1d-43bf-994c-b4f283403cdd tempest-ProjectReaderTests-2142964066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-494c186d-6beb-45fb-bc7d-249c410229a2" returned: 0 in 0.257s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1ab70dd5-5c1d-43bf-994c-b4f283403cdd tempest-ProjectReaderTests-2142964066 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:07:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1ab70dd5-5c1d-43bf-994c-b4f283403cdd tempest-ProjectReaderTests-2142964066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:07:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-eeaffc8a-3ad5-4e13-81e6-f0bdaa0144aa tempest-ProjectReaderTests-215039770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.544s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:07:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1ab70dd5-5c1d-43bf-994c-b4f283403cdd tempest-ProjectReaderTests-2142964066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f49ed95b-4221-45bb-911f-a7bde5f8f936) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-494c186d-6beb-45fb-bc7d-249c410229a2', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1ab70dd5-5c1d-43bf-994c-b4f283403cdd tempest-ProjectReaderTests-2142964066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0191c488-dad0-4b08-9844-3e3d182a4177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-eeaffc8a-3ad5-4e13-81e6-f0bdaa0144aa tempest-ProjectReaderTests-215039770 None] Creating offline snapshot 5b21c7b5-ebd0-495a-98a1-2fb019c6ecf8 of volume baa62038-ead1-4728-836c-45de945c95c3 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:07:45 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-1ab70dd5-5c1d-43bf-994c-b4f283403cdd tempest-ProjectReaderTests-2142964066 None] Volume volume-494c186d-6beb-45fb-bc7d-249c410229a2 (494c186d-6beb-45fb-bc7d-249c410229a2): created successfully Sep 28 12:07:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1ab70dd5-5c1d-43bf-994c-b4f283403cdd tempest-ProjectReaderTests-2142964066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0191c488-dad0-4b08-9844-3e3d182a4177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1ab70dd5-5c1d-43bf-994c-b4f283403cdd tempest-ProjectReaderTests-2142964066 None] Flow 'volume_create_manager' (9e42c726-3bf5-47f6-85bd-d689d7a53cdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:07:45 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce84d042-6f00-4461-9429-a965123ee385]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:07:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-eeaffc8a-3ad5-4e13-81e6-f0bdaa0144aa tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-baa62038-ead1-4728-836c-45de945c95c3 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:45 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-1ab70dd5-5c1d-43bf-994c-b4f283403cdd tempest-ProjectReaderTests-2142964066 None] Created volume successfully. Sep 28 12:07:45 devstack sudo[108420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-baa62038-ead1-4728-836c-45de945c95c3 Sep 28 12:07:45 devstack sudo[108420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:45 devstack sudo[108417]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cd0b0bde-870d-4d5c-8b73-6b59d473665a tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-f5f0d215-1deb-436a-b662-022ddc66479f" returned: 0 in 0.285s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:45 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-cd0b0bde-870d-4d5c-8b73-6b59d473665a tempest-ProjectMemberTests-1312558137 None] Lock "cinder-quobyte-f5f0d215-1deb-436a-b662-022ddc66479f" released by "delete_volume" :: held 0.781s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:07:45 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-cd0b0bde-870d-4d5c-8b73-6b59d473665a tempest-ProjectMemberTests-1312558137 None] Created reservations ['aa9bdade-2fcd-4533-b832-016645fc3f5d', '0f5f8a0c-62b5-4008-a192-692eb3784f51', '00194b30-6c98-482f-b62d-80b56ea3d66c', '76967845-7291-492e-8750-c8557c74a9c6'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:07:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cd0b0bde-870d-4d5c-8b73-6b59d473665a tempest-ProjectMemberTests-1312558137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:07:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cd0b0bde-870d-4d5c-8b73-6b59d473665a tempest-ProjectMemberTests-1312558137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:07:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cd0b0bde-870d-4d5c-8b73-6b59d473665a tempest-ProjectMemberTests-1312558137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:07:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cd0b0bde-870d-4d5c-8b73-6b59d473665a tempest-ProjectMemberTests-1312558137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:07:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cd0b0bde-870d-4d5c-8b73-6b59d473665a tempest-ProjectMemberTests-1312558137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:07:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cd0b0bde-870d-4d5c-8b73-6b59d473665a tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:45 devstack sudo[108426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:07:45 devstack sudo[108426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:45 devstack sudo[108420]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-eeaffc8a-3ad5-4e13-81e6-f0bdaa0144aa tempest-ProjectReaderTests-215039770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-baa62038-ead1-4728-836c-45de945c95c3" returned: 0 in 0.393s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-eeaffc8a-3ad5-4e13-81e6-f0bdaa0144aa tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-baa62038-ead1-4728-836c-45de945c95c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-baa62038-ead1-4728-836c-45de945c95c3.5b21c7b5-ebd0-495a-98a1-2fb019c6ecf8 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:45 devstack sudo[108428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-baa62038-ead1-4728-836c-45de945c95c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-baa62038-ead1-4728-836c-45de945c95c3.5b21c7b5-ebd0-495a-98a1-2fb019c6ecf8 1G Sep 28 12:07:45 devstack sudo[108428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:45 devstack sudo[108426]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cd0b0bde-870d-4d5c-8b73-6b59d473665a tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.275s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:45 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-cd0b0bde-870d-4d5c-8b73-6b59d473665a tempest-ProjectMemberTests-1312558137 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:07:45 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-cd0b0bde-870d-4d5c-8b73-6b59d473665a tempest-ProjectMemberTests-1312558137 None] Deleted volume successfully. Sep 28 12:07:45 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-cd0b0bde-870d-4d5c-8b73-6b59d473665a tempest-ProjectMemberTests-1312558137 None] Lock "cinder-f5f0d215-1deb-436a-b662-022ddc66479f-delete_volume" released by "delete_volume" :: held 1.345s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:07:46 devstack sudo[108428]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-eeaffc8a-3ad5-4e13-81e6-f0bdaa0144aa tempest-ProjectReaderTests-215039770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-baa62038-ead1-4728-836c-45de945c95c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-baa62038-ead1-4728-836c-45de945c95c3.5b21c7b5-ebd0-495a-98a1-2fb019c6ecf8 1G" returned: 0 in 0.469s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-eeaffc8a-3ad5-4e13-81e6-f0bdaa0144aa tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-baa62038-ead1-4728-836c-45de945c95c3 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-baa62038-ead1-4728-836c-45de945c95c3.5b21c7b5-ebd0-495a-98a1-2fb019c6ecf8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:46 devstack sudo[108434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-baa62038-ead1-4728-836c-45de945c95c3 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-baa62038-ead1-4728-836c-45de945c95c3.5b21c7b5-ebd0-495a-98a1-2fb019c6ecf8 Sep 28 12:07:46 devstack sudo[108434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:46 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-74e2b8d5-bd9e-46f1-a675-e91bcd9328f9 tempest-ProjectMemberTests-1312558137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:07:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-74e2b8d5-bd9e-46f1-a675-e91bcd9328f9 tempest-ProjectMemberTests-1312558137 None] Flow 'volume_create_manager' (303c89c8-5341-4384-a761-02f61b1064a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:07:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-74e2b8d5-bd9e-46f1-a675-e91bcd9328f9 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb15ad50-6d77-423c-8286-99a27b640a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-74e2b8d5-bd9e-46f1-a675-e91bcd9328f9 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb15ad50-6d77-423c-8286-99a27b640a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:07:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1019318664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8416166c-815c-4f1e-b0a5-248ac0412735,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba606417eb184510b6154fa1a28dce16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:07:46Z,use_quota=True,user_id='bb30da770afa465f8162e7779a473226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-74e2b8d5-bd9e-46f1-a675-e91bcd9328f9 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ad3849d-5528-4b9b-8cad-f20b3d487e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-74e2b8d5-bd9e-46f1-a675-e91bcd9328f9 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ad3849d-5528-4b9b-8cad-f20b3d487e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-74e2b8d5-bd9e-46f1-a675-e91bcd9328f9 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3e63b23-61f9-4654-a00f-371f7de10b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-74e2b8d5-bd9e-46f1-a675-e91bcd9328f9 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3e63b23-61f9-4654-a00f-371f7de10b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8416166c-815c-4f1e-b0a5-248ac0412735', 'volume_name': 'volume-8416166c-815c-4f1e-b0a5-248ac0412735', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-74e2b8d5-bd9e-46f1-a675-e91bcd9328f9 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3deb38a5-d614-4391-9649-b51bd1bfb807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-74e2b8d5-bd9e-46f1-a675-e91bcd9328f9 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3deb38a5-d614-4391-9649-b51bd1bfb807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-74e2b8d5-bd9e-46f1-a675-e91bcd9328f9 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3ec39d8-fcf3-4a0d-901b-d660aa56f11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:46 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-74e2b8d5-bd9e-46f1-a675-e91bcd9328f9 tempest-ProjectMemberTests-1312558137 None] Volume 8416166c-815c-4f1e-b0a5-248ac0412735: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8416166c-815c-4f1e-b0a5-248ac0412735', 'volume_size': 1} Sep 28 12:07:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-74e2b8d5-bd9e-46f1-a675-e91bcd9328f9 tempest-ProjectMemberTests-1312558137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:07:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-062043cf-e96c-4e9b-a7f7-23b720421076 tempest-ProjectReaderTests-2142964066 None] Acquiring lock "cinder-494c186d-6beb-45fb-bc7d-249c410229a2-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:07:46 devstack sudo[108434]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-062043cf-e96c-4e9b-a7f7-23b720421076 tempest-ProjectReaderTests-2142964066 None] Lock "cinder-494c186d-6beb-45fb-bc7d-249c410229a2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:07:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-eeaffc8a-3ad5-4e13-81e6-f0bdaa0144aa tempest-ProjectReaderTests-215039770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-baa62038-ead1-4728-836c-45de945c95c3 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-baa62038-ead1-4728-836c-45de945c95c3.5b21c7b5-ebd0-495a-98a1-2fb019c6ecf8" returned: 0 in 0.335s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:46 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-eeaffc8a-3ad5-4e13-81e6-f0bdaa0144aa tempest-ProjectReaderTests-215039770 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-baa62038-ead1-4728-836c-45de945c95c3.5b21c7b5-ebd0-495a-98a1-2fb019c6ecf8 is being set with open permissions: ugo+rw Sep 28 12:07:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-eeaffc8a-3ad5-4e13-81e6-f0bdaa0144aa tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-baa62038-ead1-4728-836c-45de945c95c3.5b21c7b5-ebd0-495a-98a1-2fb019c6ecf8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:46 devstack sudo[108439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-baa62038-ead1-4728-836c-45de945c95c3.5b21c7b5-ebd0-495a-98a1-2fb019c6ecf8 Sep 28 12:07:46 devstack sudo[108439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-062043cf-e96c-4e9b-a7f7-23b720421076 tempest-ProjectReaderTests-2142964066 None] Acquiring lock "cinder-quobyte-494c186d-6beb-45fb-bc7d-249c410229a2" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:07:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-062043cf-e96c-4e9b-a7f7-23b720421076 tempest-ProjectReaderTests-2142964066 None] Lock "cinder-quobyte-494c186d-6beb-45fb-bc7d-249c410229a2" acquired by "delete_volume" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:07:46 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[082b9106-6342-4c36-af28-c2fe37c841c2]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:07:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-062043cf-e96c-4e9b-a7f7-23b720421076 tempest-ProjectReaderTests-2142964066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-494c186d-6beb-45fb-bc7d-249c410229a2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:46 devstack sudo[108441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-494c186d-6beb-45fb-bc7d-249c410229a2 Sep 28 12:07:46 devstack sudo[108441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:46 devstack sudo[108439]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-eeaffc8a-3ad5-4e13-81e6-f0bdaa0144aa tempest-ProjectReaderTests-215039770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-baa62038-ead1-4728-836c-45de945c95c3.5b21c7b5-ebd0-495a-98a1-2fb019c6ecf8" returned: 0 in 0.257s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-eeaffc8a-3ad5-4e13-81e6-f0bdaa0144aa tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-baa62038-ead1-4728-836c-45de945c95c3.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:46 devstack sudo[108444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-baa62038-ead1-4728-836c-45de945c95c3.info Sep 28 12:07:46 devstack sudo[108444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:46 devstack sudo[108444]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:46 devstack sudo[108441]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-eeaffc8a-3ad5-4e13-81e6-f0bdaa0144aa tempest-ProjectReaderTests-215039770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-baa62038-ead1-4728-836c-45de945c95c3.info" returned: 0 in 0.261s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:46 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-eeaffc8a-3ad5-4e13-81e6-f0bdaa0144aa tempest-ProjectReaderTests-215039770 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-baa62038-ead1-4728-836c-45de945c95c3.info is being set with open permissions: ugo+rw Sep 28 12:07:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-eeaffc8a-3ad5-4e13-81e6-f0bdaa0144aa tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-baa62038-ead1-4728-836c-45de945c95c3.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-062043cf-e96c-4e9b-a7f7-23b720421076 tempest-ProjectReaderTests-2142964066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-494c186d-6beb-45fb-bc7d-249c410229a2" returned: 0 in 0.436s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-062043cf-e96c-4e9b-a7f7-23b720421076 tempest-ProjectReaderTests-2142964066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-494c186d-6beb-45fb-bc7d-249c410229a2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:47 devstack sudo[108450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-baa62038-ead1-4728-836c-45de945c95c3.info Sep 28 12:07:47 devstack sudo[108450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:47 devstack sudo[108451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-494c186d-6beb-45fb-bc7d-249c410229a2 Sep 28 12:07:47 devstack sudo[108451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:47 devstack sudo[108451]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:47 devstack sudo[108450]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-eeaffc8a-3ad5-4e13-81e6-f0bdaa0144aa tempest-ProjectReaderTests-215039770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-baa62038-ead1-4728-836c-45de945c95c3.info" returned: 0 in 0.272s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-eeaffc8a-3ad5-4e13-81e6-f0bdaa0144aa tempest-ProjectReaderTests-215039770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.110s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:07:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-74e2b8d5-bd9e-46f1-a675-e91bcd9328f9 tempest-ProjectMemberTests-1312558137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.015s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:07:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-74e2b8d5-bd9e-46f1-a675-e91bcd9328f9 tempest-ProjectMemberTests-1312558137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:07:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1019318664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8416166c-815c-4f1e-b0a5-248ac0412735,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba606417eb184510b6154fa1a28dce16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:07:46Z,use_quota=True,user_id='bb30da770afa465f8162e7779a473226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:07:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-74e2b8d5-bd9e-46f1-a675-e91bcd9328f9 tempest-ProjectMemberTests-1312558137 None] Creating volume 8416166c-815c-4f1e-b0a5-248ac0412735 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:07:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-74e2b8d5-bd9e-46f1-a675-e91bcd9328f9 tempest-ProjectMemberTests-1312558137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:07:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-74e2b8d5-bd9e-46f1-a675-e91bcd9328f9 tempest-ProjectMemberTests-1312558137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:07:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-74e2b8d5-bd9e-46f1-a675-e91bcd9328f9 tempest-ProjectMemberTests-1312558137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:07:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-74e2b8d5-bd9e-46f1-a675-e91bcd9328f9 tempest-ProjectMemberTests-1312558137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:07:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-74e2b8d5-bd9e-46f1-a675-e91bcd9328f9 tempest-ProjectMemberTests-1312558137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:07:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-74e2b8d5-bd9e-46f1-a675-e91bcd9328f9 tempest-ProjectMemberTests-1312558137 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:07:47 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-74e2b8d5-bd9e-46f1-a675-e91bcd9328f9 tempest-ProjectMemberTests-1312558137 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:07:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-74e2b8d5-bd9e-46f1-a675-e91bcd9328f9 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8416166c-815c-4f1e-b0a5-248ac0412735 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-062043cf-e96c-4e9b-a7f7-23b720421076 tempest-ProjectReaderTests-2142964066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-494c186d-6beb-45fb-bc7d-249c410229a2" returned: 0 in 0.305s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:47 devstack sudo[108456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8416166c-815c-4f1e-b0a5-248ac0412735 1073741824 Sep 28 12:07:47 devstack sudo[108456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:47 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-062043cf-e96c-4e9b-a7f7-23b720421076 tempest-ProjectReaderTests-2142964066 None] Lock "cinder-quobyte-494c186d-6beb-45fb-bc7d-249c410229a2" released by "delete_volume" :: held 0.808s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:07:47 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-eeaffc8a-3ad5-4e13-81e6-f0bdaa0144aa tempest-ProjectReaderTests-215039770 None] Create snapshot completed successfully Sep 28 12:07:47 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-062043cf-e96c-4e9b-a7f7-23b720421076 tempest-ProjectReaderTests-2142964066 None] Created reservations ['88339c37-fc32-4e9a-847f-da233ed7a5e9', '605ce88a-c34f-4827-bdc3-c06120388ea7', 'c192065d-1b64-4346-a14e-d3eabc529ac8', '90c06756-84b4-40f1-a781-dda42e6b9bf8'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:07:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-062043cf-e96c-4e9b-a7f7-23b720421076 tempest-ProjectReaderTests-2142964066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:07:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-062043cf-e96c-4e9b-a7f7-23b720421076 tempest-ProjectReaderTests-2142964066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:07:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-062043cf-e96c-4e9b-a7f7-23b720421076 tempest-ProjectReaderTests-2142964066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:07:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-062043cf-e96c-4e9b-a7f7-23b720421076 tempest-ProjectReaderTests-2142964066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:07:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-062043cf-e96c-4e9b-a7f7-23b720421076 tempest-ProjectReaderTests-2142964066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:07:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-062043cf-e96c-4e9b-a7f7-23b720421076 tempest-ProjectReaderTests-2142964066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:47 devstack sudo[108460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:07:47 devstack sudo[108460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:47 devstack sudo[108460]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-062043cf-e96c-4e9b-a7f7-23b720421076 tempest-ProjectReaderTests-2142964066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.277s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:47 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-062043cf-e96c-4e9b-a7f7-23b720421076 tempest-ProjectReaderTests-2142964066 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:07:47 devstack sudo[108456]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:47 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-062043cf-e96c-4e9b-a7f7-23b720421076 tempest-ProjectReaderTests-2142964066 None] Deleted volume successfully. Sep 28 12:07:47 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bdbaed03-1a45-478c-8f01-cf890588d073 tempest-ProjectReaderTests-215039770 None] Acquiring lock "cinder-5b21c7b5-ebd0-495a-98a1-2fb019c6ecf8-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:07:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-74e2b8d5-bd9e-46f1-a675-e91bcd9328f9 tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8416166c-815c-4f1e-b0a5-248ac0412735 1073741824" returned: 0 in 0.560s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:47 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bdbaed03-1a45-478c-8f01-cf890588d073 tempest-ProjectReaderTests-215039770 None] Lock "cinder-5b21c7b5-ebd0-495a-98a1-2fb019c6ecf8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:07:47 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bdbaed03-1a45-478c-8f01-cf890588d073 tempest-ProjectReaderTests-215039770 None] Acquiring lock "cinder-quobyte-baa62038-ead1-4728-836c-45de945c95c3" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:07:47 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-062043cf-e96c-4e9b-a7f7-23b720421076 tempest-ProjectReaderTests-2142964066 None] Lock "cinder-494c186d-6beb-45fb-bc7d-249c410229a2-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:07:47 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bdbaed03-1a45-478c-8f01-cf890588d073 tempest-ProjectReaderTests-215039770 None] Lock "cinder-quobyte-baa62038-ead1-4728-836c-45de945c95c3" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:07:47 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bdbaed03-1a45-478c-8f01-cf890588d073 tempest-ProjectReaderTests-215039770 None] Acquiring lock "cinder-quobyte-5b21c7b5-ebd0-495a-98a1-2fb019c6ecf8" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:07:47 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bdbaed03-1a45-478c-8f01-cf890588d073 tempest-ProjectReaderTests-215039770 None] Lock "cinder-quobyte-5b21c7b5-ebd0-495a-98a1-2fb019c6ecf8" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:07:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-bdbaed03-1a45-478c-8f01-cf890588d073 tempest-ProjectReaderTests-215039770 None] Deleting offline snapshot 5b21c7b5-ebd0-495a-98a1-2fb019c6ecf8 of volume baa62038-ead1-4728-836c-45de945c95c3 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:07:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-bdbaed03-1a45-478c-8f01-cf890588d073 tempest-ProjectReaderTests-215039770 None] snapshot_file for this snap is: volume-baa62038-ead1-4728-836c-45de945c95c3.5b21c7b5-ebd0-495a-98a1-2fb019c6ecf8 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:07:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-74e2b8d5-bd9e-46f1-a675-e91bcd9328f9 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8416166c-815c-4f1e-b0a5-248ac0412735 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:48 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe462a0-2f24-4d79-afc5-3baf2e5abc83]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:07:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bdbaed03-1a45-478c-8f01-cf890588d073 tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-baa62038-ead1-4728-836c-45de945c95c3.5b21c7b5-ebd0-495a-98a1-2fb019c6ecf8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:48 devstack sudo[108466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8416166c-815c-4f1e-b0a5-248ac0412735 Sep 28 12:07:48 devstack sudo[108466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:48 devstack sudo[108467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-baa62038-ead1-4728-836c-45de945c95c3.5b21c7b5-ebd0-495a-98a1-2fb019c6ecf8 Sep 28 12:07:48 devstack sudo[108467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:48 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f3db495-de63-42a0-8636-3bc076d3ad54 tempest-ProjectReaderTests-2142964066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:07:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0f3db495-de63-42a0-8636-3bc076d3ad54 tempest-ProjectReaderTests-2142964066 None] Flow 'volume_create_manager' (826be3e7-5895-45ae-8899-efd06dff7371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:07:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0f3db495-de63-42a0-8636-3bc076d3ad54 tempest-ProjectReaderTests-2142964066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da7de830-a249-4ae0-9cb0-5ff83b46fb61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0f3db495-de63-42a0-8636-3bc076d3ad54 tempest-ProjectReaderTests-2142964066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da7de830-a249-4ae0-9cb0-5ff83b46fb61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-465741019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adb43896-7470-46bc-984c-4b1ba0261c01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='863150ed474142089a12a5bb71fbf6ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:07:48Z,use_quota=True,user_id='6e9cefa9e8394d4d9745c2cbc591a90c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0f3db495-de63-42a0-8636-3bc076d3ad54 tempest-ProjectReaderTests-2142964066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea9edeae-8357-4c3b-8ec0-78669dbb79de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0f3db495-de63-42a0-8636-3bc076d3ad54 tempest-ProjectReaderTests-2142964066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea9edeae-8357-4c3b-8ec0-78669dbb79de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0f3db495-de63-42a0-8636-3bc076d3ad54 tempest-ProjectReaderTests-2142964066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4424e33a-f340-4481-8666-4b5961b7c2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0f3db495-de63-42a0-8636-3bc076d3ad54 tempest-ProjectReaderTests-2142964066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4424e33a-f340-4481-8666-4b5961b7c2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adb43896-7470-46bc-984c-4b1ba0261c01', 'volume_name': 'volume-adb43896-7470-46bc-984c-4b1ba0261c01', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0f3db495-de63-42a0-8636-3bc076d3ad54 tempest-ProjectReaderTests-2142964066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c36c57d-ad93-4cd4-9704-fb349f749c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0f3db495-de63-42a0-8636-3bc076d3ad54 tempest-ProjectReaderTests-2142964066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c36c57d-ad93-4cd4-9704-fb349f749c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0f3db495-de63-42a0-8636-3bc076d3ad54 tempest-ProjectReaderTests-2142964066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb4a5e13-fc39-49d1-ad8e-8a7c6dd55e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:48 devstack sudo[108466]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:48 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-0f3db495-de63-42a0-8636-3bc076d3ad54 tempest-ProjectReaderTests-2142964066 None] Volume adb43896-7470-46bc-984c-4b1ba0261c01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adb43896-7470-46bc-984c-4b1ba0261c01', 'volume_size': 1} Sep 28 12:07:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0f3db495-de63-42a0-8636-3bc076d3ad54 tempest-ProjectReaderTests-2142964066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:07:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-74e2b8d5-bd9e-46f1-a675-e91bcd9328f9 tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8416166c-815c-4f1e-b0a5-248ac0412735" returned: 0 in 0.280s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:48 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-74e2b8d5-bd9e-46f1-a675-e91bcd9328f9 tempest-ProjectMemberTests-1312558137 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:07:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-74e2b8d5-bd9e-46f1-a675-e91bcd9328f9 tempest-ProjectMemberTests-1312558137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:07:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0f3db495-de63-42a0-8636-3bc076d3ad54 tempest-ProjectReaderTests-2142964066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:07:48 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0f3db495-de63-42a0-8636-3bc076d3ad54 tempest-ProjectReaderTests-2142964066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-465741019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adb43896-7470-46bc-984c-4b1ba0261c01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='863150ed474142089a12a5bb71fbf6ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:07:48Z,use_quota=True,user_id='6e9cefa9e8394d4d9745c2cbc591a90c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:07:48 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-0f3db495-de63-42a0-8636-3bc076d3ad54 tempest-ProjectReaderTests-2142964066 None] Creating volume adb43896-7470-46bc-984c-4b1ba0261c01 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:07:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0f3db495-de63-42a0-8636-3bc076d3ad54 tempest-ProjectReaderTests-2142964066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:07:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0f3db495-de63-42a0-8636-3bc076d3ad54 tempest-ProjectReaderTests-2142964066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:07:48 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0f3db495-de63-42a0-8636-3bc076d3ad54 tempest-ProjectReaderTests-2142964066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:07:48 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0f3db495-de63-42a0-8636-3bc076d3ad54 tempest-ProjectReaderTests-2142964066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:07:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0f3db495-de63-42a0-8636-3bc076d3ad54 tempest-ProjectReaderTests-2142964066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:07:48 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0f3db495-de63-42a0-8636-3bc076d3ad54 tempest-ProjectReaderTests-2142964066 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:07:48 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-0f3db495-de63-42a0-8636-3bc076d3ad54 tempest-ProjectReaderTests-2142964066 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:07:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0f3db495-de63-42a0-8636-3bc076d3ad54 tempest-ProjectReaderTests-2142964066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-adb43896-7470-46bc-984c-4b1ba0261c01 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-74e2b8d5-bd9e-46f1-a675-e91bcd9328f9 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3ec39d8-fcf3-4a0d-901b-d660aa56f11f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8416166c-815c-4f1e-b0a5-248ac0412735', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-74e2b8d5-bd9e-46f1-a675-e91bcd9328f9 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d0f3c30-8ea4-4f79-90e1-4f650777a24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:48 devstack sudo[108471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-adb43896-7470-46bc-984c-4b1ba0261c01 1073741824 Sep 28 12:07:48 devstack sudo[108471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:48 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-74e2b8d5-bd9e-46f1-a675-e91bcd9328f9 tempest-ProjectMemberTests-1312558137 None] Volume volume-8416166c-815c-4f1e-b0a5-248ac0412735 (8416166c-815c-4f1e-b0a5-248ac0412735): created successfully Sep 28 12:07:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-74e2b8d5-bd9e-46f1-a675-e91bcd9328f9 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d0f3c30-8ea4-4f79-90e1-4f650777a24e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-74e2b8d5-bd9e-46f1-a675-e91bcd9328f9 tempest-ProjectMemberTests-1312558137 None] Flow 'volume_create_manager' (303c89c8-5341-4384-a761-02f61b1064a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:07:48 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-74e2b8d5-bd9e-46f1-a675-e91bcd9328f9 tempest-ProjectMemberTests-1312558137 None] Created volume successfully. Sep 28 12:07:48 devstack sudo[108467]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bdbaed03-1a45-478c-8f01-cf890588d073 tempest-ProjectReaderTests-215039770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-baa62038-ead1-4728-836c-45de945c95c3.5b21c7b5-ebd0-495a-98a1-2fb019c6ecf8" returned: 0 in 0.420s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:48 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-bdbaed03-1a45-478c-8f01-cf890588d073 tempest-ProjectReaderTests-215039770 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-baa62038-ead1-4728-836c-45de945c95c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:07:48 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[51427c40-fbf3-47d8-89ac-80f52ab3d355]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:07:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bdbaed03-1a45-478c-8f01-cf890588d073 tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-baa62038-ead1-4728-836c-45de945c95c3 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:48 devstack sudo[108476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-baa62038-ead1-4728-836c-45de945c95c3 Sep 28 12:07:48 devstack sudo[108476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:48 devstack sudo[108471]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0f3db495-de63-42a0-8636-3bc076d3ad54 tempest-ProjectReaderTests-2142964066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-adb43896-7470-46bc-984c-4b1ba0261c01 1073741824" returned: 0 in 0.476s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0f3db495-de63-42a0-8636-3bc076d3ad54 tempest-ProjectReaderTests-2142964066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-adb43896-7470-46bc-984c-4b1ba0261c01 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:48 devstack sudo[108483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-adb43896-7470-46bc-984c-4b1ba0261c01 Sep 28 12:07:48 devstack sudo[108483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:48 devstack sudo[108476]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bdbaed03-1a45-478c-8f01-cf890588d073 tempest-ProjectReaderTests-215039770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-baa62038-ead1-4728-836c-45de945c95c3" returned: 0 in 0.412s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bdbaed03-1a45-478c-8f01-cf890588d073 tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-baa62038-ead1-4728-836c-45de945c95c3.5b21c7b5-ebd0-495a-98a1-2fb019c6ecf8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:48 devstack sudo[108487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-baa62038-ead1-4728-836c-45de945c95c3.5b21c7b5-ebd0-495a-98a1-2fb019c6ecf8 Sep 28 12:07:48 devstack sudo[108487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:49 devstack sudo[108483]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0f3db495-de63-42a0-8636-3bc076d3ad54 tempest-ProjectReaderTests-2142964066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-adb43896-7470-46bc-984c-4b1ba0261c01" returned: 0 in 0.269s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0f3db495-de63-42a0-8636-3bc076d3ad54 tempest-ProjectReaderTests-2142964066 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:07:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0f3db495-de63-42a0-8636-3bc076d3ad54 tempest-ProjectReaderTests-2142964066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:07:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0f3db495-de63-42a0-8636-3bc076d3ad54 tempest-ProjectReaderTests-2142964066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb4a5e13-fc39-49d1-ad8e-8a7c6dd55e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adb43896-7470-46bc-984c-4b1ba0261c01', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0f3db495-de63-42a0-8636-3bc076d3ad54 tempest-ProjectReaderTests-2142964066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b8fea94-ed55-42e0-b0e8-3b1ecbba64a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:49 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-0f3db495-de63-42a0-8636-3bc076d3ad54 tempest-ProjectReaderTests-2142964066 None] Volume volume-adb43896-7470-46bc-984c-4b1ba0261c01 (adb43896-7470-46bc-984c-4b1ba0261c01): created successfully Sep 28 12:07:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0f3db495-de63-42a0-8636-3bc076d3ad54 tempest-ProjectReaderTests-2142964066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b8fea94-ed55-42e0-b0e8-3b1ecbba64a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0f3db495-de63-42a0-8636-3bc076d3ad54 tempest-ProjectReaderTests-2142964066 None] Flow 'volume_create_manager' (826be3e7-5895-45ae-8899-efd06dff7371) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:07:49 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-0f3db495-de63-42a0-8636-3bc076d3ad54 tempest-ProjectReaderTests-2142964066 None] Created volume successfully. Sep 28 12:07:49 devstack sudo[108487]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bdbaed03-1a45-478c-8f01-cf890588d073 tempest-ProjectReaderTests-215039770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-baa62038-ead1-4728-836c-45de945c95c3.5b21c7b5-ebd0-495a-98a1-2fb019c6ecf8" returned: 0 in 0.371s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bdbaed03-1a45-478c-8f01-cf890588d073 tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-baa62038-ead1-4728-836c-45de945c95c3.5b21c7b5-ebd0-495a-98a1-2fb019c6ecf8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:49 devstack sudo[108494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-baa62038-ead1-4728-836c-45de945c95c3.5b21c7b5-ebd0-495a-98a1-2fb019c6ecf8 Sep 28 12:07:49 devstack sudo[108494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:49 devstack sudo[108494]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bdbaed03-1a45-478c-8f01-cf890588d073 tempest-ProjectReaderTests-215039770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-baa62038-ead1-4728-836c-45de945c95c3.5b21c7b5-ebd0-495a-98a1-2fb019c6ecf8" returned: 0 in 0.245s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:49 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bdbaed03-1a45-478c-8f01-cf890588d073 tempest-ProjectReaderTests-215039770 None] Lock "cinder-quobyte-5b21c7b5-ebd0-495a-98a1-2fb019c6ecf8" released by "_delete_snapshot" :: held 1.563s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:07:49 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bdbaed03-1a45-478c-8f01-cf890588d073 tempest-ProjectReaderTests-215039770 None] Lock "cinder-quobyte-baa62038-ead1-4728-836c-45de945c95c3" released by "delete_snapshot" :: held 1.599s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:07:49 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-bdbaed03-1a45-478c-8f01-cf890588d073 tempest-ProjectReaderTests-215039770 None] Created reservations ['2c969c76-453e-4b05-b614-aec26577ac34', '6d39cc03-8126-482d-b908-d52921c67017', 'bdbcca66-19a7-470a-b45d-6c2e13d3d2f9', 'a6efb112-cbc5-4a1e-951e-3bf3137c9c1a'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:07:49 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-bdbaed03-1a45-478c-8f01-cf890588d073 tempest-ProjectReaderTests-215039770 None] Delete snapshot completed successfully. Sep 28 12:07:49 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bdbaed03-1a45-478c-8f01-cf890588d073 tempest-ProjectReaderTests-215039770 None] Lock "cinder-5b21c7b5-ebd0-495a-98a1-2fb019c6ecf8-delete_snapshot" released by "delete_snapshot" :: held 1.787s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:07:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ce7761d1-ac29-484b-82a7-788c68ea3ddc tempest-ProjectMemberTests-1312558137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:07:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ce7761d1-ac29-484b-82a7-788c68ea3ddc tempest-ProjectMemberTests-1312558137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:07:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-ce7761d1-ac29-484b-82a7-788c68ea3ddc tempest-ProjectMemberTests-1312558137 None] Creating offline snapshot 3dd252f2-b39a-42aa-9350-573a434b2b89 of volume 8416166c-815c-4f1e-b0a5-248ac0412735 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:07:49 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3f21c5-30d5-437f-8c87-abb0673cf23c]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:07:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ce7761d1-ac29-484b-82a7-788c68ea3ddc tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8416166c-815c-4f1e-b0a5-248ac0412735 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:49 devstack sudo[108497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8416166c-815c-4f1e-b0a5-248ac0412735 Sep 28 12:07:49 devstack sudo[108497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-12ffec3a-8fb4-4bf9-9557-52b09635a212 tempest-ProjectReaderTests-215039770 None] Acquiring lock "cinder-baa62038-ead1-4728-836c-45de945c95c3-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:07:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-12ffec3a-8fb4-4bf9-9557-52b09635a212 tempest-ProjectReaderTests-215039770 None] Lock "cinder-baa62038-ead1-4728-836c-45de945c95c3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:07:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-12ffec3a-8fb4-4bf9-9557-52b09635a212 tempest-ProjectReaderTests-215039770 None] Acquiring lock "cinder-quobyte-baa62038-ead1-4728-836c-45de945c95c3" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:07:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-12ffec3a-8fb4-4bf9-9557-52b09635a212 tempest-ProjectReaderTests-215039770 None] Lock "cinder-quobyte-baa62038-ead1-4728-836c-45de945c95c3" acquired by "delete_volume" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:07:50 devstack sudo[108497]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ce7761d1-ac29-484b-82a7-788c68ea3ddc tempest-ProjectMemberTests-1312558137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8416166c-815c-4f1e-b0a5-248ac0412735" returned: 0 in 0.454s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ce7761d1-ac29-484b-82a7-788c68ea3ddc tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8416166c-815c-4f1e-b0a5-248ac0412735,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8416166c-815c-4f1e-b0a5-248ac0412735.3dd252f2-b39a-42aa-9350-573a434b2b89 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:50 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[3128ebde-9a7a-4716-bfa6-08548e382b36]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:07:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-12ffec3a-8fb4-4bf9-9557-52b09635a212 tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-baa62038-ead1-4728-836c-45de945c95c3 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:50 devstack sudo[108502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8416166c-815c-4f1e-b0a5-248ac0412735,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8416166c-815c-4f1e-b0a5-248ac0412735.3dd252f2-b39a-42aa-9350-573a434b2b89 1G Sep 28 12:07:50 devstack sudo[108502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-74775d32-2f5f-4798-bdb8-c4b7eb6da80f tempest-ProjectReaderTests-2142964066 None] Acquiring lock "cinder-adb43896-7470-46bc-984c-4b1ba0261c01-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:07:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-74775d32-2f5f-4798-bdb8-c4b7eb6da80f tempest-ProjectReaderTests-2142964066 None] Lock "cinder-adb43896-7470-46bc-984c-4b1ba0261c01-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:07:50 devstack sudo[108503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-baa62038-ead1-4728-836c-45de945c95c3 Sep 28 12:07:50 devstack sudo[108503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-74775d32-2f5f-4798-bdb8-c4b7eb6da80f tempest-ProjectReaderTests-2142964066 None] Acquiring lock "cinder-quobyte-adb43896-7470-46bc-984c-4b1ba0261c01" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:07:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-74775d32-2f5f-4798-bdb8-c4b7eb6da80f tempest-ProjectReaderTests-2142964066 None] Lock "cinder-quobyte-adb43896-7470-46bc-984c-4b1ba0261c01" acquired by "delete_volume" :: waited 0.027s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:07:50 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4968583-4299-4687-b4d4-74c2cbb12174]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:07:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-74775d32-2f5f-4798-bdb8-c4b7eb6da80f tempest-ProjectReaderTests-2142964066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-adb43896-7470-46bc-984c-4b1ba0261c01 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:50 devstack sudo[108503]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-12ffec3a-8fb4-4bf9-9557-52b09635a212 tempest-ProjectReaderTests-215039770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-baa62038-ead1-4728-836c-45de945c95c3" returned: 0 in 0.424s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-12ffec3a-8fb4-4bf9-9557-52b09635a212 tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-baa62038-ead1-4728-836c-45de945c95c3 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:50 devstack sudo[108510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-adb43896-7470-46bc-984c-4b1ba0261c01 Sep 28 12:07:50 devstack sudo[108510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:50 devstack sudo[108518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-baa62038-ead1-4728-836c-45de945c95c3 Sep 28 12:07:50 devstack sudo[108518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:50 devstack sudo[108502]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ce7761d1-ac29-484b-82a7-788c68ea3ddc tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8416166c-815c-4f1e-b0a5-248ac0412735,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8416166c-815c-4f1e-b0a5-248ac0412735.3dd252f2-b39a-42aa-9350-573a434b2b89 1G" returned: 0 in 0.508s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ce7761d1-ac29-484b-82a7-788c68ea3ddc tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8416166c-815c-4f1e-b0a5-248ac0412735 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8416166c-815c-4f1e-b0a5-248ac0412735.3dd252f2-b39a-42aa-9350-573a434b2b89 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:50 devstack sudo[108520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8416166c-815c-4f1e-b0a5-248ac0412735 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8416166c-815c-4f1e-b0a5-248ac0412735.3dd252f2-b39a-42aa-9350-573a434b2b89 Sep 28 12:07:50 devstack sudo[108520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:50 devstack sudo[108510]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-74775d32-2f5f-4798-bdb8-c4b7eb6da80f tempest-ProjectReaderTests-2142964066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-adb43896-7470-46bc-984c-4b1ba0261c01" returned: 0 in 0.416s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-74775d32-2f5f-4798-bdb8-c4b7eb6da80f tempest-ProjectReaderTests-2142964066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-adb43896-7470-46bc-984c-4b1ba0261c01 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:50 devstack sudo[108518]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-12ffec3a-8fb4-4bf9-9557-52b09635a212 tempest-ProjectReaderTests-215039770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-baa62038-ead1-4728-836c-45de945c95c3" returned: 0 in 0.311s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:50 devstack sudo[108526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-adb43896-7470-46bc-984c-4b1ba0261c01 Sep 28 12:07:51 devstack sudo[108526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-12ffec3a-8fb4-4bf9-9557-52b09635a212 tempest-ProjectReaderTests-215039770 None] Lock "cinder-quobyte-baa62038-ead1-4728-836c-45de945c95c3" released by "delete_volume" :: held 0.841s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:07:51 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-12ffec3a-8fb4-4bf9-9557-52b09635a212 tempest-ProjectReaderTests-215039770 None] Created reservations ['0ed9de0d-94b1-4aa3-beeb-928f7e0055f2', '8ad84c79-362f-4ae2-9e07-4564dd4ae61f', 'a1161d90-3ec5-4b53-83c6-12fc75b66692', '7ae8e54c-49be-4d4a-af5b-3fb30c6a6437'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:07:51 devstack sudo[108520]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ce7761d1-ac29-484b-82a7-788c68ea3ddc tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8416166c-815c-4f1e-b0a5-248ac0412735 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8416166c-815c-4f1e-b0a5-248ac0412735.3dd252f2-b39a-42aa-9350-573a434b2b89" returned: 0 in 0.378s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:51 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-ce7761d1-ac29-484b-82a7-788c68ea3ddc tempest-ProjectMemberTests-1312558137 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8416166c-815c-4f1e-b0a5-248ac0412735.3dd252f2-b39a-42aa-9350-573a434b2b89 is being set with open permissions: ugo+rw Sep 28 12:07:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ce7761d1-ac29-484b-82a7-788c68ea3ddc tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8416166c-815c-4f1e-b0a5-248ac0412735.3dd252f2-b39a-42aa-9350-573a434b2b89 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:51 devstack sudo[108531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8416166c-815c-4f1e-b0a5-248ac0412735.3dd252f2-b39a-42aa-9350-573a434b2b89 Sep 28 12:07:51 devstack sudo[108531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-12ffec3a-8fb4-4bf9-9557-52b09635a212 tempest-ProjectReaderTests-215039770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:07:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-12ffec3a-8fb4-4bf9-9557-52b09635a212 tempest-ProjectReaderTests-215039770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:07:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-12ffec3a-8fb4-4bf9-9557-52b09635a212 tempest-ProjectReaderTests-215039770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:07:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-12ffec3a-8fb4-4bf9-9557-52b09635a212 tempest-ProjectReaderTests-215039770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:07:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-12ffec3a-8fb4-4bf9-9557-52b09635a212 tempest-ProjectReaderTests-215039770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:07:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-12ffec3a-8fb4-4bf9-9557-52b09635a212 tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:51 devstack sudo[108534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:07:51 devstack sudo[108534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:51 devstack sudo[108526]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-74775d32-2f5f-4798-bdb8-c4b7eb6da80f tempest-ProjectReaderTests-2142964066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-adb43896-7470-46bc-984c-4b1ba0261c01" returned: 0 in 0.350s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-74775d32-2f5f-4798-bdb8-c4b7eb6da80f tempest-ProjectReaderTests-2142964066 None] Lock "cinder-quobyte-adb43896-7470-46bc-984c-4b1ba0261c01" released by "delete_volume" :: held 0.824s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:07:51 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-74775d32-2f5f-4798-bdb8-c4b7eb6da80f tempest-ProjectReaderTests-2142964066 None] Created reservations ['0a70db70-f1dc-49cc-9879-3e50a2b3191a', '47f456ff-d8cb-41f0-a849-f7e9d0754b80', 'a0bbe671-398f-49eb-83a1-80e3f60adcd5', '92c888d6-78fc-49f7-9569-0bef7e837fad'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:07:51 devstack sudo[108531]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ce7761d1-ac29-484b-82a7-788c68ea3ddc tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8416166c-815c-4f1e-b0a5-248ac0412735.3dd252f2-b39a-42aa-9350-573a434b2b89" returned: 0 in 0.331s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ce7761d1-ac29-484b-82a7-788c68ea3ddc tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8416166c-815c-4f1e-b0a5-248ac0412735.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:51 devstack sudo[108537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8416166c-815c-4f1e-b0a5-248ac0412735.info Sep 28 12:07:51 devstack sudo[108537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-74775d32-2f5f-4798-bdb8-c4b7eb6da80f tempest-ProjectReaderTests-2142964066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:07:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-74775d32-2f5f-4798-bdb8-c4b7eb6da80f tempest-ProjectReaderTests-2142964066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:07:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-74775d32-2f5f-4798-bdb8-c4b7eb6da80f tempest-ProjectReaderTests-2142964066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:07:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-74775d32-2f5f-4798-bdb8-c4b7eb6da80f tempest-ProjectReaderTests-2142964066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:07:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-74775d32-2f5f-4798-bdb8-c4b7eb6da80f tempest-ProjectReaderTests-2142964066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:07:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-74775d32-2f5f-4798-bdb8-c4b7eb6da80f tempest-ProjectReaderTests-2142964066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:51 devstack sudo[108534]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-12ffec3a-8fb4-4bf9-9557-52b09635a212 tempest-ProjectReaderTests-215039770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.297s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:51 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-12ffec3a-8fb4-4bf9-9557-52b09635a212 tempest-ProjectReaderTests-215039770 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:07:51 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-12ffec3a-8fb4-4bf9-9557-52b09635a212 tempest-ProjectReaderTests-215039770 None] Deleted volume successfully. Sep 28 12:07:51 devstack sudo[108540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:07:51 devstack sudo[108540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-12ffec3a-8fb4-4bf9-9557-52b09635a212 tempest-ProjectReaderTests-215039770 None] Lock "cinder-baa62038-ead1-4728-836c-45de945c95c3-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:07:51 devstack sudo[108540]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-74775d32-2f5f-4798-bdb8-c4b7eb6da80f tempest-ProjectReaderTests-2142964066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.257s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:51 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-74775d32-2f5f-4798-bdb8-c4b7eb6da80f tempest-ProjectReaderTests-2142964066 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:07:51 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-74775d32-2f5f-4798-bdb8-c4b7eb6da80f tempest-ProjectReaderTests-2142964066 None] Deleted volume successfully. Sep 28 12:07:51 devstack sudo[108537]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ce7761d1-ac29-484b-82a7-788c68ea3ddc tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8416166c-815c-4f1e-b0a5-248ac0412735.info" returned: 0 in 0.330s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:51 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-ce7761d1-ac29-484b-82a7-788c68ea3ddc tempest-ProjectMemberTests-1312558137 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8416166c-815c-4f1e-b0a5-248ac0412735.info is being set with open permissions: ugo+rw Sep 28 12:07:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ce7761d1-ac29-484b-82a7-788c68ea3ddc tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8416166c-815c-4f1e-b0a5-248ac0412735.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:51 devstack sudo[108544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8416166c-815c-4f1e-b0a5-248ac0412735.info Sep 28 12:07:51 devstack sudo[108544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-74775d32-2f5f-4798-bdb8-c4b7eb6da80f tempest-ProjectReaderTests-2142964066 None] Lock "cinder-adb43896-7470-46bc-984c-4b1ba0261c01-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:07:52 devstack sudo[108544]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ce7761d1-ac29-484b-82a7-788c68ea3ddc tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8416166c-815c-4f1e-b0a5-248ac0412735.info" returned: 0 in 0.253s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ce7761d1-ac29-484b-82a7-788c68ea3ddc tempest-ProjectMemberTests-1312558137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.351s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:07:52 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-ce7761d1-ac29-484b-82a7-788c68ea3ddc tempest-ProjectMemberTests-1312558137 None] Create snapshot completed successfully Sep 28 12:07:52 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-6671b247-cd24-4d3b-bd99-46944d7a5b60 tempest-ProjectReaderTests-215039770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:07:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6671b247-cd24-4d3b-bd99-46944d7a5b60 tempest-ProjectReaderTests-215039770 None] Flow 'volume_create_manager' (d0277045-7f3c-428f-9ac5-c423e2f9fdb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:07:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6671b247-cd24-4d3b-bd99-46944d7a5b60 tempest-ProjectReaderTests-215039770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dc84d6a-ff15-4dad-9197-1e084a7d6a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6671b247-cd24-4d3b-bd99-46944d7a5b60 tempest-ProjectReaderTests-215039770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dc84d6a-ff15-4dad-9197-1e084a7d6a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-865154115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4b4af66-3dca-4853-a5cb-f807ed14c443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0967a03b26444a099e6a835bf5318cd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:07:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:07:53Z,use_quota=True,user_id='15e36ceca64444e0a9bfeb42495fbb44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6671b247-cd24-4d3b-bd99-46944d7a5b60 tempest-ProjectReaderTests-215039770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e51627d-d8c8-40c4-998d-4d927f54eef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6671b247-cd24-4d3b-bd99-46944d7a5b60 tempest-ProjectReaderTests-215039770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e51627d-d8c8-40c4-998d-4d927f54eef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6671b247-cd24-4d3b-bd99-46944d7a5b60 tempest-ProjectReaderTests-215039770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c86624c-bc1f-494f-a3a7-26901a2bf8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6671b247-cd24-4d3b-bd99-46944d7a5b60 tempest-ProjectReaderTests-215039770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c86624c-bc1f-494f-a3a7-26901a2bf8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4b4af66-3dca-4853-a5cb-f807ed14c443', 'volume_name': 'volume-d4b4af66-3dca-4853-a5cb-f807ed14c443', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6671b247-cd24-4d3b-bd99-46944d7a5b60 tempest-ProjectReaderTests-215039770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bba612d1-d1ab-44e6-b13b-b62a4650508c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6671b247-cd24-4d3b-bd99-46944d7a5b60 tempest-ProjectReaderTests-215039770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bba612d1-d1ab-44e6-b13b-b62a4650508c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6671b247-cd24-4d3b-bd99-46944d7a5b60 tempest-ProjectReaderTests-215039770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f80bd24-c3f7-4f66-bb93-91a0ebc02742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:52 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-6671b247-cd24-4d3b-bd99-46944d7a5b60 tempest-ProjectReaderTests-215039770 None] Volume d4b4af66-3dca-4853-a5cb-f807ed14c443: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4b4af66-3dca-4853-a5cb-f807ed14c443', 'volume_size': 1} Sep 28 12:07:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6671b247-cd24-4d3b-bd99-46944d7a5b60 tempest-ProjectReaderTests-215039770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:07:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6671b247-cd24-4d3b-bd99-46944d7a5b60 tempest-ProjectReaderTests-215039770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:07:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6671b247-cd24-4d3b-bd99-46944d7a5b60 tempest-ProjectReaderTests-215039770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-865154115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4b4af66-3dca-4853-a5cb-f807ed14c443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0967a03b26444a099e6a835bf5318cd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:07:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:07:53Z,use_quota=True,user_id='15e36ceca64444e0a9bfeb42495fbb44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:07:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-6671b247-cd24-4d3b-bd99-46944d7a5b60 tempest-ProjectReaderTests-215039770 None] Creating volume d4b4af66-3dca-4853-a5cb-f807ed14c443 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:07:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6671b247-cd24-4d3b-bd99-46944d7a5b60 tempest-ProjectReaderTests-215039770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:07:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6671b247-cd24-4d3b-bd99-46944d7a5b60 tempest-ProjectReaderTests-215039770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:07:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6671b247-cd24-4d3b-bd99-46944d7a5b60 tempest-ProjectReaderTests-215039770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:07:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6671b247-cd24-4d3b-bd99-46944d7a5b60 tempest-ProjectReaderTests-215039770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:07:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6671b247-cd24-4d3b-bd99-46944d7a5b60 tempest-ProjectReaderTests-215039770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:07:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6671b247-cd24-4d3b-bd99-46944d7a5b60 tempest-ProjectReaderTests-215039770 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:07:52 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-6671b247-cd24-4d3b-bd99-46944d7a5b60 tempest-ProjectReaderTests-215039770 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:07:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6671b247-cd24-4d3b-bd99-46944d7a5b60 tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d4b4af66-3dca-4853-a5cb-f807ed14c443 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:52 devstack sudo[108547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d4b4af66-3dca-4853-a5cb-f807ed14c443 1073741824 Sep 28 12:07:52 devstack sudo[108547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:52 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5e6c2232-70ec-4b0d-ac60-b13724a5bbef tempest-ProjectMemberTests-1312558137 None] Acquiring lock "cinder-3dd252f2-b39a-42aa-9350-573a434b2b89-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:07:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5e6c2232-70ec-4b0d-ac60-b13724a5bbef tempest-ProjectMemberTests-1312558137 None] Lock "cinder-3dd252f2-b39a-42aa-9350-573a434b2b89-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:07:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5e6c2232-70ec-4b0d-ac60-b13724a5bbef tempest-ProjectMemberTests-1312558137 None] Acquiring lock "cinder-quobyte-8416166c-815c-4f1e-b0a5-248ac0412735" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:07:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5e6c2232-70ec-4b0d-ac60-b13724a5bbef tempest-ProjectMemberTests-1312558137 None] Lock "cinder-quobyte-8416166c-815c-4f1e-b0a5-248ac0412735" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:07:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5e6c2232-70ec-4b0d-ac60-b13724a5bbef tempest-ProjectMemberTests-1312558137 None] Acquiring lock "cinder-quobyte-3dd252f2-b39a-42aa-9350-573a434b2b89" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:07:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5e6c2232-70ec-4b0d-ac60-b13724a5bbef tempest-ProjectMemberTests-1312558137 None] Lock "cinder-quobyte-3dd252f2-b39a-42aa-9350-573a434b2b89" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:07:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-5e6c2232-70ec-4b0d-ac60-b13724a5bbef tempest-ProjectMemberTests-1312558137 None] Deleting offline snapshot 3dd252f2-b39a-42aa-9350-573a434b2b89 of volume 8416166c-815c-4f1e-b0a5-248ac0412735 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:07:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-5e6c2232-70ec-4b0d-ac60-b13724a5bbef tempest-ProjectMemberTests-1312558137 None] snapshot_file for this snap is: volume-8416166c-815c-4f1e-b0a5-248ac0412735.3dd252f2-b39a-42aa-9350-573a434b2b89 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:07:53 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[0878f6c5-50d6-466d-9fe3-c63a42044005]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:07:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5e6c2232-70ec-4b0d-ac60-b13724a5bbef tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8416166c-815c-4f1e-b0a5-248ac0412735.3dd252f2-b39a-42aa-9350-573a434b2b89 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:53 devstack sudo[108549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8416166c-815c-4f1e-b0a5-248ac0412735.3dd252f2-b39a-42aa-9350-573a434b2b89 Sep 28 12:07:53 devstack sudo[108549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:53 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6dca83a-39f6-492c-80a6-c3424def31e4 tempest-ProjectReaderTests-2142964066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:07:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e6dca83a-39f6-492c-80a6-c3424def31e4 tempest-ProjectReaderTests-2142964066 None] Flow 'volume_create_manager' (4460ecf2-8f29-4195-8dbf-b1aae26e8f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:07:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e6dca83a-39f6-492c-80a6-c3424def31e4 tempest-ProjectReaderTests-2142964066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80141781-66f2-4f18-ad85-8ad6d5743ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e6dca83a-39f6-492c-80a6-c3424def31e4 tempest-ProjectReaderTests-2142964066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80141781-66f2-4f18-ad85-8ad6d5743ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:07:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-907911257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf8149bc-ad99-4a30-8218-953716d75a46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='863150ed474142089a12a5bb71fbf6ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:07:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:07:53Z,use_quota=True,user_id='6e9cefa9e8394d4d9745c2cbc591a90c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e6dca83a-39f6-492c-80a6-c3424def31e4 tempest-ProjectReaderTests-2142964066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fe3f401-e80d-4eca-ad47-e85bf6bab7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e6dca83a-39f6-492c-80a6-c3424def31e4 tempest-ProjectReaderTests-2142964066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fe3f401-e80d-4eca-ad47-e85bf6bab7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e6dca83a-39f6-492c-80a6-c3424def31e4 tempest-ProjectReaderTests-2142964066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4d44392-9330-435d-888f-8c4539184200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e6dca83a-39f6-492c-80a6-c3424def31e4 tempest-ProjectReaderTests-2142964066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4d44392-9330-435d-888f-8c4539184200) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf8149bc-ad99-4a30-8218-953716d75a46', 'volume_name': 'volume-bf8149bc-ad99-4a30-8218-953716d75a46', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e6dca83a-39f6-492c-80a6-c3424def31e4 tempest-ProjectReaderTests-2142964066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee077a8f-ced6-4c3b-851b-9e1b69092295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e6dca83a-39f6-492c-80a6-c3424def31e4 tempest-ProjectReaderTests-2142964066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee077a8f-ced6-4c3b-851b-9e1b69092295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e6dca83a-39f6-492c-80a6-c3424def31e4 tempest-ProjectReaderTests-2142964066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b66c0ebc-f245-454d-904f-ac8b31c36dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:53 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-e6dca83a-39f6-492c-80a6-c3424def31e4 tempest-ProjectReaderTests-2142964066 None] Volume bf8149bc-ad99-4a30-8218-953716d75a46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf8149bc-ad99-4a30-8218-953716d75a46', 'volume_size': 1} Sep 28 12:07:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e6dca83a-39f6-492c-80a6-c3424def31e4 tempest-ProjectReaderTests-2142964066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:07:53 devstack sudo[108547]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6671b247-cd24-4d3b-bd99-46944d7a5b60 tempest-ProjectReaderTests-215039770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d4b4af66-3dca-4853-a5cb-f807ed14c443 1073741824" returned: 0 in 0.585s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6671b247-cd24-4d3b-bd99-46944d7a5b60 tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d4b4af66-3dca-4853-a5cb-f807ed14c443 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:53 devstack sudo[108549]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5e6c2232-70ec-4b0d-ac60-b13724a5bbef tempest-ProjectMemberTests-1312558137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8416166c-815c-4f1e-b0a5-248ac0412735.3dd252f2-b39a-42aa-9350-573a434b2b89" returned: 0 in 0.379s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-5e6c2232-70ec-4b0d-ac60-b13724a5bbef tempest-ProjectMemberTests-1312558137 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8416166c-815c-4f1e-b0a5-248ac0412735(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:07:53 devstack sudo[108559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d4b4af66-3dca-4853-a5cb-f807ed14c443 Sep 28 12:07:53 devstack sudo[108559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:53 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1aa6c5-c50c-4c32-b2d9-c351a4adb944]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:07:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5e6c2232-70ec-4b0d-ac60-b13724a5bbef tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8416166c-815c-4f1e-b0a5-248ac0412735 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:53 devstack sudo[108561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8416166c-815c-4f1e-b0a5-248ac0412735 Sep 28 12:07:53 devstack sudo[108561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:53 devstack sudo[108559]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6671b247-cd24-4d3b-bd99-46944d7a5b60 tempest-ProjectReaderTests-215039770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d4b4af66-3dca-4853-a5cb-f807ed14c443" returned: 0 in 0.285s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6671b247-cd24-4d3b-bd99-46944d7a5b60 tempest-ProjectReaderTests-215039770 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:07:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6671b247-cd24-4d3b-bd99-46944d7a5b60 tempest-ProjectReaderTests-215039770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:07:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e6dca83a-39f6-492c-80a6-c3424def31e4 tempest-ProjectReaderTests-2142964066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.408s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:07:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e6dca83a-39f6-492c-80a6-c3424def31e4 tempest-ProjectReaderTests-2142964066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:07:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-907911257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf8149bc-ad99-4a30-8218-953716d75a46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='863150ed474142089a12a5bb71fbf6ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:07:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:07:53Z,use_quota=True,user_id='6e9cefa9e8394d4d9745c2cbc591a90c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:07:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-e6dca83a-39f6-492c-80a6-c3424def31e4 tempest-ProjectReaderTests-2142964066 None] Creating volume bf8149bc-ad99-4a30-8218-953716d75a46 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:07:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e6dca83a-39f6-492c-80a6-c3424def31e4 tempest-ProjectReaderTests-2142964066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:07:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e6dca83a-39f6-492c-80a6-c3424def31e4 tempest-ProjectReaderTests-2142964066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:07:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e6dca83a-39f6-492c-80a6-c3424def31e4 tempest-ProjectReaderTests-2142964066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:07:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e6dca83a-39f6-492c-80a6-c3424def31e4 tempest-ProjectReaderTests-2142964066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:07:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e6dca83a-39f6-492c-80a6-c3424def31e4 tempest-ProjectReaderTests-2142964066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:07:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e6dca83a-39f6-492c-80a6-c3424def31e4 tempest-ProjectReaderTests-2142964066 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:07:53 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-e6dca83a-39f6-492c-80a6-c3424def31e4 tempest-ProjectReaderTests-2142964066 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:07:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e6dca83a-39f6-492c-80a6-c3424def31e4 tempest-ProjectReaderTests-2142964066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bf8149bc-ad99-4a30-8218-953716d75a46 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:53 devstack sudo[108564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bf8149bc-ad99-4a30-8218-953716d75a46 1073741824 Sep 28 12:07:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6671b247-cd24-4d3b-bd99-46944d7a5b60 tempest-ProjectReaderTests-215039770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f80bd24-c3f7-4f66-bb93-91a0ebc02742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4b4af66-3dca-4853-a5cb-f807ed14c443', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:53 devstack sudo[108564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6671b247-cd24-4d3b-bd99-46944d7a5b60 tempest-ProjectReaderTests-215039770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (984f087d-cb0c-47c3-a600-6d0a9283c8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:53 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-6671b247-cd24-4d3b-bd99-46944d7a5b60 tempest-ProjectReaderTests-215039770 None] Volume volume-d4b4af66-3dca-4853-a5cb-f807ed14c443 (d4b4af66-3dca-4853-a5cb-f807ed14c443): created successfully Sep 28 12:07:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6671b247-cd24-4d3b-bd99-46944d7a5b60 tempest-ProjectReaderTests-215039770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (984f087d-cb0c-47c3-a600-6d0a9283c8d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6671b247-cd24-4d3b-bd99-46944d7a5b60 tempest-ProjectReaderTests-215039770 None] Flow 'volume_create_manager' (d0277045-7f3c-428f-9ac5-c423e2f9fdb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:07:53 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-6671b247-cd24-4d3b-bd99-46944d7a5b60 tempest-ProjectReaderTests-215039770 None] Created volume successfully. Sep 28 12:07:54 devstack sudo[108561]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5e6c2232-70ec-4b0d-ac60-b13724a5bbef tempest-ProjectMemberTests-1312558137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8416166c-815c-4f1e-b0a5-248ac0412735" returned: 0 in 0.452s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5e6c2232-70ec-4b0d-ac60-b13724a5bbef tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8416166c-815c-4f1e-b0a5-248ac0412735.3dd252f2-b39a-42aa-9350-573a434b2b89 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:54 devstack sudo[108570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8416166c-815c-4f1e-b0a5-248ac0412735.3dd252f2-b39a-42aa-9350-573a434b2b89 Sep 28 12:07:54 devstack sudo[108570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:54 devstack sudo[108564]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e6dca83a-39f6-492c-80a6-c3424def31e4 tempest-ProjectReaderTests-2142964066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bf8149bc-ad99-4a30-8218-953716d75a46 1073741824" returned: 0 in 0.485s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e6dca83a-39f6-492c-80a6-c3424def31e4 tempest-ProjectReaderTests-2142964066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bf8149bc-ad99-4a30-8218-953716d75a46 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:54 devstack sudo[108577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bf8149bc-ad99-4a30-8218-953716d75a46 Sep 28 12:07:54 devstack sudo[108577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:54 devstack sudo[108570]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5e6c2232-70ec-4b0d-ac60-b13724a5bbef tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8416166c-815c-4f1e-b0a5-248ac0412735.3dd252f2-b39a-42aa-9350-573a434b2b89" returned: 0 in 0.404s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5e6c2232-70ec-4b0d-ac60-b13724a5bbef tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8416166c-815c-4f1e-b0a5-248ac0412735.3dd252f2-b39a-42aa-9350-573a434b2b89 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:54 devstack sudo[108579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8416166c-815c-4f1e-b0a5-248ac0412735.3dd252f2-b39a-42aa-9350-573a434b2b89 Sep 28 12:07:54 devstack sudo[108579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:54 devstack sudo[108577]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e6dca83a-39f6-492c-80a6-c3424def31e4 tempest-ProjectReaderTests-2142964066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bf8149bc-ad99-4a30-8218-953716d75a46" returned: 0 in 0.255s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e6dca83a-39f6-492c-80a6-c3424def31e4 tempest-ProjectReaderTests-2142964066 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:07:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e6dca83a-39f6-492c-80a6-c3424def31e4 tempest-ProjectReaderTests-2142964066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:07:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e6dca83a-39f6-492c-80a6-c3424def31e4 tempest-ProjectReaderTests-2142964066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b66c0ebc-f245-454d-904f-ac8b31c36dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf8149bc-ad99-4a30-8218-953716d75a46', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e6dca83a-39f6-492c-80a6-c3424def31e4 tempest-ProjectReaderTests-2142964066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db672b4e-256b-4e1e-b618-9e9fd6f73218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:54 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-e6dca83a-39f6-492c-80a6-c3424def31e4 tempest-ProjectReaderTests-2142964066 None] Volume volume-bf8149bc-ad99-4a30-8218-953716d75a46 (bf8149bc-ad99-4a30-8218-953716d75a46): created successfully Sep 28 12:07:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e6dca83a-39f6-492c-80a6-c3424def31e4 tempest-ProjectReaderTests-2142964066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db672b4e-256b-4e1e-b618-9e9fd6f73218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e6dca83a-39f6-492c-80a6-c3424def31e4 tempest-ProjectReaderTests-2142964066 None] Flow 'volume_create_manager' (4460ecf2-8f29-4195-8dbf-b1aae26e8f42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:07:54 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e6dca83a-39f6-492c-80a6-c3424def31e4 tempest-ProjectReaderTests-2142964066 None] Created volume successfully. Sep 28 12:07:54 devstack sudo[108579]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5e6c2232-70ec-4b0d-ac60-b13724a5bbef tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8416166c-815c-4f1e-b0a5-248ac0412735.3dd252f2-b39a-42aa-9350-573a434b2b89" returned: 0 in 0.280s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5e6c2232-70ec-4b0d-ac60-b13724a5bbef tempest-ProjectMemberTests-1312558137 None] Lock "cinder-quobyte-3dd252f2-b39a-42aa-9350-573a434b2b89" released by "_delete_snapshot" :: held 1.651s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:07:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5e6c2232-70ec-4b0d-ac60-b13724a5bbef tempest-ProjectMemberTests-1312558137 None] Lock "cinder-quobyte-8416166c-815c-4f1e-b0a5-248ac0412735" released by "delete_snapshot" :: held 1.684s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:07:54 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-5e6c2232-70ec-4b0d-ac60-b13724a5bbef tempest-ProjectMemberTests-1312558137 None] Created reservations ['9b75f1a6-efcd-452f-acdf-34f63a4f5d93', 'b63e3a5a-ebce-463b-9c78-ae288fd1c32d', 'c57cf5c7-dcd4-42da-a2f6-32ad22942032', 'a1af1fe5-5108-40fd-b42e-adee6865563c'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:07:54 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-5e6c2232-70ec-4b0d-ac60-b13724a5bbef tempest-ProjectMemberTests-1312558137 None] Delete snapshot completed successfully. Sep 28 12:07:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5e6c2232-70ec-4b0d-ac60-b13724a5bbef tempest-ProjectMemberTests-1312558137 None] Lock "cinder-3dd252f2-b39a-42aa-9350-573a434b2b89-delete_snapshot" released by "delete_snapshot" :: held 1.843s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:07:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c35f5f48-5f8d-413f-af7d-c426c971f727 tempest-ProjectReaderTests-215039770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:07:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c35f5f48-5f8d-413f-af7d-c426c971f727 tempest-ProjectReaderTests-215039770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:07:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-c35f5f48-5f8d-413f-af7d-c426c971f727 tempest-ProjectReaderTests-215039770 None] Creating offline snapshot 9ba8b673-287e-4bb2-9d54-c303b0162369 of volume d4b4af66-3dca-4853-a5cb-f807ed14c443 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:07:55 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fbc9219-f48f-45bc-b2c5-95fd38a2df85]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:07:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c35f5f48-5f8d-413f-af7d-c426c971f727 tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d4b4af66-3dca-4853-a5cb-f807ed14c443 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:55 devstack sudo[108583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d4b4af66-3dca-4853-a5cb-f807ed14c443 Sep 28 12:07:55 devstack sudo[108583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-feb933b0-568e-4703-afe2-309a720d195c tempest-ProjectMemberTests-1312558137 None] Acquiring lock "cinder-8416166c-815c-4f1e-b0a5-248ac0412735-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:07:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-feb933b0-568e-4703-afe2-309a720d195c tempest-ProjectMemberTests-1312558137 None] Lock "cinder-8416166c-815c-4f1e-b0a5-248ac0412735-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:07:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-feb933b0-568e-4703-afe2-309a720d195c tempest-ProjectMemberTests-1312558137 None] Acquiring lock "cinder-quobyte-8416166c-815c-4f1e-b0a5-248ac0412735" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:07:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-feb933b0-568e-4703-afe2-309a720d195c tempest-ProjectMemberTests-1312558137 None] Lock "cinder-quobyte-8416166c-815c-4f1e-b0a5-248ac0412735" acquired by "delete_volume" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:07:55 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[873bbaff-af32-4a42-998f-0b60288f6d75]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:07:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-feb933b0-568e-4703-afe2-309a720d195c tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8416166c-815c-4f1e-b0a5-248ac0412735 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-03de19dd-633b-4618-9ce9-bbe7d4d7c6cd tempest-ProjectReaderTests-2142964066 None] Acquiring lock "cinder-bf8149bc-ad99-4a30-8218-953716d75a46-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:07:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-03de19dd-633b-4618-9ce9-bbe7d4d7c6cd tempest-ProjectReaderTests-2142964066 None] Lock "cinder-bf8149bc-ad99-4a30-8218-953716d75a46-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:07:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-03de19dd-633b-4618-9ce9-bbe7d4d7c6cd tempest-ProjectReaderTests-2142964066 None] Acquiring lock "cinder-quobyte-bf8149bc-ad99-4a30-8218-953716d75a46" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:07:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-03de19dd-633b-4618-9ce9-bbe7d4d7c6cd tempest-ProjectReaderTests-2142964066 None] Lock "cinder-quobyte-bf8149bc-ad99-4a30-8218-953716d75a46" acquired by "delete_volume" :: waited 0.027s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:07:55 devstack sudo[108585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8416166c-815c-4f1e-b0a5-248ac0412735 Sep 28 12:07:55 devstack sudo[108585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:55 devstack sudo[108583]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c35f5f48-5f8d-413f-af7d-c426c971f727 tempest-ProjectReaderTests-215039770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d4b4af66-3dca-4853-a5cb-f807ed14c443" returned: 0 in 0.474s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c35f5f48-5f8d-413f-af7d-c426c971f727 tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d4b4af66-3dca-4853-a5cb-f807ed14c443,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d4b4af66-3dca-4853-a5cb-f807ed14c443.9ba8b673-287e-4bb2-9d54-c303b0162369 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:55 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32351d6-62ec-4ade-9e7e-ec8f72676f07]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:07:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-03de19dd-633b-4618-9ce9-bbe7d4d7c6cd tempest-ProjectReaderTests-2142964066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bf8149bc-ad99-4a30-8218-953716d75a46 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:55 devstack sudo[108591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d4b4af66-3dca-4853-a5cb-f807ed14c443,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d4b4af66-3dca-4853-a5cb-f807ed14c443.9ba8b673-287e-4bb2-9d54-c303b0162369 1G Sep 28 12:07:55 devstack sudo[108591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:55 devstack sudo[108592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bf8149bc-ad99-4a30-8218-953716d75a46 Sep 28 12:07:55 devstack sudo[108592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:55 devstack sudo[108585]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-feb933b0-568e-4703-afe2-309a720d195c tempest-ProjectMemberTests-1312558137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8416166c-815c-4f1e-b0a5-248ac0412735" returned: 0 in 0.418s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-feb933b0-568e-4703-afe2-309a720d195c tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8416166c-815c-4f1e-b0a5-248ac0412735 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:55 devstack sudo[108600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8416166c-815c-4f1e-b0a5-248ac0412735 Sep 28 12:07:55 devstack sudo[108600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:55 devstack sudo[108592]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-03de19dd-633b-4618-9ce9-bbe7d4d7c6cd tempest-ProjectReaderTests-2142964066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bf8149bc-ad99-4a30-8218-953716d75a46" returned: 0 in 0.416s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-03de19dd-633b-4618-9ce9-bbe7d4d7c6cd tempest-ProjectReaderTests-2142964066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bf8149bc-ad99-4a30-8218-953716d75a46 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:55 devstack sudo[108591]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c35f5f48-5f8d-413f-af7d-c426c971f727 tempest-ProjectReaderTests-215039770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d4b4af66-3dca-4853-a5cb-f807ed14c443,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d4b4af66-3dca-4853-a5cb-f807ed14c443.9ba8b673-287e-4bb2-9d54-c303b0162369 1G" returned: 0 in 0.446s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c35f5f48-5f8d-413f-af7d-c426c971f727 tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4b4af66-3dca-4853-a5cb-f807ed14c443 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d4b4af66-3dca-4853-a5cb-f807ed14c443.9ba8b673-287e-4bb2-9d54-c303b0162369 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:55 devstack sudo[108607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bf8149bc-ad99-4a30-8218-953716d75a46 Sep 28 12:07:55 devstack sudo[108607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:56 devstack sudo[108608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4b4af66-3dca-4853-a5cb-f807ed14c443 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d4b4af66-3dca-4853-a5cb-f807ed14c443.9ba8b673-287e-4bb2-9d54-c303b0162369 Sep 28 12:07:56 devstack sudo[108608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:56 devstack sudo[108600]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-feb933b0-568e-4703-afe2-309a720d195c tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-8416166c-815c-4f1e-b0a5-248ac0412735" returned: 0 in 0.309s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-feb933b0-568e-4703-afe2-309a720d195c tempest-ProjectMemberTests-1312558137 None] Lock "cinder-quobyte-8416166c-815c-4f1e-b0a5-248ac0412735" released by "delete_volume" :: held 0.819s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:07:56 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-feb933b0-568e-4703-afe2-309a720d195c tempest-ProjectMemberTests-1312558137 None] Created reservations ['fd0c3153-0758-4fb7-84f1-0bfeaec064ae', '531432ab-1ec0-43b9-8002-2d23c7bc5ef3', '072840fb-750e-4caa-81ec-d297aa17f4cc', '7c1b4165-9b87-484d-b5d0-0e6374f1052a'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:07:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-feb933b0-568e-4703-afe2-309a720d195c tempest-ProjectMemberTests-1312558137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:07:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-feb933b0-568e-4703-afe2-309a720d195c tempest-ProjectMemberTests-1312558137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:07:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-feb933b0-568e-4703-afe2-309a720d195c tempest-ProjectMemberTests-1312558137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:07:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-feb933b0-568e-4703-afe2-309a720d195c tempest-ProjectMemberTests-1312558137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:07:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-feb933b0-568e-4703-afe2-309a720d195c tempest-ProjectMemberTests-1312558137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:07:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-feb933b0-568e-4703-afe2-309a720d195c tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:56 devstack sudo[108607]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-03de19dd-633b-4618-9ce9-bbe7d4d7c6cd tempest-ProjectReaderTests-2142964066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bf8149bc-ad99-4a30-8218-953716d75a46" returned: 0 in 0.308s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:56 devstack sudo[108617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:07:56 devstack sudo[108617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-03de19dd-633b-4618-9ce9-bbe7d4d7c6cd tempest-ProjectReaderTests-2142964066 None] Lock "cinder-quobyte-bf8149bc-ad99-4a30-8218-953716d75a46" released by "delete_volume" :: held 0.785s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:07:56 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-03de19dd-633b-4618-9ce9-bbe7d4d7c6cd tempest-ProjectReaderTests-2142964066 None] Created reservations ['736d7d08-9d9b-4aed-9a82-75ecd768370a', '72de2fff-747f-43f0-b037-b88101cef34e', '37bc8959-867e-4e0f-8875-d01bc0761493', 'c25d8081-8ab0-47da-adba-288927b30c05'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:07:56 devstack sudo[108608]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c35f5f48-5f8d-413f-af7d-c426c971f727 tempest-ProjectReaderTests-215039770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4b4af66-3dca-4853-a5cb-f807ed14c443 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d4b4af66-3dca-4853-a5cb-f807ed14c443.9ba8b673-287e-4bb2-9d54-c303b0162369" returned: 0 in 0.396s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:56 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-c35f5f48-5f8d-413f-af7d-c426c971f727 tempest-ProjectReaderTests-215039770 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d4b4af66-3dca-4853-a5cb-f807ed14c443.9ba8b673-287e-4bb2-9d54-c303b0162369 is being set with open permissions: ugo+rw Sep 28 12:07:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c35f5f48-5f8d-413f-af7d-c426c971f727 tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d4b4af66-3dca-4853-a5cb-f807ed14c443.9ba8b673-287e-4bb2-9d54-c303b0162369 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:56 devstack sudo[108621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d4b4af66-3dca-4853-a5cb-f807ed14c443.9ba8b673-287e-4bb2-9d54-c303b0162369 Sep 28 12:07:56 devstack sudo[108621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-03de19dd-633b-4618-9ce9-bbe7d4d7c6cd tempest-ProjectReaderTests-2142964066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:07:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-03de19dd-633b-4618-9ce9-bbe7d4d7c6cd tempest-ProjectReaderTests-2142964066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:07:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-03de19dd-633b-4618-9ce9-bbe7d4d7c6cd tempest-ProjectReaderTests-2142964066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:07:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-03de19dd-633b-4618-9ce9-bbe7d4d7c6cd tempest-ProjectReaderTests-2142964066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:07:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-03de19dd-633b-4618-9ce9-bbe7d4d7c6cd tempest-ProjectReaderTests-2142964066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:07:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-03de19dd-633b-4618-9ce9-bbe7d4d7c6cd tempest-ProjectReaderTests-2142964066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:56 devstack sudo[108623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:07:56 devstack sudo[108623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:56 devstack sudo[108617]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-feb933b0-568e-4703-afe2-309a720d195c tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.374s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:56 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-feb933b0-568e-4703-afe2-309a720d195c tempest-ProjectMemberTests-1312558137 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:07:56 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-feb933b0-568e-4703-afe2-309a720d195c tempest-ProjectMemberTests-1312558137 None] Deleted volume successfully. Sep 28 12:07:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-feb933b0-568e-4703-afe2-309a720d195c tempest-ProjectMemberTests-1312558137 None] Lock "cinder-8416166c-815c-4f1e-b0a5-248ac0412735-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:07:56 devstack sudo[108621]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c35f5f48-5f8d-413f-af7d-c426c971f727 tempest-ProjectReaderTests-215039770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d4b4af66-3dca-4853-a5cb-f807ed14c443.9ba8b673-287e-4bb2-9d54-c303b0162369" returned: 0 in 0.344s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c35f5f48-5f8d-413f-af7d-c426c971f727 tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d4b4af66-3dca-4853-a5cb-f807ed14c443.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:56 devstack sudo[108627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d4b4af66-3dca-4853-a5cb-f807ed14c443.info Sep 28 12:07:56 devstack sudo[108627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:56 devstack sudo[108623]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-03de19dd-633b-4618-9ce9-bbe7d4d7c6cd tempest-ProjectReaderTests-2142964066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.397s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:56 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-03de19dd-633b-4618-9ce9-bbe7d4d7c6cd tempest-ProjectReaderTests-2142964066 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:07:56 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-03de19dd-633b-4618-9ce9-bbe7d4d7c6cd tempest-ProjectReaderTests-2142964066 None] Deleted volume successfully. Sep 28 12:07:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-03de19dd-633b-4618-9ce9-bbe7d4d7c6cd tempest-ProjectReaderTests-2142964066 None] Lock "cinder-bf8149bc-ad99-4a30-8218-953716d75a46-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:07:57 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fdc8e0f-fb08-42ce-91ad-116d54ffd547 tempest-ProjectMemberTests-1312558137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:07:57 devstack sudo[108627]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4fdc8e0f-fb08-42ce-91ad-116d54ffd547 tempest-ProjectMemberTests-1312558137 None] Flow 'volume_create_manager' (bb94fb0b-d999-46fb-accb-96974cfa75cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:07:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4fdc8e0f-fb08-42ce-91ad-116d54ffd547 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb546ec2-7c91-45cf-9833-726b2041fa03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c35f5f48-5f8d-413f-af7d-c426c971f727 tempest-ProjectReaderTests-215039770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d4b4af66-3dca-4853-a5cb-f807ed14c443.info" returned: 0 in 0.411s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:57 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-c35f5f48-5f8d-413f-af7d-c426c971f727 tempest-ProjectReaderTests-215039770 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d4b4af66-3dca-4853-a5cb-f807ed14c443.info is being set with open permissions: ugo+rw Sep 28 12:07:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c35f5f48-5f8d-413f-af7d-c426c971f727 tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d4b4af66-3dca-4853-a5cb-f807ed14c443.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4fdc8e0f-fb08-42ce-91ad-116d54ffd547 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb546ec2-7c91-45cf-9833-726b2041fa03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-96566818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbbda85c-e806-4d65-bdcb-fa88dbdad6b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba606417eb184510b6154fa1a28dce16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:07:57Z,use_quota=True,user_id='bb30da770afa465f8162e7779a473226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:57 devstack sudo[108631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d4b4af66-3dca-4853-a5cb-f807ed14c443.info Sep 28 12:07:57 devstack sudo[108631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4fdc8e0f-fb08-42ce-91ad-116d54ffd547 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7776351-b61d-4b79-8a6e-538d24660543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4fdc8e0f-fb08-42ce-91ad-116d54ffd547 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7776351-b61d-4b79-8a6e-538d24660543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4fdc8e0f-fb08-42ce-91ad-116d54ffd547 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ef434c3-cc2a-4d85-965e-da9e1a1d4041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4fdc8e0f-fb08-42ce-91ad-116d54ffd547 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ef434c3-cc2a-4d85-965e-da9e1a1d4041) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbbda85c-e806-4d65-bdcb-fa88dbdad6b1', 'volume_name': 'volume-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4fdc8e0f-fb08-42ce-91ad-116d54ffd547 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0afad9fd-c04b-4dfe-93a7-1f9e61811bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4fdc8e0f-fb08-42ce-91ad-116d54ffd547 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0afad9fd-c04b-4dfe-93a7-1f9e61811bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4fdc8e0f-fb08-42ce-91ad-116d54ffd547 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54b88c54-a11c-4f04-abfe-2702823779a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:57 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-4fdc8e0f-fb08-42ce-91ad-116d54ffd547 tempest-ProjectMemberTests-1312558137 None] Volume bbbda85c-e806-4d65-bdcb-fa88dbdad6b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1', 'volume_size': 1} Sep 28 12:07:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4fdc8e0f-fb08-42ce-91ad-116d54ffd547 tempest-ProjectMemberTests-1312558137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:07:57 devstack sudo[108631]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c35f5f48-5f8d-413f-af7d-c426c971f727 tempest-ProjectReaderTests-215039770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d4b4af66-3dca-4853-a5cb-f807ed14c443.info" returned: 0 in 0.260s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c35f5f48-5f8d-413f-af7d-c426c971f727 tempest-ProjectReaderTests-215039770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.425s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:07:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4fdc8e0f-fb08-42ce-91ad-116d54ffd547 tempest-ProjectMemberTests-1312558137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.218s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:07:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4fdc8e0f-fb08-42ce-91ad-116d54ffd547 tempest-ProjectMemberTests-1312558137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-96566818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbbda85c-e806-4d65-bdcb-fa88dbdad6b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba606417eb184510b6154fa1a28dce16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:07:57Z,use_quota=True,user_id='bb30da770afa465f8162e7779a473226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:07:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-4fdc8e0f-fb08-42ce-91ad-116d54ffd547 tempest-ProjectMemberTests-1312558137 None] Creating volume bbbda85c-e806-4d65-bdcb-fa88dbdad6b1 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:07:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4fdc8e0f-fb08-42ce-91ad-116d54ffd547 tempest-ProjectMemberTests-1312558137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:07:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4fdc8e0f-fb08-42ce-91ad-116d54ffd547 tempest-ProjectMemberTests-1312558137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:07:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4fdc8e0f-fb08-42ce-91ad-116d54ffd547 tempest-ProjectMemberTests-1312558137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:07:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4fdc8e0f-fb08-42ce-91ad-116d54ffd547 tempest-ProjectMemberTests-1312558137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:07:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4fdc8e0f-fb08-42ce-91ad-116d54ffd547 tempest-ProjectMemberTests-1312558137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:07:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4fdc8e0f-fb08-42ce-91ad-116d54ffd547 tempest-ProjectMemberTests-1312558137 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:07:57 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-4fdc8e0f-fb08-42ce-91ad-116d54ffd547 tempest-ProjectMemberTests-1312558137 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:07:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4fdc8e0f-fb08-42ce-91ad-116d54ffd547 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:57 devstack sudo[108634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1 1073741824 Sep 28 12:07:57 devstack sudo[108634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:57 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-c35f5f48-5f8d-413f-af7d-c426c971f727 tempest-ProjectReaderTests-215039770 None] Create snapshot completed successfully Sep 28 12:07:57 devstack sudo[108634]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4fdc8e0f-fb08-42ce-91ad-116d54ffd547 tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1 1073741824" returned: 0 in 0.521s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4fdc8e0f-fb08-42ce-91ad-116d54ffd547 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:58 devstack sudo[108640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1 Sep 28 12:07:58 devstack sudo[108640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-805ef480-dfb7-4418-a55f-6225225f7757 tempest-ProjectReaderTests-215039770 None] Acquiring lock "cinder-9ba8b673-287e-4bb2-9d54-c303b0162369-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:07:58 devstack sudo[108640]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4fdc8e0f-fb08-42ce-91ad-116d54ffd547 tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1" returned: 0 in 0.295s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4fdc8e0f-fb08-42ce-91ad-116d54ffd547 tempest-ProjectMemberTests-1312558137 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:07:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4fdc8e0f-fb08-42ce-91ad-116d54ffd547 tempest-ProjectMemberTests-1312558137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:07:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4fdc8e0f-fb08-42ce-91ad-116d54ffd547 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54b88c54-a11c-4f04-abfe-2702823779a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4fdc8e0f-fb08-42ce-91ad-116d54ffd547 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10666246-ec46-40cc-8c13-bce53e645f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:07:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-805ef480-dfb7-4418-a55f-6225225f7757 tempest-ProjectReaderTests-215039770 None] Lock "cinder-9ba8b673-287e-4bb2-9d54-c303b0162369-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:07:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-805ef480-dfb7-4418-a55f-6225225f7757 tempest-ProjectReaderTests-215039770 None] Acquiring lock "cinder-quobyte-d4b4af66-3dca-4853-a5cb-f807ed14c443" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:07:58 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-4fdc8e0f-fb08-42ce-91ad-116d54ffd547 tempest-ProjectMemberTests-1312558137 None] Volume volume-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1 (bbbda85c-e806-4d65-bdcb-fa88dbdad6b1): created successfully Sep 28 12:07:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4fdc8e0f-fb08-42ce-91ad-116d54ffd547 tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10666246-ec46-40cc-8c13-bce53e645f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:07:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4fdc8e0f-fb08-42ce-91ad-116d54ffd547 tempest-ProjectMemberTests-1312558137 None] Flow 'volume_create_manager' (bb94fb0b-d999-46fb-accb-96974cfa75cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:07:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-805ef480-dfb7-4418-a55f-6225225f7757 tempest-ProjectReaderTests-215039770 None] Lock "cinder-quobyte-d4b4af66-3dca-4853-a5cb-f807ed14c443" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:07:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-805ef480-dfb7-4418-a55f-6225225f7757 tempest-ProjectReaderTests-215039770 None] Acquiring lock "cinder-quobyte-9ba8b673-287e-4bb2-9d54-c303b0162369" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:07:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-805ef480-dfb7-4418-a55f-6225225f7757 tempest-ProjectReaderTests-215039770 None] Lock "cinder-quobyte-9ba8b673-287e-4bb2-9d54-c303b0162369" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:07:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-805ef480-dfb7-4418-a55f-6225225f7757 tempest-ProjectReaderTests-215039770 None] Deleting offline snapshot 9ba8b673-287e-4bb2-9d54-c303b0162369 of volume d4b4af66-3dca-4853-a5cb-f807ed14c443 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:07:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-805ef480-dfb7-4418-a55f-6225225f7757 tempest-ProjectReaderTests-215039770 None] snapshot_file for this snap is: volume-d4b4af66-3dca-4853-a5cb-f807ed14c443.9ba8b673-287e-4bb2-9d54-c303b0162369 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:07:58 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-4fdc8e0f-fb08-42ce-91ad-116d54ffd547 tempest-ProjectMemberTests-1312558137 None] Created volume successfully. Sep 28 12:07:58 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6c4543-fb12-418c-9903-56bc9d09f353]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:07:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-805ef480-dfb7-4418-a55f-6225225f7757 tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d4b4af66-3dca-4853-a5cb-f807ed14c443.9ba8b673-287e-4bb2-9d54-c303b0162369 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:58 devstack sudo[108643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d4b4af66-3dca-4853-a5cb-f807ed14c443.9ba8b673-287e-4bb2-9d54-c303b0162369 Sep 28 12:07:58 devstack sudo[108643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:58 devstack sudo[108643]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-805ef480-dfb7-4418-a55f-6225225f7757 tempest-ProjectReaderTests-215039770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d4b4af66-3dca-4853-a5cb-f807ed14c443.9ba8b673-287e-4bb2-9d54-c303b0162369" returned: 0 in 0.412s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-805ef480-dfb7-4418-a55f-6225225f7757 tempest-ProjectReaderTests-215039770 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4b4af66-3dca-4853-a5cb-f807ed14c443(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:07:58 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96c2d76-3aea-446f-b3a6-d414557be33a]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:07:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-805ef480-dfb7-4418-a55f-6225225f7757 tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d4b4af66-3dca-4853-a5cb-f807ed14c443 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:59 devstack sudo[108648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d4b4af66-3dca-4853-a5cb-f807ed14c443 Sep 28 12:07:59 devstack sudo[108648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:59 devstack sudo[108648]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-805ef480-dfb7-4418-a55f-6225225f7757 tempest-ProjectReaderTests-215039770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d4b4af66-3dca-4853-a5cb-f807ed14c443" returned: 0 in 0.404s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-805ef480-dfb7-4418-a55f-6225225f7757 tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d4b4af66-3dca-4853-a5cb-f807ed14c443.9ba8b673-287e-4bb2-9d54-c303b0162369 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:59 devstack sudo[108653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d4b4af66-3dca-4853-a5cb-f807ed14c443.9ba8b673-287e-4bb2-9d54-c303b0162369 Sep 28 12:07:59 devstack sudo[108653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4df7e9ae-8405-4391-8749-25a04a4dab62 tempest-ProjectMemberTests-1312558137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:07:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4df7e9ae-8405-4391-8749-25a04a4dab62 tempest-ProjectMemberTests-1312558137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:07:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-4df7e9ae-8405-4391-8749-25a04a4dab62 tempest-ProjectMemberTests-1312558137 None] Creating offline snapshot 34f56593-d5ce-4786-a1f2-34ec626474c3 of volume bbbda85c-e806-4d65-bdcb-fa88dbdad6b1 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:07:59 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[224b6b78-b107-4df9-bdc5-78a40886fa64]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:07:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4df7e9ae-8405-4391-8749-25a04a4dab62 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:59 devstack sudo[108655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1 Sep 28 12:07:59 devstack sudo[108655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:59 devstack sudo[108653]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-805ef480-dfb7-4418-a55f-6225225f7757 tempest-ProjectReaderTests-215039770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d4b4af66-3dca-4853-a5cb-f807ed14c443.9ba8b673-287e-4bb2-9d54-c303b0162369" returned: 0 in 0.365s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-805ef480-dfb7-4418-a55f-6225225f7757 tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d4b4af66-3dca-4853-a5cb-f807ed14c443.9ba8b673-287e-4bb2-9d54-c303b0162369 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:59 devstack sudo[108660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d4b4af66-3dca-4853-a5cb-f807ed14c443.9ba8b673-287e-4bb2-9d54-c303b0162369 Sep 28 12:07:59 devstack sudo[108660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:59 devstack sudo[108655]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4df7e9ae-8405-4391-8749-25a04a4dab62 tempest-ProjectMemberTests-1312558137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1" returned: 0 in 0.424s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4df7e9ae-8405-4391-8749-25a04a4dab62 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1.34f56593-d5ce-4786-a1f2-34ec626474c3 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:59 devstack sudo[108665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1.34f56593-d5ce-4786-a1f2-34ec626474c3 1G Sep 28 12:07:59 devstack sudo[108665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:59 devstack sudo[108660]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-805ef480-dfb7-4418-a55f-6225225f7757 tempest-ProjectReaderTests-215039770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d4b4af66-3dca-4853-a5cb-f807ed14c443.9ba8b673-287e-4bb2-9d54-c303b0162369" returned: 0 in 0.258s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-805ef480-dfb7-4418-a55f-6225225f7757 tempest-ProjectReaderTests-215039770 None] Lock "cinder-quobyte-9ba8b673-287e-4bb2-9d54-c303b0162369" released by "_delete_snapshot" :: held 1.568s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:07:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-805ef480-dfb7-4418-a55f-6225225f7757 tempest-ProjectReaderTests-215039770 None] Lock "cinder-quobyte-d4b4af66-3dca-4853-a5cb-f807ed14c443" released by "delete_snapshot" :: held 1.598s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:08:00 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-805ef480-dfb7-4418-a55f-6225225f7757 tempest-ProjectReaderTests-215039770 None] Created reservations ['5394189a-0da3-4937-a17c-6622fc2b7922', '1955f806-7105-494c-987a-9e83700ab515', '7f17b268-9838-47c8-b99a-28ff98bd6396', 'a9fa5268-5f80-4cc4-8aa9-acde4387c3f7'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:08:00 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-805ef480-dfb7-4418-a55f-6225225f7757 tempest-ProjectReaderTests-215039770 None] Delete snapshot completed successfully. Sep 28 12:08:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-805ef480-dfb7-4418-a55f-6225225f7757 tempest-ProjectReaderTests-215039770 None] Lock "cinder-9ba8b673-287e-4bb2-9d54-c303b0162369-delete_snapshot" released by "delete_snapshot" :: held 1.784s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:08:00 devstack sudo[108665]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4df7e9ae-8405-4391-8749-25a04a4dab62 tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1.34f56593-d5ce-4786-a1f2-34ec626474c3 1G" returned: 0 in 0.454s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4df7e9ae-8405-4391-8749-25a04a4dab62 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1.34f56593-d5ce-4786-a1f2-34ec626474c3 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:00 devstack sudo[108671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1.34f56593-d5ce-4786-a1f2-34ec626474c3 Sep 28 12:08:00 devstack sudo[108671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5b50c5ba-e2c2-42a5-bd37-1d495ff42ea6 tempest-ProjectReaderTests-215039770 None] Acquiring lock "cinder-d4b4af66-3dca-4853-a5cb-f807ed14c443-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:08:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5b50c5ba-e2c2-42a5-bd37-1d495ff42ea6 tempest-ProjectReaderTests-215039770 None] Lock "cinder-d4b4af66-3dca-4853-a5cb-f807ed14c443-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:08:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5b50c5ba-e2c2-42a5-bd37-1d495ff42ea6 tempest-ProjectReaderTests-215039770 None] Acquiring lock "cinder-quobyte-d4b4af66-3dca-4853-a5cb-f807ed14c443" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:08:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5b50c5ba-e2c2-42a5-bd37-1d495ff42ea6 tempest-ProjectReaderTests-215039770 None] Lock "cinder-quobyte-d4b4af66-3dca-4853-a5cb-f807ed14c443" acquired by "delete_volume" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:08:00 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[a723254f-74ac-4083-95fb-a891452368d7]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:08:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5b50c5ba-e2c2-42a5-bd37-1d495ff42ea6 tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d4b4af66-3dca-4853-a5cb-f807ed14c443 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:00 devstack sudo[108671]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4df7e9ae-8405-4391-8749-25a04a4dab62 tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1.34f56593-d5ce-4786-a1f2-34ec626474c3" returned: 0 in 0.349s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:00 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-4df7e9ae-8405-4391-8749-25a04a4dab62 tempest-ProjectMemberTests-1312558137 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1.34f56593-d5ce-4786-a1f2-34ec626474c3 is being set with open permissions: ugo+rw Sep 28 12:08:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4df7e9ae-8405-4391-8749-25a04a4dab62 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1.34f56593-d5ce-4786-a1f2-34ec626474c3 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:00 devstack sudo[108678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1.34f56593-d5ce-4786-a1f2-34ec626474c3 Sep 28 12:08:00 devstack sudo[108678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:00 devstack sudo[108677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d4b4af66-3dca-4853-a5cb-f807ed14c443 Sep 28 12:08:00 devstack sudo[108677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:00 devstack sudo[108678]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4df7e9ae-8405-4391-8749-25a04a4dab62 tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1.34f56593-d5ce-4786-a1f2-34ec626474c3" returned: 0 in 0.264s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4df7e9ae-8405-4391-8749-25a04a4dab62 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:00 devstack sudo[108685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1.info Sep 28 12:08:00 devstack sudo[108685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:00 devstack sudo[108677]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5b50c5ba-e2c2-42a5-bd37-1d495ff42ea6 tempest-ProjectReaderTests-215039770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d4b4af66-3dca-4853-a5cb-f807ed14c443" returned: 0 in 0.394s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5b50c5ba-e2c2-42a5-bd37-1d495ff42ea6 tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d4b4af66-3dca-4853-a5cb-f807ed14c443 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:01 devstack sudo[108687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d4b4af66-3dca-4853-a5cb-f807ed14c443 Sep 28 12:08:01 devstack sudo[108687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:01 devstack sudo[108685]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4df7e9ae-8405-4391-8749-25a04a4dab62 tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1.info" returned: 0 in 0.294s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:01 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-4df7e9ae-8405-4391-8749-25a04a4dab62 tempest-ProjectMemberTests-1312558137 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1.info is being set with open permissions: ugo+rw Sep 28 12:08:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4df7e9ae-8405-4391-8749-25a04a4dab62 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:01 devstack sudo[108687]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5b50c5ba-e2c2-42a5-bd37-1d495ff42ea6 tempest-ProjectReaderTests-215039770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-d4b4af66-3dca-4853-a5cb-f807ed14c443" returned: 0 in 0.258s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:01 devstack sudo[108691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1.info Sep 28 12:08:01 devstack sudo[108691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5b50c5ba-e2c2-42a5-bd37-1d495ff42ea6 tempest-ProjectReaderTests-215039770 None] Lock "cinder-quobyte-d4b4af66-3dca-4853-a5cb-f807ed14c443" released by "delete_volume" :: held 0.721s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:08:01 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-5b50c5ba-e2c2-42a5-bd37-1d495ff42ea6 tempest-ProjectReaderTests-215039770 None] Created reservations ['2cb4fb66-6e9b-4199-b44c-c31b645c2827', '296352f2-89a8-4ce4-a5a8-0fa2b55313b9', '0f1fd347-dc91-4538-9ff4-ab6466f07ad7', '01dc91d8-2bfc-4ed5-854c-1607df317dec'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:08:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5b50c5ba-e2c2-42a5-bd37-1d495ff42ea6 tempest-ProjectReaderTests-215039770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:08:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5b50c5ba-e2c2-42a5-bd37-1d495ff42ea6 tempest-ProjectReaderTests-215039770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:08:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5b50c5ba-e2c2-42a5-bd37-1d495ff42ea6 tempest-ProjectReaderTests-215039770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:08:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5b50c5ba-e2c2-42a5-bd37-1d495ff42ea6 tempest-ProjectReaderTests-215039770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:08:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5b50c5ba-e2c2-42a5-bd37-1d495ff42ea6 tempest-ProjectReaderTests-215039770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:08:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5b50c5ba-e2c2-42a5-bd37-1d495ff42ea6 tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:01 devstack sudo[108693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:08:01 devstack sudo[108693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:01 devstack sudo[108691]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4df7e9ae-8405-4391-8749-25a04a4dab62 tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1.info" returned: 0 in 0.263s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4df7e9ae-8405-4391-8749-25a04a4dab62 tempest-ProjectMemberTests-1312558137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.158s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:08:01 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-4df7e9ae-8405-4391-8749-25a04a4dab62 tempest-ProjectMemberTests-1312558137 None] Create snapshot completed successfully Sep 28 12:08:01 devstack sudo[108693]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5b50c5ba-e2c2-42a5-bd37-1d495ff42ea6 tempest-ProjectReaderTests-215039770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.278s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:01 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-5b50c5ba-e2c2-42a5-bd37-1d495ff42ea6 tempest-ProjectReaderTests-215039770 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:08:01 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-5b50c5ba-e2c2-42a5-bd37-1d495ff42ea6 tempest-ProjectReaderTests-215039770 None] Deleted volume successfully. Sep 28 12:08:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5b50c5ba-e2c2-42a5-bd37-1d495ff42ea6 tempest-ProjectReaderTests-215039770 None] Lock "cinder-d4b4af66-3dca-4853-a5cb-f807ed14c443-delete_volume" released by "delete_volume" :: held 1.221s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:08:02 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-b69a0e88-22e0-4c88-8f25-cf8391d1d4c0 tempest-ProjectReaderTests-215039770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:08:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b69a0e88-22e0-4c88-8f25-cf8391d1d4c0 tempest-ProjectReaderTests-215039770 None] Flow 'volume_create_manager' (43b0088a-fba8-4f43-b142-8bf05c3b6f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:08:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b69a0e88-22e0-4c88-8f25-cf8391d1d4c0 tempest-ProjectReaderTests-215039770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b578b9a4-f93a-45f5-8358-9df92db6dd13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:08:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b69a0e88-22e0-4c88-8f25-cf8391d1d4c0 tempest-ProjectReaderTests-215039770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b578b9a4-f93a-45f5-8358-9df92db6dd13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-586054363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c90a6f87-69ba-443b-b00b-6b103d753403,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0967a03b26444a099e6a835bf5318cd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:08:02Z,use_quota=True,user_id='15e36ceca64444e0a9bfeb42495fbb44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:08:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b69a0e88-22e0-4c88-8f25-cf8391d1d4c0 tempest-ProjectReaderTests-215039770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8da4a09c-206b-4d12-b844-f8884e62ab9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:08:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b69a0e88-22e0-4c88-8f25-cf8391d1d4c0 tempest-ProjectReaderTests-215039770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8da4a09c-206b-4d12-b844-f8884e62ab9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:08:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b69a0e88-22e0-4c88-8f25-cf8391d1d4c0 tempest-ProjectReaderTests-215039770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (879ab999-d21d-4847-8837-8a245e91b5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:08:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b69a0e88-22e0-4c88-8f25-cf8391d1d4c0 tempest-ProjectReaderTests-215039770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (879ab999-d21d-4847-8837-8a245e91b5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c90a6f87-69ba-443b-b00b-6b103d753403', 'volume_name': 'volume-c90a6f87-69ba-443b-b00b-6b103d753403', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:08:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b69a0e88-22e0-4c88-8f25-cf8391d1d4c0 tempest-ProjectReaderTests-215039770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b762fc6-fd29-452b-bad3-6c1c8779a38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:08:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b69a0e88-22e0-4c88-8f25-cf8391d1d4c0 tempest-ProjectReaderTests-215039770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b762fc6-fd29-452b-bad3-6c1c8779a38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:08:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b69a0e88-22e0-4c88-8f25-cf8391d1d4c0 tempest-ProjectReaderTests-215039770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ced80b36-71d9-4048-951f-804a49c15cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:08:02 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-b69a0e88-22e0-4c88-8f25-cf8391d1d4c0 tempest-ProjectReaderTests-215039770 None] Volume c90a6f87-69ba-443b-b00b-6b103d753403: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c90a6f87-69ba-443b-b00b-6b103d753403', 'volume_size': 1} Sep 28 12:08:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b69a0e88-22e0-4c88-8f25-cf8391d1d4c0 tempest-ProjectReaderTests-215039770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:08:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b69a0e88-22e0-4c88-8f25-cf8391d1d4c0 tempest-ProjectReaderTests-215039770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:08:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b69a0e88-22e0-4c88-8f25-cf8391d1d4c0 tempest-ProjectReaderTests-215039770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-586054363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c90a6f87-69ba-443b-b00b-6b103d753403,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0967a03b26444a099e6a835bf5318cd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:08:02Z,use_quota=True,user_id='15e36ceca64444e0a9bfeb42495fbb44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:08:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-b69a0e88-22e0-4c88-8f25-cf8391d1d4c0 tempest-ProjectReaderTests-215039770 None] Creating volume c90a6f87-69ba-443b-b00b-6b103d753403 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:08:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b69a0e88-22e0-4c88-8f25-cf8391d1d4c0 tempest-ProjectReaderTests-215039770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:08:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b69a0e88-22e0-4c88-8f25-cf8391d1d4c0 tempest-ProjectReaderTests-215039770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:08:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b69a0e88-22e0-4c88-8f25-cf8391d1d4c0 tempest-ProjectReaderTests-215039770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:08:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b69a0e88-22e0-4c88-8f25-cf8391d1d4c0 tempest-ProjectReaderTests-215039770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:08:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b69a0e88-22e0-4c88-8f25-cf8391d1d4c0 tempest-ProjectReaderTests-215039770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:08:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b69a0e88-22e0-4c88-8f25-cf8391d1d4c0 tempest-ProjectReaderTests-215039770 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:08:02 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-b69a0e88-22e0-4c88-8f25-cf8391d1d4c0 tempest-ProjectReaderTests-215039770 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:08:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b69a0e88-22e0-4c88-8f25-cf8391d1d4c0 tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c90a6f87-69ba-443b-b00b-6b103d753403 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:02 devstack sudo[108697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c90a6f87-69ba-443b-b00b-6b103d753403 1073741824 Sep 28 12:08:02 devstack sudo[108697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-619f460b-58d9-4359-b355-963024579e91 tempest-ProjectMemberTests-1312558137 None] Acquiring lock "cinder-34f56593-d5ce-4786-a1f2-34ec626474c3-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:08:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-619f460b-58d9-4359-b355-963024579e91 tempest-ProjectMemberTests-1312558137 None] Lock "cinder-34f56593-d5ce-4786-a1f2-34ec626474c3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:08:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-619f460b-58d9-4359-b355-963024579e91 tempest-ProjectMemberTests-1312558137 None] Acquiring lock "cinder-quobyte-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:08:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-619f460b-58d9-4359-b355-963024579e91 tempest-ProjectMemberTests-1312558137 None] Lock "cinder-quobyte-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:08:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-619f460b-58d9-4359-b355-963024579e91 tempest-ProjectMemberTests-1312558137 None] Acquiring lock "cinder-quobyte-34f56593-d5ce-4786-a1f2-34ec626474c3" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:08:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-619f460b-58d9-4359-b355-963024579e91 tempest-ProjectMemberTests-1312558137 None] Lock "cinder-quobyte-34f56593-d5ce-4786-a1f2-34ec626474c3" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:08:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-619f460b-58d9-4359-b355-963024579e91 tempest-ProjectMemberTests-1312558137 None] Deleting offline snapshot 34f56593-d5ce-4786-a1f2-34ec626474c3 of volume bbbda85c-e806-4d65-bdcb-fa88dbdad6b1 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:08:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-619f460b-58d9-4359-b355-963024579e91 tempest-ProjectMemberTests-1312558137 None] snapshot_file for this snap is: volume-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1.34f56593-d5ce-4786-a1f2-34ec626474c3 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:08:02 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[241a1cbb-dc4b-4377-90c0-f967680790a6]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:08:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-619f460b-58d9-4359-b355-963024579e91 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1.34f56593-d5ce-4786-a1f2-34ec626474c3 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:02 devstack sudo[108697]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b69a0e88-22e0-4c88-8f25-cf8391d1d4c0 tempest-ProjectReaderTests-215039770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c90a6f87-69ba-443b-b00b-6b103d753403 1073741824" returned: 0 in 0.501s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b69a0e88-22e0-4c88-8f25-cf8391d1d4c0 tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c90a6f87-69ba-443b-b00b-6b103d753403 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:02 devstack sudo[108704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c90a6f87-69ba-443b-b00b-6b103d753403 Sep 28 12:08:02 devstack sudo[108704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:02 devstack sudo[108703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1.34f56593-d5ce-4786-a1f2-34ec626474c3 Sep 28 12:08:02 devstack sudo[108703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:02 devstack sudo[108704]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b69a0e88-22e0-4c88-8f25-cf8391d1d4c0 tempest-ProjectReaderTests-215039770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c90a6f87-69ba-443b-b00b-6b103d753403" returned: 0 in 0.288s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b69a0e88-22e0-4c88-8f25-cf8391d1d4c0 tempest-ProjectReaderTests-215039770 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:08:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b69a0e88-22e0-4c88-8f25-cf8391d1d4c0 tempest-ProjectReaderTests-215039770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:08:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b69a0e88-22e0-4c88-8f25-cf8391d1d4c0 tempest-ProjectReaderTests-215039770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ced80b36-71d9-4048-951f-804a49c15cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c90a6f87-69ba-443b-b00b-6b103d753403', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:08:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b69a0e88-22e0-4c88-8f25-cf8391d1d4c0 tempest-ProjectReaderTests-215039770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c11a8b41-4da5-4c68-8484-58b51f2bb060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:08:03 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-b69a0e88-22e0-4c88-8f25-cf8391d1d4c0 tempest-ProjectReaderTests-215039770 None] Volume volume-c90a6f87-69ba-443b-b00b-6b103d753403 (c90a6f87-69ba-443b-b00b-6b103d753403): created successfully Sep 28 12:08:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b69a0e88-22e0-4c88-8f25-cf8391d1d4c0 tempest-ProjectReaderTests-215039770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c11a8b41-4da5-4c68-8484-58b51f2bb060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:08:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b69a0e88-22e0-4c88-8f25-cf8391d1d4c0 tempest-ProjectReaderTests-215039770 None] Flow 'volume_create_manager' (43b0088a-fba8-4f43-b142-8bf05c3b6f9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:08:03 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b69a0e88-22e0-4c88-8f25-cf8391d1d4c0 tempest-ProjectReaderTests-215039770 None] Created volume successfully. Sep 28 12:08:03 devstack sudo[108703]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-619f460b-58d9-4359-b355-963024579e91 tempest-ProjectMemberTests-1312558137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1.34f56593-d5ce-4786-a1f2-34ec626474c3" returned: 0 in 0.443s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-619f460b-58d9-4359-b355-963024579e91 tempest-ProjectMemberTests-1312558137 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:08:03 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[110c9483-d8ff-45fd-828c-9be64552d8d3]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:08:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-619f460b-58d9-4359-b355-963024579e91 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:03 devstack sudo[108711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1 Sep 28 12:08:03 devstack sudo[108711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:03 devstack sudo[108711]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-619f460b-58d9-4359-b355-963024579e91 tempest-ProjectMemberTests-1312558137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1" returned: 0 in 0.387s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-619f460b-58d9-4359-b355-963024579e91 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1.34f56593-d5ce-4786-a1f2-34ec626474c3 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:03 devstack sudo[108716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1.34f56593-d5ce-4786-a1f2-34ec626474c3 Sep 28 12:08:03 devstack sudo[108716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:03 devstack sudo[108716]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-619f460b-58d9-4359-b355-963024579e91 tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1.34f56593-d5ce-4786-a1f2-34ec626474c3" returned: 0 in 0.369s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-619f460b-58d9-4359-b355-963024579e91 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1.34f56593-d5ce-4786-a1f2-34ec626474c3 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:03 devstack sudo[108721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1.34f56593-d5ce-4786-a1f2-34ec626474c3 Sep 28 12:08:03 devstack sudo[108721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:04 devstack sudo[108721]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-619f460b-58d9-4359-b355-963024579e91 tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1.34f56593-d5ce-4786-a1f2-34ec626474c3" returned: 0 in 0.279s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:04 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-619f460b-58d9-4359-b355-963024579e91 tempest-ProjectMemberTests-1312558137 None] Lock "cinder-quobyte-34f56593-d5ce-4786-a1f2-34ec626474c3" released by "_delete_snapshot" :: held 1.595s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:08:04 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-619f460b-58d9-4359-b355-963024579e91 tempest-ProjectMemberTests-1312558137 None] Lock "cinder-quobyte-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1" released by "delete_snapshot" :: held 1.624s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:08:04 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-619f460b-58d9-4359-b355-963024579e91 tempest-ProjectMemberTests-1312558137 None] Created reservations ['075b9ef9-5b53-4567-8010-64bdc9735dab', '2dd06ca9-afee-4fbd-9f12-908ea3fc38a2', 'a4882a1e-b886-419d-b052-4fec1fec7426', 'e43f314a-8ff8-4a53-9a19-26860692626c'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:08:04 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-619f460b-58d9-4359-b355-963024579e91 tempest-ProjectMemberTests-1312558137 None] Delete snapshot completed successfully. Sep 28 12:08:04 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-619f460b-58d9-4359-b355-963024579e91 tempest-ProjectMemberTests-1312558137 None] Lock "cinder-34f56593-d5ce-4786-a1f2-34ec626474c3-delete_snapshot" released by "delete_snapshot" :: held 1.807s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:08:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-327cdb72-9cc0-49b8-98cf-6401b71443a7 tempest-ProjectReaderTests-215039770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:08:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-327cdb72-9cc0-49b8-98cf-6401b71443a7 tempest-ProjectReaderTests-215039770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:08:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-327cdb72-9cc0-49b8-98cf-6401b71443a7 tempest-ProjectReaderTests-215039770 None] Creating offline snapshot cc1ebb2f-3d2a-4f46-9508-9d1e78bc8392 of volume c90a6f87-69ba-443b-b00b-6b103d753403 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:08:04 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[42312414-7f48-4926-9ffd-3fe498600b82]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:08:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-327cdb72-9cc0-49b8-98cf-6401b71443a7 tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c90a6f87-69ba-443b-b00b-6b103d753403 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:04 devstack sudo[108724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c90a6f87-69ba-443b-b00b-6b103d753403 Sep 28 12:08:04 devstack sudo[108724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:04 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ff58cdc8-9757-4753-a468-42e336c4ad25 tempest-ProjectMemberTests-1312558137 None] Acquiring lock "cinder-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:08:04 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ff58cdc8-9757-4753-a468-42e336c4ad25 tempest-ProjectMemberTests-1312558137 None] Lock "cinder-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:08:04 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ff58cdc8-9757-4753-a468-42e336c4ad25 tempest-ProjectMemberTests-1312558137 None] Acquiring lock "cinder-quobyte-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:08:04 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ff58cdc8-9757-4753-a468-42e336c4ad25 tempest-ProjectMemberTests-1312558137 None] Lock "cinder-quobyte-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1" acquired by "delete_volume" :: waited 0.021s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:08:04 devstack sudo[108724]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-327cdb72-9cc0-49b8-98cf-6401b71443a7 tempest-ProjectReaderTests-215039770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c90a6f87-69ba-443b-b00b-6b103d753403" returned: 0 in 0.407s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-327cdb72-9cc0-49b8-98cf-6401b71443a7 tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c90a6f87-69ba-443b-b00b-6b103d753403,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c90a6f87-69ba-443b-b00b-6b103d753403.cc1ebb2f-3d2a-4f46-9508-9d1e78bc8392 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:04 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f983704-0bf9-4667-9700-1877e6f4edd7]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:08:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ff58cdc8-9757-4753-a468-42e336c4ad25 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:04 devstack sudo[108730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c90a6f87-69ba-443b-b00b-6b103d753403,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c90a6f87-69ba-443b-b00b-6b103d753403.cc1ebb2f-3d2a-4f46-9508-9d1e78bc8392 1G Sep 28 12:08:04 devstack sudo[108730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:04 devstack sudo[108731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1 Sep 28 12:08:04 devstack sudo[108731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:05 devstack sudo[108731]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ff58cdc8-9757-4753-a468-42e336c4ad25 tempest-ProjectMemberTests-1312558137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1" returned: 0 in 0.399s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ff58cdc8-9757-4753-a468-42e336c4ad25 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:05 devstack sudo[108730]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-327cdb72-9cc0-49b8-98cf-6401b71443a7 tempest-ProjectReaderTests-215039770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c90a6f87-69ba-443b-b00b-6b103d753403,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c90a6f87-69ba-443b-b00b-6b103d753403.cc1ebb2f-3d2a-4f46-9508-9d1e78bc8392 1G" returned: 0 in 0.436s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-327cdb72-9cc0-49b8-98cf-6401b71443a7 tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c90a6f87-69ba-443b-b00b-6b103d753403 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c90a6f87-69ba-443b-b00b-6b103d753403.cc1ebb2f-3d2a-4f46-9508-9d1e78bc8392 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:05 devstack sudo[108741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1 Sep 28 12:08:05 devstack sudo[108741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:05 devstack sudo[108742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c90a6f87-69ba-443b-b00b-6b103d753403 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c90a6f87-69ba-443b-b00b-6b103d753403.cc1ebb2f-3d2a-4f46-9508-9d1e78bc8392 Sep 28 12:08:05 devstack sudo[108742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:05 devstack sudo[108741]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ff58cdc8-9757-4753-a468-42e336c4ad25 tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1" returned: 0 in 0.275s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ff58cdc8-9757-4753-a468-42e336c4ad25 tempest-ProjectMemberTests-1312558137 None] Lock "cinder-quobyte-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1" released by "delete_volume" :: held 0.755s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:08:05 devstack sudo[108742]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-327cdb72-9cc0-49b8-98cf-6401b71443a7 tempest-ProjectReaderTests-215039770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c90a6f87-69ba-443b-b00b-6b103d753403 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c90a6f87-69ba-443b-b00b-6b103d753403.cc1ebb2f-3d2a-4f46-9508-9d1e78bc8392" returned: 0 in 0.319s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:05 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-327cdb72-9cc0-49b8-98cf-6401b71443a7 tempest-ProjectReaderTests-215039770 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c90a6f87-69ba-443b-b00b-6b103d753403.cc1ebb2f-3d2a-4f46-9508-9d1e78bc8392 is being set with open permissions: ugo+rw Sep 28 12:08:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-327cdb72-9cc0-49b8-98cf-6401b71443a7 tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c90a6f87-69ba-443b-b00b-6b103d753403.cc1ebb2f-3d2a-4f46-9508-9d1e78bc8392 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:05 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-ff58cdc8-9757-4753-a468-42e336c4ad25 tempest-ProjectMemberTests-1312558137 None] Created reservations ['403e594f-571b-4aa2-8bc1-50ed12c656bc', '4e0eff1d-6032-4419-a5aa-e442e449a9de', 'e1ed3261-3ae3-41b7-a5bf-610b2e4ca4bd', '8bbc69c8-d6bf-4e8a-88bd-659f152e6f3e'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:08:05 devstack sudo[108749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c90a6f87-69ba-443b-b00b-6b103d753403.cc1ebb2f-3d2a-4f46-9508-9d1e78bc8392 Sep 28 12:08:05 devstack sudo[108749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ff58cdc8-9757-4753-a468-42e336c4ad25 tempest-ProjectMemberTests-1312558137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:08:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ff58cdc8-9757-4753-a468-42e336c4ad25 tempest-ProjectMemberTests-1312558137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:08:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ff58cdc8-9757-4753-a468-42e336c4ad25 tempest-ProjectMemberTests-1312558137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:08:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ff58cdc8-9757-4753-a468-42e336c4ad25 tempest-ProjectMemberTests-1312558137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:08:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ff58cdc8-9757-4753-a468-42e336c4ad25 tempest-ProjectMemberTests-1312558137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:08:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ff58cdc8-9757-4753-a468-42e336c4ad25 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:05 devstack sudo[108751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:08:05 devstack sudo[108751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:05 devstack sudo[108749]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-327cdb72-9cc0-49b8-98cf-6401b71443a7 tempest-ProjectReaderTests-215039770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c90a6f87-69ba-443b-b00b-6b103d753403.cc1ebb2f-3d2a-4f46-9508-9d1e78bc8392" returned: 0 in 0.291s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-327cdb72-9cc0-49b8-98cf-6401b71443a7 tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c90a6f87-69ba-443b-b00b-6b103d753403.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:05 devstack sudo[108754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c90a6f87-69ba-443b-b00b-6b103d753403.info Sep 28 12:08:05 devstack sudo[108754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:05 devstack sudo[108751]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ff58cdc8-9757-4753-a468-42e336c4ad25 tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.296s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:05 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-ff58cdc8-9757-4753-a468-42e336c4ad25 tempest-ProjectMemberTests-1312558137 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:08:06 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-ff58cdc8-9757-4753-a468-42e336c4ad25 tempest-ProjectMemberTests-1312558137 None] Deleted volume successfully. Sep 28 12:08:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ff58cdc8-9757-4753-a468-42e336c4ad25 tempest-ProjectMemberTests-1312558137 None] Lock "cinder-bbbda85c-e806-4d65-bdcb-fa88dbdad6b1-delete_volume" released by "delete_volume" :: held 1.297s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:08:06 devstack sudo[108754]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-327cdb72-9cc0-49b8-98cf-6401b71443a7 tempest-ProjectReaderTests-215039770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c90a6f87-69ba-443b-b00b-6b103d753403.info" returned: 0 in 0.322s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:06 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-327cdb72-9cc0-49b8-98cf-6401b71443a7 tempest-ProjectReaderTests-215039770 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c90a6f87-69ba-443b-b00b-6b103d753403.info is being set with open permissions: ugo+rw Sep 28 12:08:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-327cdb72-9cc0-49b8-98cf-6401b71443a7 tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c90a6f87-69ba-443b-b00b-6b103d753403.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:06 devstack sudo[108758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c90a6f87-69ba-443b-b00b-6b103d753403.info Sep 28 12:08:06 devstack sudo[108758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:06 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9aaa65f-b4d9-40b4-9b24-882da359b66f tempest-ProjectMemberTests-1312558137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:08:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d9aaa65f-b4d9-40b4-9b24-882da359b66f tempest-ProjectMemberTests-1312558137 None] Flow 'volume_create_manager' (2a3724d0-302c-4fe2-880e-ed5bb3f99978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:08:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d9aaa65f-b4d9-40b4-9b24-882da359b66f tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b2b532b-c5fa-48c9-b458-e5b8c91b3e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:08:06 devstack sudo[108758]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-327cdb72-9cc0-49b8-98cf-6401b71443a7 tempest-ProjectReaderTests-215039770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c90a6f87-69ba-443b-b00b-6b103d753403.info" returned: 0 in 0.297s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-327cdb72-9cc0-49b8-98cf-6401b71443a7 tempest-ProjectReaderTests-215039770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.173s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:08:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d9aaa65f-b4d9-40b4-9b24-882da359b66f tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b2b532b-c5fa-48c9-b458-e5b8c91b3e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-542146188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfb96e66-0031-42b5-b440-c49ef2971109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba606417eb184510b6154fa1a28dce16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:08:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:08:06Z,use_quota=True,user_id='bb30da770afa465f8162e7779a473226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:08:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d9aaa65f-b4d9-40b4-9b24-882da359b66f tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d13dad3-96f1-4b4f-9b8c-148ba1a8050d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:08:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d9aaa65f-b4d9-40b4-9b24-882da359b66f tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d13dad3-96f1-4b4f-9b8c-148ba1a8050d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:08:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d9aaa65f-b4d9-40b4-9b24-882da359b66f tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21abad75-a8fe-4c6f-9655-daba52919b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:08:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d9aaa65f-b4d9-40b4-9b24-882da359b66f tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21abad75-a8fe-4c6f-9655-daba52919b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfb96e66-0031-42b5-b440-c49ef2971109', 'volume_name': 'volume-dfb96e66-0031-42b5-b440-c49ef2971109', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:08:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d9aaa65f-b4d9-40b4-9b24-882da359b66f tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8910dea3-0997-4bec-962c-3ec2faca95ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:08:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d9aaa65f-b4d9-40b4-9b24-882da359b66f tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8910dea3-0997-4bec-962c-3ec2faca95ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:08:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d9aaa65f-b4d9-40b4-9b24-882da359b66f tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fd264e2-e6f8-4370-9e78-e726f0e46289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:08:06 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-d9aaa65f-b4d9-40b4-9b24-882da359b66f tempest-ProjectMemberTests-1312558137 None] Volume dfb96e66-0031-42b5-b440-c49ef2971109: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfb96e66-0031-42b5-b440-c49ef2971109', 'volume_size': 1} Sep 28 12:08:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d9aaa65f-b4d9-40b4-9b24-882da359b66f tempest-ProjectMemberTests-1312558137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:08:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d9aaa65f-b4d9-40b4-9b24-882da359b66f tempest-ProjectMemberTests-1312558137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:08:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d9aaa65f-b4d9-40b4-9b24-882da359b66f tempest-ProjectMemberTests-1312558137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-542146188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfb96e66-0031-42b5-b440-c49ef2971109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba606417eb184510b6154fa1a28dce16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:08:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:08:06Z,use_quota=True,user_id='bb30da770afa465f8162e7779a473226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:08:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-d9aaa65f-b4d9-40b4-9b24-882da359b66f tempest-ProjectMemberTests-1312558137 None] Creating volume dfb96e66-0031-42b5-b440-c49ef2971109 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:08:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d9aaa65f-b4d9-40b4-9b24-882da359b66f tempest-ProjectMemberTests-1312558137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:08:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d9aaa65f-b4d9-40b4-9b24-882da359b66f tempest-ProjectMemberTests-1312558137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:08:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d9aaa65f-b4d9-40b4-9b24-882da359b66f tempest-ProjectMemberTests-1312558137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:08:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d9aaa65f-b4d9-40b4-9b24-882da359b66f tempest-ProjectMemberTests-1312558137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:08:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d9aaa65f-b4d9-40b4-9b24-882da359b66f tempest-ProjectMemberTests-1312558137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:08:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d9aaa65f-b4d9-40b4-9b24-882da359b66f tempest-ProjectMemberTests-1312558137 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:08:06 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-d9aaa65f-b4d9-40b4-9b24-882da359b66f tempest-ProjectMemberTests-1312558137 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:08:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d9aaa65f-b4d9-40b4-9b24-882da359b66f tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dfb96e66-0031-42b5-b440-c49ef2971109 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:06 devstack sudo[108761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dfb96e66-0031-42b5-b440-c49ef2971109 1073741824 Sep 28 12:08:06 devstack sudo[108761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:06 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-327cdb72-9cc0-49b8-98cf-6401b71443a7 tempest-ProjectReaderTests-215039770 None] Create snapshot completed successfully Sep 28 12:08:07 devstack sudo[108761]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d9aaa65f-b4d9-40b4-9b24-882da359b66f tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dfb96e66-0031-42b5-b440-c49ef2971109 1073741824" returned: 0 in 0.434s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d9aaa65f-b4d9-40b4-9b24-882da359b66f tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dfb96e66-0031-42b5-b440-c49ef2971109 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:07 devstack sudo[108767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dfb96e66-0031-42b5-b440-c49ef2971109 Sep 28 12:08:07 devstack sudo[108767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:07 devstack sudo[108767]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d9aaa65f-b4d9-40b4-9b24-882da359b66f tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dfb96e66-0031-42b5-b440-c49ef2971109" returned: 0 in 0.254s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d9aaa65f-b4d9-40b4-9b24-882da359b66f tempest-ProjectMemberTests-1312558137 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:08:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d9aaa65f-b4d9-40b4-9b24-882da359b66f tempest-ProjectMemberTests-1312558137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:08:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d9aaa65f-b4d9-40b4-9b24-882da359b66f tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fd264e2-e6f8-4370-9e78-e726f0e46289) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfb96e66-0031-42b5-b440-c49ef2971109', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:08:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d9aaa65f-b4d9-40b4-9b24-882da359b66f tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (940d08ba-6391-457a-8e2b-19475d7584a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:08:07 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-d9aaa65f-b4d9-40b4-9b24-882da359b66f tempest-ProjectMemberTests-1312558137 None] Volume volume-dfb96e66-0031-42b5-b440-c49ef2971109 (dfb96e66-0031-42b5-b440-c49ef2971109): created successfully Sep 28 12:08:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d9aaa65f-b4d9-40b4-9b24-882da359b66f tempest-ProjectMemberTests-1312558137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (940d08ba-6391-457a-8e2b-19475d7584a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:08:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d9aaa65f-b4d9-40b4-9b24-882da359b66f tempest-ProjectMemberTests-1312558137 None] Flow 'volume_create_manager' (2a3724d0-302c-4fe2-880e-ed5bb3f99978) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:08:07 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-d9aaa65f-b4d9-40b4-9b24-882da359b66f tempest-ProjectMemberTests-1312558137 None] Created volume successfully. Sep 28 12:08:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a6e0203c-1895-4e80-b3b6-e232b98c25a4 tempest-ProjectReaderTests-215039770 None] Acquiring lock "cinder-cc1ebb2f-3d2a-4f46-9508-9d1e78bc8392-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:08:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a6e0203c-1895-4e80-b3b6-e232b98c25a4 tempest-ProjectReaderTests-215039770 None] Lock "cinder-cc1ebb2f-3d2a-4f46-9508-9d1e78bc8392-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:08:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a6e0203c-1895-4e80-b3b6-e232b98c25a4 tempest-ProjectReaderTests-215039770 None] Acquiring lock "cinder-quobyte-c90a6f87-69ba-443b-b00b-6b103d753403" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:08:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a6e0203c-1895-4e80-b3b6-e232b98c25a4 tempest-ProjectReaderTests-215039770 None] Lock "cinder-quobyte-c90a6f87-69ba-443b-b00b-6b103d753403" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:08:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a6e0203c-1895-4e80-b3b6-e232b98c25a4 tempest-ProjectReaderTests-215039770 None] Acquiring lock "cinder-quobyte-cc1ebb2f-3d2a-4f46-9508-9d1e78bc8392" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:08:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a6e0203c-1895-4e80-b3b6-e232b98c25a4 tempest-ProjectReaderTests-215039770 None] Lock "cinder-quobyte-cc1ebb2f-3d2a-4f46-9508-9d1e78bc8392" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:08:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-a6e0203c-1895-4e80-b3b6-e232b98c25a4 tempest-ProjectReaderTests-215039770 None] Deleting offline snapshot cc1ebb2f-3d2a-4f46-9508-9d1e78bc8392 of volume c90a6f87-69ba-443b-b00b-6b103d753403 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:08:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-a6e0203c-1895-4e80-b3b6-e232b98c25a4 tempest-ProjectReaderTests-215039770 None] snapshot_file for this snap is: volume-c90a6f87-69ba-443b-b00b-6b103d753403.cc1ebb2f-3d2a-4f46-9508-9d1e78bc8392 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:08:07 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[8782e656-4b7f-42f3-81a4-f3bd21afb1ca]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:08:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a6e0203c-1895-4e80-b3b6-e232b98c25a4 tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c90a6f87-69ba-443b-b00b-6b103d753403.cc1ebb2f-3d2a-4f46-9508-9d1e78bc8392 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:07 devstack sudo[108770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c90a6f87-69ba-443b-b00b-6b103d753403.cc1ebb2f-3d2a-4f46-9508-9d1e78bc8392 Sep 28 12:08:07 devstack sudo[108770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:08 devstack sudo[108770]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a6e0203c-1895-4e80-b3b6-e232b98c25a4 tempest-ProjectReaderTests-215039770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c90a6f87-69ba-443b-b00b-6b103d753403.cc1ebb2f-3d2a-4f46-9508-9d1e78bc8392" returned: 0 in 0.366s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-a6e0203c-1895-4e80-b3b6-e232b98c25a4 tempest-ProjectReaderTests-215039770 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c90a6f87-69ba-443b-b00b-6b103d753403(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:08:08 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f1b19b-6dac-4f1d-84a1-2dcd2379b2b9]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:08:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a6e0203c-1895-4e80-b3b6-e232b98c25a4 tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c90a6f87-69ba-443b-b00b-6b103d753403 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:08 devstack sudo[108775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c90a6f87-69ba-443b-b00b-6b103d753403 Sep 28 12:08:08 devstack sudo[108775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:08 devstack sudo[108775]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a6e0203c-1895-4e80-b3b6-e232b98c25a4 tempest-ProjectReaderTests-215039770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c90a6f87-69ba-443b-b00b-6b103d753403" returned: 0 in 0.378s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a6e0203c-1895-4e80-b3b6-e232b98c25a4 tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c90a6f87-69ba-443b-b00b-6b103d753403.cc1ebb2f-3d2a-4f46-9508-9d1e78bc8392 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:08 devstack sudo[108780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c90a6f87-69ba-443b-b00b-6b103d753403.cc1ebb2f-3d2a-4f46-9508-9d1e78bc8392 Sep 28 12:08:08 devstack sudo[108780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c3534ec7-5457-4780-a040-01e6fe5a252e tempest-ProjectMemberTests-1312558137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:08:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c3534ec7-5457-4780-a040-01e6fe5a252e tempest-ProjectMemberTests-1312558137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:08:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-c3534ec7-5457-4780-a040-01e6fe5a252e tempest-ProjectMemberTests-1312558137 None] Creating offline snapshot 5d9e369f-c6e3-4caf-a20c-638047ab0655 of volume dfb96e66-0031-42b5-b440-c49ef2971109 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:08:08 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea61d124-7f31-41f0-a95c-166dfb92a76f]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:08:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c3534ec7-5457-4780-a040-01e6fe5a252e tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dfb96e66-0031-42b5-b440-c49ef2971109 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:08 devstack sudo[108780]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a6e0203c-1895-4e80-b3b6-e232b98c25a4 tempest-ProjectReaderTests-215039770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c90a6f87-69ba-443b-b00b-6b103d753403.cc1ebb2f-3d2a-4f46-9508-9d1e78bc8392" returned: 0 in 0.395s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a6e0203c-1895-4e80-b3b6-e232b98c25a4 tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c90a6f87-69ba-443b-b00b-6b103d753403.cc1ebb2f-3d2a-4f46-9508-9d1e78bc8392 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:08 devstack sudo[108786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c90a6f87-69ba-443b-b00b-6b103d753403.cc1ebb2f-3d2a-4f46-9508-9d1e78bc8392 Sep 28 12:08:08 devstack sudo[108786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:08 devstack sudo[108785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dfb96e66-0031-42b5-b440-c49ef2971109 Sep 28 12:08:08 devstack sudo[108785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:09 devstack sudo[108786]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a6e0203c-1895-4e80-b3b6-e232b98c25a4 tempest-ProjectReaderTests-215039770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c90a6f87-69ba-443b-b00b-6b103d753403.cc1ebb2f-3d2a-4f46-9508-9d1e78bc8392" returned: 0 in 0.288s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a6e0203c-1895-4e80-b3b6-e232b98c25a4 tempest-ProjectReaderTests-215039770 None] Lock "cinder-quobyte-cc1ebb2f-3d2a-4f46-9508-9d1e78bc8392" released by "_delete_snapshot" :: held 1.535s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:08:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a6e0203c-1895-4e80-b3b6-e232b98c25a4 tempest-ProjectReaderTests-215039770 None] Lock "cinder-quobyte-c90a6f87-69ba-443b-b00b-6b103d753403" released by "delete_snapshot" :: held 1.560s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:08:09 devstack sudo[108785]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c3534ec7-5457-4780-a040-01e6fe5a252e tempest-ProjectMemberTests-1312558137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dfb96e66-0031-42b5-b440-c49ef2971109" returned: 0 in 0.402s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c3534ec7-5457-4780-a040-01e6fe5a252e tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dfb96e66-0031-42b5-b440-c49ef2971109,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dfb96e66-0031-42b5-b440-c49ef2971109.5d9e369f-c6e3-4caf-a20c-638047ab0655 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:09 devstack sudo[108793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dfb96e66-0031-42b5-b440-c49ef2971109,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dfb96e66-0031-42b5-b440-c49ef2971109.5d9e369f-c6e3-4caf-a20c-638047ab0655 1G Sep 28 12:08:09 devstack sudo[108793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:09 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-a6e0203c-1895-4e80-b3b6-e232b98c25a4 tempest-ProjectReaderTests-215039770 None] Created reservations ['65d74363-8c15-4908-a94c-3bb10398649c', '1cc373af-612e-4ee3-9ad8-5b60f07a6f1e', '1677280a-0ee4-44fb-95e3-548d7fe89a80', '9c55900f-2078-4f42-a7de-c70356e8c1f6'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:08:09 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-a6e0203c-1895-4e80-b3b6-e232b98c25a4 tempest-ProjectReaderTests-215039770 None] Delete snapshot completed successfully. Sep 28 12:08:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a6e0203c-1895-4e80-b3b6-e232b98c25a4 tempest-ProjectReaderTests-215039770 None] Lock "cinder-cc1ebb2f-3d2a-4f46-9508-9d1e78bc8392-delete_snapshot" released by "delete_snapshot" :: held 1.731s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:08:09 devstack sudo[108793]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c3534ec7-5457-4780-a040-01e6fe5a252e tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dfb96e66-0031-42b5-b440-c49ef2971109,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dfb96e66-0031-42b5-b440-c49ef2971109.5d9e369f-c6e3-4caf-a20c-638047ab0655 1G" returned: 0 in 0.406s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c3534ec7-5457-4780-a040-01e6fe5a252e tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfb96e66-0031-42b5-b440-c49ef2971109 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dfb96e66-0031-42b5-b440-c49ef2971109.5d9e369f-c6e3-4caf-a20c-638047ab0655 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:09 devstack sudo[108799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfb96e66-0031-42b5-b440-c49ef2971109 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dfb96e66-0031-42b5-b440-c49ef2971109.5d9e369f-c6e3-4caf-a20c-638047ab0655 Sep 28 12:08:09 devstack sudo[108799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-760c738a-83df-4c30-8b39-87b0bb8caf5f tempest-ProjectReaderTests-215039770 None] Acquiring lock "cinder-c90a6f87-69ba-443b-b00b-6b103d753403-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:08:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-760c738a-83df-4c30-8b39-87b0bb8caf5f tempest-ProjectReaderTests-215039770 None] Lock "cinder-c90a6f87-69ba-443b-b00b-6b103d753403-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:08:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-760c738a-83df-4c30-8b39-87b0bb8caf5f tempest-ProjectReaderTests-215039770 None] Acquiring lock "cinder-quobyte-c90a6f87-69ba-443b-b00b-6b103d753403" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:08:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-760c738a-83df-4c30-8b39-87b0bb8caf5f tempest-ProjectReaderTests-215039770 None] Lock "cinder-quobyte-c90a6f87-69ba-443b-b00b-6b103d753403" acquired by "delete_volume" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:08:09 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b070590-5490-4b5a-8c84-6cb0a678a61c]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:08:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-760c738a-83df-4c30-8b39-87b0bb8caf5f tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c90a6f87-69ba-443b-b00b-6b103d753403 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:09 devstack sudo[108799]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c3534ec7-5457-4780-a040-01e6fe5a252e tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfb96e66-0031-42b5-b440-c49ef2971109 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dfb96e66-0031-42b5-b440-c49ef2971109.5d9e369f-c6e3-4caf-a20c-638047ab0655" returned: 0 in 0.333s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:09 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-c3534ec7-5457-4780-a040-01e6fe5a252e tempest-ProjectMemberTests-1312558137 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dfb96e66-0031-42b5-b440-c49ef2971109.5d9e369f-c6e3-4caf-a20c-638047ab0655 is being set with open permissions: ugo+rw Sep 28 12:08:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c3534ec7-5457-4780-a040-01e6fe5a252e tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dfb96e66-0031-42b5-b440-c49ef2971109.5d9e369f-c6e3-4caf-a20c-638047ab0655 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:09 devstack sudo[108805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dfb96e66-0031-42b5-b440-c49ef2971109.5d9e369f-c6e3-4caf-a20c-638047ab0655 Sep 28 12:08:09 devstack sudo[108805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:09 devstack sudo[108804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c90a6f87-69ba-443b-b00b-6b103d753403 Sep 28 12:08:09 devstack sudo[108804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:10 devstack sudo[108805]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c3534ec7-5457-4780-a040-01e6fe5a252e tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dfb96e66-0031-42b5-b440-c49ef2971109.5d9e369f-c6e3-4caf-a20c-638047ab0655" returned: 0 in 0.263s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c3534ec7-5457-4780-a040-01e6fe5a252e tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dfb96e66-0031-42b5-b440-c49ef2971109.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:10 devstack sudo[108812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dfb96e66-0031-42b5-b440-c49ef2971109.info Sep 28 12:08:10 devstack sudo[108812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:10 devstack sudo[108804]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-760c738a-83df-4c30-8b39-87b0bb8caf5f tempest-ProjectReaderTests-215039770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c90a6f87-69ba-443b-b00b-6b103d753403" returned: 0 in 0.387s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-760c738a-83df-4c30-8b39-87b0bb8caf5f tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c90a6f87-69ba-443b-b00b-6b103d753403 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:10 devstack sudo[108814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c90a6f87-69ba-443b-b00b-6b103d753403 Sep 28 12:08:10 devstack sudo[108814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:10 devstack sudo[108814]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:10 devstack sudo[108812]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c3534ec7-5457-4780-a040-01e6fe5a252e tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dfb96e66-0031-42b5-b440-c49ef2971109.info" returned: 0 in 0.294s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-760c738a-83df-4c30-8b39-87b0bb8caf5f tempest-ProjectReaderTests-215039770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-c90a6f87-69ba-443b-b00b-6b103d753403" returned: 0 in 0.258s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:10 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-c3534ec7-5457-4780-a040-01e6fe5a252e tempest-ProjectMemberTests-1312558137 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dfb96e66-0031-42b5-b440-c49ef2971109.info is being set with open permissions: ugo+rw Sep 28 12:08:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c3534ec7-5457-4780-a040-01e6fe5a252e tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dfb96e66-0031-42b5-b440-c49ef2971109.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:10 devstack sudo[108819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dfb96e66-0031-42b5-b440-c49ef2971109.info Sep 28 12:08:10 devstack sudo[108819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:10 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-760c738a-83df-4c30-8b39-87b0bb8caf5f tempest-ProjectReaderTests-215039770 None] Lock "cinder-quobyte-c90a6f87-69ba-443b-b00b-6b103d753403" released by "delete_volume" :: held 0.718s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:08:10 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-760c738a-83df-4c30-8b39-87b0bb8caf5f tempest-ProjectReaderTests-215039770 None] Created reservations ['7b85923c-4e0c-4880-8fc2-ad6fa7d3651e', '97d480c0-99e1-4a94-810f-ee8c2ccbe417', '5158ec80-3114-4f9c-a8e0-62bac1acade6', '32eb5a6b-1428-40c4-9618-e5313caaee48'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:08:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-760c738a-83df-4c30-8b39-87b0bb8caf5f tempest-ProjectReaderTests-215039770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:08:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-760c738a-83df-4c30-8b39-87b0bb8caf5f tempest-ProjectReaderTests-215039770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:08:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-760c738a-83df-4c30-8b39-87b0bb8caf5f tempest-ProjectReaderTests-215039770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:08:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-760c738a-83df-4c30-8b39-87b0bb8caf5f tempest-ProjectReaderTests-215039770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:08:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-760c738a-83df-4c30-8b39-87b0bb8caf5f tempest-ProjectReaderTests-215039770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:08:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-760c738a-83df-4c30-8b39-87b0bb8caf5f tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:10 devstack sudo[108821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:08:10 devstack sudo[108821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:10 devstack sudo[108819]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c3534ec7-5457-4780-a040-01e6fe5a252e tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dfb96e66-0031-42b5-b440-c49ef2971109.info" returned: 0 in 0.264s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c3534ec7-5457-4780-a040-01e6fe5a252e tempest-ProjectMemberTests-1312558137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.073s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:08:10 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-c3534ec7-5457-4780-a040-01e6fe5a252e tempest-ProjectMemberTests-1312558137 None] Create snapshot completed successfully Sep 28 12:08:10 devstack sudo[108821]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-760c738a-83df-4c30-8b39-87b0bb8caf5f tempest-ProjectReaderTests-215039770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.280s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:10 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-760c738a-83df-4c30-8b39-87b0bb8caf5f tempest-ProjectReaderTests-215039770 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:08:10 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-760c738a-83df-4c30-8b39-87b0bb8caf5f tempest-ProjectReaderTests-215039770 None] Deleted volume successfully. Sep 28 12:08:10 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-760c738a-83df-4c30-8b39-87b0bb8caf5f tempest-ProjectReaderTests-215039770 None] Lock "cinder-c90a6f87-69ba-443b-b00b-6b103d753403-delete_volume" released by "delete_volume" :: held 1.224s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:08:11 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b4d12d7-5e84-4f5c-aa5b-9ede351e7bcc tempest-ProjectReaderTests-215039770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:08:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4b4d12d7-5e84-4f5c-aa5b-9ede351e7bcc tempest-ProjectReaderTests-215039770 None] Flow 'volume_create_manager' (6a587dd9-7482-4292-ba44-cee48a0a2a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:08:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4b4d12d7-5e84-4f5c-aa5b-9ede351e7bcc tempest-ProjectReaderTests-215039770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4cdd4aa-49be-400d-9abf-4f7c9d9d4649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:08:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4b4d12d7-5e84-4f5c-aa5b-9ede351e7bcc tempest-ProjectReaderTests-215039770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4cdd4aa-49be-400d-9abf-4f7c9d9d4649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:08:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-245126148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=643d8a13-ce82-409c-8440-c36601e4f2f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0967a03b26444a099e6a835bf5318cd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:08:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:08:11Z,use_quota=True,user_id='15e36ceca64444e0a9bfeb42495fbb44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:08:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4b4d12d7-5e84-4f5c-aa5b-9ede351e7bcc tempest-ProjectReaderTests-215039770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a5b80cb-19ee-4bf7-944c-52d00ca24661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:08:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4b4d12d7-5e84-4f5c-aa5b-9ede351e7bcc tempest-ProjectReaderTests-215039770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a5b80cb-19ee-4bf7-944c-52d00ca24661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:08:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4b4d12d7-5e84-4f5c-aa5b-9ede351e7bcc tempest-ProjectReaderTests-215039770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84e3a264-7b68-4f42-a0a6-b255e1a4d96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:08:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4b4d12d7-5e84-4f5c-aa5b-9ede351e7bcc tempest-ProjectReaderTests-215039770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84e3a264-7b68-4f42-a0a6-b255e1a4d96d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '643d8a13-ce82-409c-8440-c36601e4f2f5', 'volume_name': 'volume-643d8a13-ce82-409c-8440-c36601e4f2f5', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:08:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4b4d12d7-5e84-4f5c-aa5b-9ede351e7bcc tempest-ProjectReaderTests-215039770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d28bb8a-fe55-4e1d-8c0f-db27890c1163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:08:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4b4d12d7-5e84-4f5c-aa5b-9ede351e7bcc tempest-ProjectReaderTests-215039770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d28bb8a-fe55-4e1d-8c0f-db27890c1163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:08:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4b4d12d7-5e84-4f5c-aa5b-9ede351e7bcc tempest-ProjectReaderTests-215039770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7cd6a75-e625-4a06-9770-061ba6b7792c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:08:11 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-4b4d12d7-5e84-4f5c-aa5b-9ede351e7bcc tempest-ProjectReaderTests-215039770 None] Volume 643d8a13-ce82-409c-8440-c36601e4f2f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-643d8a13-ce82-409c-8440-c36601e4f2f5', 'volume_size': 1} Sep 28 12:08:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4b4d12d7-5e84-4f5c-aa5b-9ede351e7bcc tempest-ProjectReaderTests-215039770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:08:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4b4d12d7-5e84-4f5c-aa5b-9ede351e7bcc tempest-ProjectReaderTests-215039770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:08:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4b4d12d7-5e84-4f5c-aa5b-9ede351e7bcc tempest-ProjectReaderTests-215039770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:08:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-245126148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=643d8a13-ce82-409c-8440-c36601e4f2f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0967a03b26444a099e6a835bf5318cd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:08:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:08:11Z,use_quota=True,user_id='15e36ceca64444e0a9bfeb42495fbb44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:08:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-4b4d12d7-5e84-4f5c-aa5b-9ede351e7bcc tempest-ProjectReaderTests-215039770 None] Creating volume 643d8a13-ce82-409c-8440-c36601e4f2f5 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:08:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4b4d12d7-5e84-4f5c-aa5b-9ede351e7bcc tempest-ProjectReaderTests-215039770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:08:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4b4d12d7-5e84-4f5c-aa5b-9ede351e7bcc tempest-ProjectReaderTests-215039770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:08:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4b4d12d7-5e84-4f5c-aa5b-9ede351e7bcc tempest-ProjectReaderTests-215039770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:08:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4b4d12d7-5e84-4f5c-aa5b-9ede351e7bcc tempest-ProjectReaderTests-215039770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:08:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4b4d12d7-5e84-4f5c-aa5b-9ede351e7bcc tempest-ProjectReaderTests-215039770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:08:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4b4d12d7-5e84-4f5c-aa5b-9ede351e7bcc tempest-ProjectReaderTests-215039770 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:08:11 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-4b4d12d7-5e84-4f5c-aa5b-9ede351e7bcc tempest-ProjectReaderTests-215039770 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:08:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4b4d12d7-5e84-4f5c-aa5b-9ede351e7bcc tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-643d8a13-ce82-409c-8440-c36601e4f2f5 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:11 devstack sudo[108825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-643d8a13-ce82-409c-8440-c36601e4f2f5 1073741824 Sep 28 12:08:11 devstack sudo[108825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:11 devstack sudo[108825]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4b4d12d7-5e84-4f5c-aa5b-9ede351e7bcc tempest-ProjectReaderTests-215039770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-643d8a13-ce82-409c-8440-c36601e4f2f5 1073741824" returned: 0 in 0.439s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4b4d12d7-5e84-4f5c-aa5b-9ede351e7bcc tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-643d8a13-ce82-409c-8440-c36601e4f2f5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:11 devstack sudo[108831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-643d8a13-ce82-409c-8440-c36601e4f2f5 Sep 28 12:08:11 devstack sudo[108831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9d8c1de3-43ca-43be-b39f-c2521ca65fd6 tempest-ProjectMemberTests-1312558137 None] Acquiring lock "cinder-5d9e369f-c6e3-4caf-a20c-638047ab0655-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:08:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9d8c1de3-43ca-43be-b39f-c2521ca65fd6 tempest-ProjectMemberTests-1312558137 None] Lock "cinder-5d9e369f-c6e3-4caf-a20c-638047ab0655-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:08:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9d8c1de3-43ca-43be-b39f-c2521ca65fd6 tempest-ProjectMemberTests-1312558137 None] Acquiring lock "cinder-quobyte-dfb96e66-0031-42b5-b440-c49ef2971109" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:08:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9d8c1de3-43ca-43be-b39f-c2521ca65fd6 tempest-ProjectMemberTests-1312558137 None] Lock "cinder-quobyte-dfb96e66-0031-42b5-b440-c49ef2971109" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:08:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9d8c1de3-43ca-43be-b39f-c2521ca65fd6 tempest-ProjectMemberTests-1312558137 None] Acquiring lock "cinder-quobyte-5d9e369f-c6e3-4caf-a20c-638047ab0655" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:08:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9d8c1de3-43ca-43be-b39f-c2521ca65fd6 tempest-ProjectMemberTests-1312558137 None] Lock "cinder-quobyte-5d9e369f-c6e3-4caf-a20c-638047ab0655" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:08:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-9d8c1de3-43ca-43be-b39f-c2521ca65fd6 tempest-ProjectMemberTests-1312558137 None] Deleting offline snapshot 5d9e369f-c6e3-4caf-a20c-638047ab0655 of volume dfb96e66-0031-42b5-b440-c49ef2971109 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:08:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-9d8c1de3-43ca-43be-b39f-c2521ca65fd6 tempest-ProjectMemberTests-1312558137 None] snapshot_file for this snap is: volume-dfb96e66-0031-42b5-b440-c49ef2971109.5d9e369f-c6e3-4caf-a20c-638047ab0655 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:08:12 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17fcbad-d784-4b3a-84ff-3fb2d3ebf78c]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:08:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9d8c1de3-43ca-43be-b39f-c2521ca65fd6 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dfb96e66-0031-42b5-b440-c49ef2971109.5d9e369f-c6e3-4caf-a20c-638047ab0655 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:12 devstack sudo[108831]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4b4d12d7-5e84-4f5c-aa5b-9ede351e7bcc tempest-ProjectReaderTests-215039770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-643d8a13-ce82-409c-8440-c36601e4f2f5" returned: 0 in 0.261s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4b4d12d7-5e84-4f5c-aa5b-9ede351e7bcc tempest-ProjectReaderTests-215039770 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:08:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4b4d12d7-5e84-4f5c-aa5b-9ede351e7bcc tempest-ProjectReaderTests-215039770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:08:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4b4d12d7-5e84-4f5c-aa5b-9ede351e7bcc tempest-ProjectReaderTests-215039770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7cd6a75-e625-4a06-9770-061ba6b7792c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-643d8a13-ce82-409c-8440-c36601e4f2f5', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:08:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4b4d12d7-5e84-4f5c-aa5b-9ede351e7bcc tempest-ProjectReaderTests-215039770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ca06cf3-1323-441f-962b-e845728fd0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:08:12 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-4b4d12d7-5e84-4f5c-aa5b-9ede351e7bcc tempest-ProjectReaderTests-215039770 None] Volume volume-643d8a13-ce82-409c-8440-c36601e4f2f5 (643d8a13-ce82-409c-8440-c36601e4f2f5): created successfully Sep 28 12:08:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4b4d12d7-5e84-4f5c-aa5b-9ede351e7bcc tempest-ProjectReaderTests-215039770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ca06cf3-1323-441f-962b-e845728fd0b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:08:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4b4d12d7-5e84-4f5c-aa5b-9ede351e7bcc tempest-ProjectReaderTests-215039770 None] Flow 'volume_create_manager' (6a587dd9-7482-4292-ba44-cee48a0a2a23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:08:12 devstack sudo[108833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dfb96e66-0031-42b5-b440-c49ef2971109.5d9e369f-c6e3-4caf-a20c-638047ab0655 Sep 28 12:08:12 devstack sudo[108833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:12 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-4b4d12d7-5e84-4f5c-aa5b-9ede351e7bcc tempest-ProjectReaderTests-215039770 None] Created volume successfully. Sep 28 12:08:12 devstack sudo[108833]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9d8c1de3-43ca-43be-b39f-c2521ca65fd6 tempest-ProjectMemberTests-1312558137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dfb96e66-0031-42b5-b440-c49ef2971109.5d9e369f-c6e3-4caf-a20c-638047ab0655" returned: 0 in 0.374s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-9d8c1de3-43ca-43be-b39f-c2521ca65fd6 tempest-ProjectMemberTests-1312558137 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfb96e66-0031-42b5-b440-c49ef2971109(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:08:12 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[620e5910-34bf-418d-9078-ae0a7063359a]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:08:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9d8c1de3-43ca-43be-b39f-c2521ca65fd6 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dfb96e66-0031-42b5-b440-c49ef2971109 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1a76e893-fc54-4c1c-b456-6a306ba6bfad tempest-ProjectReaderTests-215039770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:08:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1a76e893-fc54-4c1c-b456-6a306ba6bfad tempest-ProjectReaderTests-215039770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:08:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-1a76e893-fc54-4c1c-b456-6a306ba6bfad tempest-ProjectReaderTests-215039770 None] Creating offline snapshot 9e5eda6c-7652-448e-8759-37dae9ca3c7f of volume 643d8a13-ce82-409c-8440-c36601e4f2f5 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:08:12 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[3010ea3d-e00e-47c3-be5f-4db2dc078411]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:08:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1a76e893-fc54-4c1c-b456-6a306ba6bfad tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-643d8a13-ce82-409c-8440-c36601e4f2f5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:12 devstack sudo[108839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dfb96e66-0031-42b5-b440-c49ef2971109 Sep 28 12:08:12 devstack sudo[108839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:12 devstack sudo[108840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-643d8a13-ce82-409c-8440-c36601e4f2f5 Sep 28 12:08:12 devstack sudo[108840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:12 devstack sudo[108839]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9d8c1de3-43ca-43be-b39f-c2521ca65fd6 tempest-ProjectMemberTests-1312558137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dfb96e66-0031-42b5-b440-c49ef2971109" returned: 0 in 0.385s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9d8c1de3-43ca-43be-b39f-c2521ca65fd6 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dfb96e66-0031-42b5-b440-c49ef2971109.5d9e369f-c6e3-4caf-a20c-638047ab0655 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:12 devstack sudo[108848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dfb96e66-0031-42b5-b440-c49ef2971109.5d9e369f-c6e3-4caf-a20c-638047ab0655 Sep 28 12:08:12 devstack sudo[108848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:13 devstack sudo[108840]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1a76e893-fc54-4c1c-b456-6a306ba6bfad tempest-ProjectReaderTests-215039770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-643d8a13-ce82-409c-8440-c36601e4f2f5" returned: 0 in 0.390s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1a76e893-fc54-4c1c-b456-6a306ba6bfad tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-643d8a13-ce82-409c-8440-c36601e4f2f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-643d8a13-ce82-409c-8440-c36601e4f2f5.9e5eda6c-7652-448e-8759-37dae9ca3c7f 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:13 devstack sudo[108851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-643d8a13-ce82-409c-8440-c36601e4f2f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-643d8a13-ce82-409c-8440-c36601e4f2f5.9e5eda6c-7652-448e-8759-37dae9ca3c7f 1G Sep 28 12:08:13 devstack sudo[108851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:13 devstack sudo[108848]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9d8c1de3-43ca-43be-b39f-c2521ca65fd6 tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dfb96e66-0031-42b5-b440-c49ef2971109.5d9e369f-c6e3-4caf-a20c-638047ab0655" returned: 0 in 0.379s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9d8c1de3-43ca-43be-b39f-c2521ca65fd6 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dfb96e66-0031-42b5-b440-c49ef2971109.5d9e369f-c6e3-4caf-a20c-638047ab0655 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:13 devstack sudo[108859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dfb96e66-0031-42b5-b440-c49ef2971109.5d9e369f-c6e3-4caf-a20c-638047ab0655 Sep 28 12:08:13 devstack sudo[108859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:13 devstack sudo[108851]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1a76e893-fc54-4c1c-b456-6a306ba6bfad tempest-ProjectReaderTests-215039770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-643d8a13-ce82-409c-8440-c36601e4f2f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-643d8a13-ce82-409c-8440-c36601e4f2f5.9e5eda6c-7652-448e-8759-37dae9ca3c7f 1G" returned: 0 in 0.449s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1a76e893-fc54-4c1c-b456-6a306ba6bfad tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-643d8a13-ce82-409c-8440-c36601e4f2f5 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-643d8a13-ce82-409c-8440-c36601e4f2f5.9e5eda6c-7652-448e-8759-37dae9ca3c7f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:13 devstack sudo[108861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-643d8a13-ce82-409c-8440-c36601e4f2f5 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-643d8a13-ce82-409c-8440-c36601e4f2f5.9e5eda6c-7652-448e-8759-37dae9ca3c7f Sep 28 12:08:13 devstack sudo[108861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:13 devstack sudo[108859]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9d8c1de3-43ca-43be-b39f-c2521ca65fd6 tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dfb96e66-0031-42b5-b440-c49ef2971109.5d9e369f-c6e3-4caf-a20c-638047ab0655" returned: 0 in 0.301s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9d8c1de3-43ca-43be-b39f-c2521ca65fd6 tempest-ProjectMemberTests-1312558137 None] Lock "cinder-quobyte-5d9e369f-c6e3-4caf-a20c-638047ab0655" released by "_delete_snapshot" :: held 1.571s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:08:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9d8c1de3-43ca-43be-b39f-c2521ca65fd6 tempest-ProjectMemberTests-1312558137 None] Lock "cinder-quobyte-dfb96e66-0031-42b5-b440-c49ef2971109" released by "delete_snapshot" :: held 1.595s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:08:13 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-9d8c1de3-43ca-43be-b39f-c2521ca65fd6 tempest-ProjectMemberTests-1312558137 None] Created reservations ['b5a925f6-9e96-4a54-8ac9-194a3fa57589', '5d6e4917-da09-429b-8ef4-10535346fd34', '74772f71-d67c-46b3-99ba-3b059cef8316', 'ec72ac2b-50ca-4f65-b25c-80b8e6dc1884'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:08:13 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-9d8c1de3-43ca-43be-b39f-c2521ca65fd6 tempest-ProjectMemberTests-1312558137 None] Delete snapshot completed successfully. Sep 28 12:08:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9d8c1de3-43ca-43be-b39f-c2521ca65fd6 tempest-ProjectMemberTests-1312558137 None] Lock "cinder-5d9e369f-c6e3-4caf-a20c-638047ab0655-delete_snapshot" released by "delete_snapshot" :: held 1.751s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:08:13 devstack sudo[108861]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1a76e893-fc54-4c1c-b456-6a306ba6bfad tempest-ProjectReaderTests-215039770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-643d8a13-ce82-409c-8440-c36601e4f2f5 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-643d8a13-ce82-409c-8440-c36601e4f2f5.9e5eda6c-7652-448e-8759-37dae9ca3c7f" returned: 0 in 0.346s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:13 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-1a76e893-fc54-4c1c-b456-6a306ba6bfad tempest-ProjectReaderTests-215039770 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-643d8a13-ce82-409c-8440-c36601e4f2f5.9e5eda6c-7652-448e-8759-37dae9ca3c7f is being set with open permissions: ugo+rw Sep 28 12:08:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1a76e893-fc54-4c1c-b456-6a306ba6bfad tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-643d8a13-ce82-409c-8440-c36601e4f2f5.9e5eda6c-7652-448e-8759-37dae9ca3c7f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:13 devstack sudo[108868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-643d8a13-ce82-409c-8440-c36601e4f2f5.9e5eda6c-7652-448e-8759-37dae9ca3c7f Sep 28 12:08:13 devstack sudo[108868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:14 devstack sudo[108868]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1a76e893-fc54-4c1c-b456-6a306ba6bfad tempest-ProjectReaderTests-215039770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-643d8a13-ce82-409c-8440-c36601e4f2f5.9e5eda6c-7652-448e-8759-37dae9ca3c7f" returned: 0 in 0.244s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1a76e893-fc54-4c1c-b456-6a306ba6bfad tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-643d8a13-ce82-409c-8440-c36601e4f2f5.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:14 devstack sudo[108875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-643d8a13-ce82-409c-8440-c36601e4f2f5.info Sep 28 12:08:14 devstack sudo[108875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6f3bfaa1-763f-48c4-947c-1daf4a6ee203 tempest-ProjectMemberTests-1312558137 None] Acquiring lock "cinder-dfb96e66-0031-42b5-b440-c49ef2971109-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:08:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6f3bfaa1-763f-48c4-947c-1daf4a6ee203 tempest-ProjectMemberTests-1312558137 None] Lock "cinder-dfb96e66-0031-42b5-b440-c49ef2971109-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:08:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6f3bfaa1-763f-48c4-947c-1daf4a6ee203 tempest-ProjectMemberTests-1312558137 None] Acquiring lock "cinder-quobyte-dfb96e66-0031-42b5-b440-c49ef2971109" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:08:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6f3bfaa1-763f-48c4-947c-1daf4a6ee203 tempest-ProjectMemberTests-1312558137 None] Lock "cinder-quobyte-dfb96e66-0031-42b5-b440-c49ef2971109" acquired by "delete_volume" :: waited 0.023s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:08:14 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[cacc588a-87dc-4d46-b5bc-e85045406253]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:08:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6f3bfaa1-763f-48c4-947c-1daf4a6ee203 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dfb96e66-0031-42b5-b440-c49ef2971109 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:14 devstack sudo[108875]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1a76e893-fc54-4c1c-b456-6a306ba6bfad tempest-ProjectReaderTests-215039770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-643d8a13-ce82-409c-8440-c36601e4f2f5.info" returned: 0 in 0.376s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:14 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-1a76e893-fc54-4c1c-b456-6a306ba6bfad tempest-ProjectReaderTests-215039770 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-643d8a13-ce82-409c-8440-c36601e4f2f5.info is being set with open permissions: ugo+rw Sep 28 12:08:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1a76e893-fc54-4c1c-b456-6a306ba6bfad tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-643d8a13-ce82-409c-8440-c36601e4f2f5.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:14 devstack sudo[108908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dfb96e66-0031-42b5-b440-c49ef2971109 Sep 28 12:08:14 devstack sudo[108908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:14 devstack sudo[108911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-643d8a13-ce82-409c-8440-c36601e4f2f5.info Sep 28 12:08:14 devstack sudo[108911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:14 devstack sudo[108911]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1a76e893-fc54-4c1c-b456-6a306ba6bfad tempest-ProjectReaderTests-215039770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-643d8a13-ce82-409c-8440-c36601e4f2f5.info" returned: 0 in 0.267s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1a76e893-fc54-4c1c-b456-6a306ba6bfad tempest-ProjectReaderTests-215039770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.159s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:08:14 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-1a76e893-fc54-4c1c-b456-6a306ba6bfad tempest-ProjectReaderTests-215039770 None] Create snapshot completed successfully Sep 28 12:08:14 devstack sudo[108908]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6f3bfaa1-763f-48c4-947c-1daf4a6ee203 tempest-ProjectMemberTests-1312558137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dfb96e66-0031-42b5-b440-c49ef2971109" returned: 0 in 0.413s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6f3bfaa1-763f-48c4-947c-1daf4a6ee203 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dfb96e66-0031-42b5-b440-c49ef2971109 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:14 devstack sudo[108918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dfb96e66-0031-42b5-b440-c49ef2971109 Sep 28 12:08:14 devstack sudo[108918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:15 devstack sudo[108918]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6f3bfaa1-763f-48c4-947c-1daf4a6ee203 tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-dfb96e66-0031-42b5-b440-c49ef2971109" returned: 0 in 0.249s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6f3bfaa1-763f-48c4-947c-1daf4a6ee203 tempest-ProjectMemberTests-1312558137 None] Lock "cinder-quobyte-dfb96e66-0031-42b5-b440-c49ef2971109" released by "delete_volume" :: held 0.757s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:08:15 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-6f3bfaa1-763f-48c4-947c-1daf4a6ee203 tempest-ProjectMemberTests-1312558137 None] Created reservations ['f344c6bd-4c39-4dfd-9ce8-4b0f8c6ddcc4', '531ebc24-de22-498c-a2c5-ec41b02200ca', 'dbc7038e-41a9-4196-81d9-e8b99c55bf8d', 'cba99828-7041-4f01-8538-9682404bcb1d'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:08:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6f3bfaa1-763f-48c4-947c-1daf4a6ee203 tempest-ProjectMemberTests-1312558137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:08:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6f3bfaa1-763f-48c4-947c-1daf4a6ee203 tempest-ProjectMemberTests-1312558137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:08:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6f3bfaa1-763f-48c4-947c-1daf4a6ee203 tempest-ProjectMemberTests-1312558137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:08:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6f3bfaa1-763f-48c4-947c-1daf4a6ee203 tempest-ProjectMemberTests-1312558137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:08:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6f3bfaa1-763f-48c4-947c-1daf4a6ee203 tempest-ProjectMemberTests-1312558137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:08:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6f3bfaa1-763f-48c4-947c-1daf4a6ee203 tempest-ProjectMemberTests-1312558137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:15 devstack sudo[108921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:08:15 devstack sudo[108921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:15 devstack sudo[108921]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6f3bfaa1-763f-48c4-947c-1daf4a6ee203 tempest-ProjectMemberTests-1312558137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.257s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:15 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-6f3bfaa1-763f-48c4-947c-1daf4a6ee203 tempest-ProjectMemberTests-1312558137 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:08:15 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-6f3bfaa1-763f-48c4-947c-1daf4a6ee203 tempest-ProjectMemberTests-1312558137 None] Deleted volume successfully. Sep 28 12:08:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6f3bfaa1-763f-48c4-947c-1daf4a6ee203 tempest-ProjectMemberTests-1312558137 None] Lock "cinder-dfb96e66-0031-42b5-b440-c49ef2971109-delete_volume" released by "delete_volume" :: held 1.263s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:08:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-277fdf26-4808-4df1-846a-4bc06af49481 tempest-ProjectReaderTests-215039770 None] Acquiring lock "cinder-9e5eda6c-7652-448e-8759-37dae9ca3c7f-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:08:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-277fdf26-4808-4df1-846a-4bc06af49481 tempest-ProjectReaderTests-215039770 None] Lock "cinder-9e5eda6c-7652-448e-8759-37dae9ca3c7f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:08:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-277fdf26-4808-4df1-846a-4bc06af49481 tempest-ProjectReaderTests-215039770 None] Acquiring lock "cinder-quobyte-643d8a13-ce82-409c-8440-c36601e4f2f5" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:08:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-277fdf26-4808-4df1-846a-4bc06af49481 tempest-ProjectReaderTests-215039770 None] Lock "cinder-quobyte-643d8a13-ce82-409c-8440-c36601e4f2f5" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:08:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-277fdf26-4808-4df1-846a-4bc06af49481 tempest-ProjectReaderTests-215039770 None] Acquiring lock "cinder-quobyte-9e5eda6c-7652-448e-8759-37dae9ca3c7f" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:08:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-277fdf26-4808-4df1-846a-4bc06af49481 tempest-ProjectReaderTests-215039770 None] Lock "cinder-quobyte-9e5eda6c-7652-448e-8759-37dae9ca3c7f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:08:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-277fdf26-4808-4df1-846a-4bc06af49481 tempest-ProjectReaderTests-215039770 None] Deleting offline snapshot 9e5eda6c-7652-448e-8759-37dae9ca3c7f of volume 643d8a13-ce82-409c-8440-c36601e4f2f5 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:08:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-277fdf26-4808-4df1-846a-4bc06af49481 tempest-ProjectReaderTests-215039770 None] snapshot_file for this snap is: volume-643d8a13-ce82-409c-8440-c36601e4f2f5.9e5eda6c-7652-448e-8759-37dae9ca3c7f {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:08:15 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bce4ab0-ca0d-4fd6-b2fe-743f133f7ba2]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:08:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-277fdf26-4808-4df1-846a-4bc06af49481 tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-643d8a13-ce82-409c-8440-c36601e4f2f5.9e5eda6c-7652-448e-8759-37dae9ca3c7f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:15 devstack sudo[108924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-643d8a13-ce82-409c-8440-c36601e4f2f5.9e5eda6c-7652-448e-8759-37dae9ca3c7f Sep 28 12:08:15 devstack sudo[108924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:16 devstack sudo[108924]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-277fdf26-4808-4df1-846a-4bc06af49481 tempest-ProjectReaderTests-215039770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-643d8a13-ce82-409c-8440-c36601e4f2f5.9e5eda6c-7652-448e-8759-37dae9ca3c7f" returned: 0 in 0.419s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-277fdf26-4808-4df1-846a-4bc06af49481 tempest-ProjectReaderTests-215039770 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-643d8a13-ce82-409c-8440-c36601e4f2f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:08:16 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[71bc09d6-b522-4259-85f2-f4574adc5966]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:08:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-277fdf26-4808-4df1-846a-4bc06af49481 tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-643d8a13-ce82-409c-8440-c36601e4f2f5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:16 devstack sudo[108931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-643d8a13-ce82-409c-8440-c36601e4f2f5 Sep 28 12:08:16 devstack sudo[108931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:16 devstack sudo[108931]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-277fdf26-4808-4df1-846a-4bc06af49481 tempest-ProjectReaderTests-215039770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-643d8a13-ce82-409c-8440-c36601e4f2f5" returned: 0 in 0.444s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-277fdf26-4808-4df1-846a-4bc06af49481 tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-643d8a13-ce82-409c-8440-c36601e4f2f5.9e5eda6c-7652-448e-8759-37dae9ca3c7f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:16 devstack sudo[108942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-643d8a13-ce82-409c-8440-c36601e4f2f5.9e5eda6c-7652-448e-8759-37dae9ca3c7f Sep 28 12:08:16 devstack sudo[108942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:17 devstack sudo[108942]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-277fdf26-4808-4df1-846a-4bc06af49481 tempest-ProjectReaderTests-215039770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-643d8a13-ce82-409c-8440-c36601e4f2f5.9e5eda6c-7652-448e-8759-37dae9ca3c7f" returned: 0 in 0.408s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-277fdf26-4808-4df1-846a-4bc06af49481 tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-643d8a13-ce82-409c-8440-c36601e4f2f5.9e5eda6c-7652-448e-8759-37dae9ca3c7f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:17 devstack sudo[108948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-643d8a13-ce82-409c-8440-c36601e4f2f5.9e5eda6c-7652-448e-8759-37dae9ca3c7f Sep 28 12:08:17 devstack sudo[108948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:17 devstack sudo[108948]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-277fdf26-4808-4df1-846a-4bc06af49481 tempest-ProjectReaderTests-215039770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-643d8a13-ce82-409c-8440-c36601e4f2f5.9e5eda6c-7652-448e-8759-37dae9ca3c7f" returned: 0 in 0.259s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-277fdf26-4808-4df1-846a-4bc06af49481 tempest-ProjectReaderTests-215039770 None] Lock "cinder-quobyte-9e5eda6c-7652-448e-8759-37dae9ca3c7f" released by "_delete_snapshot" :: held 1.652s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:08:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-277fdf26-4808-4df1-846a-4bc06af49481 tempest-ProjectReaderTests-215039770 None] Lock "cinder-quobyte-643d8a13-ce82-409c-8440-c36601e4f2f5" released by "delete_snapshot" :: held 1.678s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:08:17 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-277fdf26-4808-4df1-846a-4bc06af49481 tempest-ProjectReaderTests-215039770 None] Created reservations ['d1502dc2-d294-4145-a175-8d7ea0695037', '28c840a2-59cf-4bdc-bbc6-3a32d3b70056', 'efaa6c3d-8e1b-4b5e-bf14-30de4543b133', '6d9e9cce-709f-4d24-946e-41644aec1125'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:08:17 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-277fdf26-4808-4df1-846a-4bc06af49481 tempest-ProjectReaderTests-215039770 None] Delete snapshot completed successfully. Sep 28 12:08:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-277fdf26-4808-4df1-846a-4bc06af49481 tempest-ProjectReaderTests-215039770 None] Lock "cinder-9e5eda6c-7652-448e-8759-37dae9ca3c7f-delete_snapshot" released by "delete_snapshot" :: held 1.874s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:08:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f65cec90-6821-4298-8869-e4b316f1bf74 tempest-ProjectReaderTests-215039770 None] Acquiring lock "cinder-643d8a13-ce82-409c-8440-c36601e4f2f5-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:08:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f65cec90-6821-4298-8869-e4b316f1bf74 tempest-ProjectReaderTests-215039770 None] Lock "cinder-643d8a13-ce82-409c-8440-c36601e4f2f5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:08:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f65cec90-6821-4298-8869-e4b316f1bf74 tempest-ProjectReaderTests-215039770 None] Acquiring lock "cinder-quobyte-643d8a13-ce82-409c-8440-c36601e4f2f5" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:08:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f65cec90-6821-4298-8869-e4b316f1bf74 tempest-ProjectReaderTests-215039770 None] Lock "cinder-quobyte-643d8a13-ce82-409c-8440-c36601e4f2f5" acquired by "delete_volume" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:08:18 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea770986-5201-461c-944f-428fc2e48ac9]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:08:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f65cec90-6821-4298-8869-e4b316f1bf74 tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-643d8a13-ce82-409c-8440-c36601e4f2f5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:18 devstack sudo[108951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-643d8a13-ce82-409c-8440-c36601e4f2f5 Sep 28 12:08:18 devstack sudo[108951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:18 devstack sudo[108951]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f65cec90-6821-4298-8869-e4b316f1bf74 tempest-ProjectReaderTests-215039770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-643d8a13-ce82-409c-8440-c36601e4f2f5" returned: 0 in 0.421s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f65cec90-6821-4298-8869-e4b316f1bf74 tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-643d8a13-ce82-409c-8440-c36601e4f2f5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:18 devstack sudo[108956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-643d8a13-ce82-409c-8440-c36601e4f2f5 Sep 28 12:08:18 devstack sudo[108956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:18 devstack sudo[108956]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f65cec90-6821-4298-8869-e4b316f1bf74 tempest-ProjectReaderTests-215039770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-643d8a13-ce82-409c-8440-c36601e4f2f5" returned: 0 in 0.272s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f65cec90-6821-4298-8869-e4b316f1bf74 tempest-ProjectReaderTests-215039770 None] Lock "cinder-quobyte-643d8a13-ce82-409c-8440-c36601e4f2f5" released by "delete_volume" :: held 0.770s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:08:18 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-f65cec90-6821-4298-8869-e4b316f1bf74 tempest-ProjectReaderTests-215039770 None] Created reservations ['fd78e8ac-9f05-446c-a3dd-35639a8cc72f', '1b728a3b-318c-42a6-a0d6-63bbecdc5a18', '85a16c19-0cfb-4c3f-8cf1-fbc1371f98a3', '8fef4919-f43f-41cf-a492-b30da8f0cce0'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:08:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f65cec90-6821-4298-8869-e4b316f1bf74 tempest-ProjectReaderTests-215039770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:08:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f65cec90-6821-4298-8869-e4b316f1bf74 tempest-ProjectReaderTests-215039770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:08:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f65cec90-6821-4298-8869-e4b316f1bf74 tempest-ProjectReaderTests-215039770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:08:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f65cec90-6821-4298-8869-e4b316f1bf74 tempest-ProjectReaderTests-215039770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:08:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f65cec90-6821-4298-8869-e4b316f1bf74 tempest-ProjectReaderTests-215039770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:08:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f65cec90-6821-4298-8869-e4b316f1bf74 tempest-ProjectReaderTests-215039770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:18 devstack sudo[108959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:08:18 devstack sudo[108959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:19 devstack sudo[108959]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f65cec90-6821-4298-8869-e4b316f1bf74 tempest-ProjectReaderTests-215039770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.318s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:19 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-f65cec90-6821-4298-8869-e4b316f1bf74 tempest-ProjectReaderTests-215039770 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:08:19 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-f65cec90-6821-4298-8869-e4b316f1bf74 tempest-ProjectReaderTests-215039770 None] Deleted volume successfully. Sep 28 12:08:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f65cec90-6821-4298-8869-e4b316f1bf74 tempest-ProjectReaderTests-215039770 None] Lock "cinder-643d8a13-ce82-409c-8440-c36601e4f2f5-delete_volume" released by "delete_volume" :: held 1.314s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:08:28 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=157,cinder:UPDATE=234,cinder:DELETE=23,cinder:INSERT=61 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:08:29 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=187,cinder:UPDATE=237,cinder:INSERT=63,cinder:DELETE=17 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:08:38 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:08:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:08:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:08:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:08:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:08:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:08:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:38 devstack sudo[108966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:08:38 devstack sudo[108966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:38 devstack sudo[108966]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.299s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:38 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:08:38 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:08:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] thread count: 28 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:08:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a27558c1-9353-4bdf-8de5-557f844af6d1 None None] thread info: [<_MainThread(MainThread, started 135408582168704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:08:39 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d40a1f4-c83c-4962-8207-e0b704a06fa9 tempest-SnapshotDependencyTests-1114162996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:08:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3d40a1f4-c83c-4962-8207-e0b704a06fa9 tempest-SnapshotDependencyTests-1114162996 None] Flow 'volume_create_manager' (486d40f6-7204-4a88-8850-693e87cb1ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:08:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3d40a1f4-c83c-4962-8207-e0b704a06fa9 tempest-SnapshotDependencyTests-1114162996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaa02426-f8cc-4469-a516-edc2c3ea204c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:08:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3d40a1f4-c83c-4962-8207-e0b704a06fa9 tempest-SnapshotDependencyTests-1114162996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaa02426-f8cc-4469-a516-edc2c3ea204c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-881839863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b999e947-663f-44c1-b4af-fb2bb373b328,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88c92252047c4d629620ef4d8a348724',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:08:40Z,use_quota=True,user_id='0cc455b30f64452cb3ff48c62a9bdeba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:08:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3d40a1f4-c83c-4962-8207-e0b704a06fa9 tempest-SnapshotDependencyTests-1114162996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91384b86-4c6b-4036-a0a4-66b6bd6228cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:08:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3d40a1f4-c83c-4962-8207-e0b704a06fa9 tempest-SnapshotDependencyTests-1114162996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91384b86-4c6b-4036-a0a4-66b6bd6228cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:08:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3d40a1f4-c83c-4962-8207-e0b704a06fa9 tempest-SnapshotDependencyTests-1114162996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14eeeed4-21a9-428f-a18c-fa2ac59c87da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:08:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3d40a1f4-c83c-4962-8207-e0b704a06fa9 tempest-SnapshotDependencyTests-1114162996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14eeeed4-21a9-428f-a18c-fa2ac59c87da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b999e947-663f-44c1-b4af-fb2bb373b328', 'volume_name': 'volume-b999e947-663f-44c1-b4af-fb2bb373b328', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:08:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3d40a1f4-c83c-4962-8207-e0b704a06fa9 tempest-SnapshotDependencyTests-1114162996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bcac057-2971-4a25-9501-97949303be9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:08:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3d40a1f4-c83c-4962-8207-e0b704a06fa9 tempest-SnapshotDependencyTests-1114162996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bcac057-2971-4a25-9501-97949303be9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:08:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3d40a1f4-c83c-4962-8207-e0b704a06fa9 tempest-SnapshotDependencyTests-1114162996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb4996a6-4e38-4f12-b59e-aa149615a7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:08:39 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-3d40a1f4-c83c-4962-8207-e0b704a06fa9 tempest-SnapshotDependencyTests-1114162996 None] Volume b999e947-663f-44c1-b4af-fb2bb373b328: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b999e947-663f-44c1-b4af-fb2bb373b328', 'volume_size': 1} Sep 28 12:08:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3d40a1f4-c83c-4962-8207-e0b704a06fa9 tempest-SnapshotDependencyTests-1114162996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:08:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3d40a1f4-c83c-4962-8207-e0b704a06fa9 tempest-SnapshotDependencyTests-1114162996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:08:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3d40a1f4-c83c-4962-8207-e0b704a06fa9 tempest-SnapshotDependencyTests-1114162996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-881839863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b999e947-663f-44c1-b4af-fb2bb373b328,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88c92252047c4d629620ef4d8a348724',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:08:40Z,use_quota=True,user_id='0cc455b30f64452cb3ff48c62a9bdeba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:08:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-3d40a1f4-c83c-4962-8207-e0b704a06fa9 tempest-SnapshotDependencyTests-1114162996 None] Creating volume b999e947-663f-44c1-b4af-fb2bb373b328 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:08:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3d40a1f4-c83c-4962-8207-e0b704a06fa9 tempest-SnapshotDependencyTests-1114162996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:08:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3d40a1f4-c83c-4962-8207-e0b704a06fa9 tempest-SnapshotDependencyTests-1114162996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:08:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3d40a1f4-c83c-4962-8207-e0b704a06fa9 tempest-SnapshotDependencyTests-1114162996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:08:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3d40a1f4-c83c-4962-8207-e0b704a06fa9 tempest-SnapshotDependencyTests-1114162996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:08:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3d40a1f4-c83c-4962-8207-e0b704a06fa9 tempest-SnapshotDependencyTests-1114162996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:08:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3d40a1f4-c83c-4962-8207-e0b704a06fa9 tempest-SnapshotDependencyTests-1114162996 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:08:39 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-3d40a1f4-c83c-4962-8207-e0b704a06fa9 tempest-SnapshotDependencyTests-1114162996 None] casted to osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 Sep 28 12:08:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3d40a1f4-c83c-4962-8207-e0b704a06fa9 tempest-SnapshotDependencyTests-1114162996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b999e947-663f-44c1-b4af-fb2bb373b328 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:39 devstack sudo[108969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b999e947-663f-44c1-b4af-fb2bb373b328 1073741824 Sep 28 12:08:39 devstack sudo[108969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:40 devstack sudo[108969]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3d40a1f4-c83c-4962-8207-e0b704a06fa9 tempest-SnapshotDependencyTests-1114162996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b999e947-663f-44c1-b4af-fb2bb373b328 1073741824" returned: 0 in 0.445s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3d40a1f4-c83c-4962-8207-e0b704a06fa9 tempest-SnapshotDependencyTests-1114162996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b999e947-663f-44c1-b4af-fb2bb373b328 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:40 devstack sudo[108975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b999e947-663f-44c1-b4af-fb2bb373b328 Sep 28 12:08:40 devstack sudo[108975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:40 devstack sudo[108975]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3d40a1f4-c83c-4962-8207-e0b704a06fa9 tempest-SnapshotDependencyTests-1114162996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b999e947-663f-44c1-b4af-fb2bb373b328" returned: 0 in 0.238s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3d40a1f4-c83c-4962-8207-e0b704a06fa9 tempest-SnapshotDependencyTests-1114162996 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:08:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3d40a1f4-c83c-4962-8207-e0b704a06fa9 tempest-SnapshotDependencyTests-1114162996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:08:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3d40a1f4-c83c-4962-8207-e0b704a06fa9 tempest-SnapshotDependencyTests-1114162996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb4996a6-4e38-4f12-b59e-aa149615a7c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b999e947-663f-44c1-b4af-fb2bb373b328', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:08:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3d40a1f4-c83c-4962-8207-e0b704a06fa9 tempest-SnapshotDependencyTests-1114162996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d39409ec-036f-4318-bfb2-da86c592f7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:08:40 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-3d40a1f4-c83c-4962-8207-e0b704a06fa9 tempest-SnapshotDependencyTests-1114162996 None] Volume volume-b999e947-663f-44c1-b4af-fb2bb373b328 (b999e947-663f-44c1-b4af-fb2bb373b328): created successfully Sep 28 12:08:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3d40a1f4-c83c-4962-8207-e0b704a06fa9 tempest-SnapshotDependencyTests-1114162996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d39409ec-036f-4318-bfb2-da86c592f7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:08:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3d40a1f4-c83c-4962-8207-e0b704a06fa9 tempest-SnapshotDependencyTests-1114162996 None] Flow 'volume_create_manager' (486d40f6-7204-4a88-8850-693e87cb1ed9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:08:40 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-3d40a1f4-c83c-4962-8207-e0b704a06fa9 tempest-SnapshotDependencyTests-1114162996 None] Created volume successfully. Sep 28 12:08:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f433c843-788b-477f-a74d-bf15576fbd0c tempest-SnapshotDependencyTests-1114162996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:08:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f433c843-788b-477f-a74d-bf15576fbd0c tempest-SnapshotDependencyTests-1114162996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:08:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-f433c843-788b-477f-a74d-bf15576fbd0c tempest-SnapshotDependencyTests-1114162996 None] Creating offline snapshot 08a28661-e2a6-4f34-a69e-b68c9f320a47 of volume b999e947-663f-44c1-b4af-fb2bb373b328 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:08:41 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f08ffc-4eb8-4dd0-8197-e20be578fe75]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:08:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f433c843-788b-477f-a74d-bf15576fbd0c tempest-SnapshotDependencyTests-1114162996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b999e947-663f-44c1-b4af-fb2bb373b328 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:41 devstack sudo[108979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b999e947-663f-44c1-b4af-fb2bb373b328 Sep 28 12:08:41 devstack sudo[108979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:41 devstack sudo[108979]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f433c843-788b-477f-a74d-bf15576fbd0c tempest-SnapshotDependencyTests-1114162996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b999e947-663f-44c1-b4af-fb2bb373b328" returned: 0 in 0.359s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f433c843-788b-477f-a74d-bf15576fbd0c tempest-SnapshotDependencyTests-1114162996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b999e947-663f-44c1-b4af-fb2bb373b328,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b999e947-663f-44c1-b4af-fb2bb373b328.08a28661-e2a6-4f34-a69e-b68c9f320a47 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:41 devstack sudo[108984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b999e947-663f-44c1-b4af-fb2bb373b328,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b999e947-663f-44c1-b4af-fb2bb373b328.08a28661-e2a6-4f34-a69e-b68c9f320a47 1G Sep 28 12:08:41 devstack sudo[108984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:41 devstack sudo[108984]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f433c843-788b-477f-a74d-bf15576fbd0c tempest-SnapshotDependencyTests-1114162996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b999e947-663f-44c1-b4af-fb2bb373b328,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b999e947-663f-44c1-b4af-fb2bb373b328.08a28661-e2a6-4f34-a69e-b68c9f320a47 1G" returned: 0 in 0.455s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f433c843-788b-477f-a74d-bf15576fbd0c tempest-SnapshotDependencyTests-1114162996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b999e947-663f-44c1-b4af-fb2bb373b328 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b999e947-663f-44c1-b4af-fb2bb373b328.08a28661-e2a6-4f34-a69e-b68c9f320a47 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:41 devstack sudo[108989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b999e947-663f-44c1-b4af-fb2bb373b328 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b999e947-663f-44c1-b4af-fb2bb373b328.08a28661-e2a6-4f34-a69e-b68c9f320a47 Sep 28 12:08:41 devstack sudo[108989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:42 devstack sudo[108989]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f433c843-788b-477f-a74d-bf15576fbd0c tempest-SnapshotDependencyTests-1114162996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b999e947-663f-44c1-b4af-fb2bb373b328 -F qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b999e947-663f-44c1-b4af-fb2bb373b328.08a28661-e2a6-4f34-a69e-b68c9f320a47" returned: 0 in 0.327s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:42 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-f433c843-788b-477f-a74d-bf15576fbd0c tempest-SnapshotDependencyTests-1114162996 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b999e947-663f-44c1-b4af-fb2bb373b328.08a28661-e2a6-4f34-a69e-b68c9f320a47 is being set with open permissions: ugo+rw Sep 28 12:08:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f433c843-788b-477f-a74d-bf15576fbd0c tempest-SnapshotDependencyTests-1114162996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b999e947-663f-44c1-b4af-fb2bb373b328.08a28661-e2a6-4f34-a69e-b68c9f320a47 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:42 devstack sudo[108994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b999e947-663f-44c1-b4af-fb2bb373b328.08a28661-e2a6-4f34-a69e-b68c9f320a47 Sep 28 12:08:42 devstack sudo[108994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:42 devstack sudo[108994]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f433c843-788b-477f-a74d-bf15576fbd0c tempest-SnapshotDependencyTests-1114162996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b999e947-663f-44c1-b4af-fb2bb373b328.08a28661-e2a6-4f34-a69e-b68c9f320a47" returned: 0 in 0.279s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f433c843-788b-477f-a74d-bf15576fbd0c tempest-SnapshotDependencyTests-1114162996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b999e947-663f-44c1-b4af-fb2bb373b328.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:42 devstack sudo[108997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b999e947-663f-44c1-b4af-fb2bb373b328.info Sep 28 12:08:42 devstack sudo[108997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:42 devstack sudo[108997]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f433c843-788b-477f-a74d-bf15576fbd0c tempest-SnapshotDependencyTests-1114162996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b999e947-663f-44c1-b4af-fb2bb373b328.info" returned: 0 in 0.275s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:42 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-f433c843-788b-477f-a74d-bf15576fbd0c tempest-SnapshotDependencyTests-1114162996 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b999e947-663f-44c1-b4af-fb2bb373b328.info is being set with open permissions: ugo+rw Sep 28 12:08:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f433c843-788b-477f-a74d-bf15576fbd0c tempest-SnapshotDependencyTests-1114162996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b999e947-663f-44c1-b4af-fb2bb373b328.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:42 devstack sudo[109000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b999e947-663f-44c1-b4af-fb2bb373b328.info Sep 28 12:08:42 devstack sudo[109000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:43 devstack sudo[109000]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f433c843-788b-477f-a74d-bf15576fbd0c tempest-SnapshotDependencyTests-1114162996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b999e947-663f-44c1-b4af-fb2bb373b328.info" returned: 0 in 0.276s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f433c843-788b-477f-a74d-bf15576fbd0c tempest-SnapshotDependencyTests-1114162996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.067s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:08:43 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-f433c843-788b-477f-a74d-bf15576fbd0c tempest-SnapshotDependencyTests-1114162996 None] Create snapshot completed successfully Sep 28 12:08:44 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5045ee6-5ad8-432d-90d6-e99b89fea71b tempest-SnapshotDependencyTests-1114162996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:08:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a5045ee6-5ad8-432d-90d6-e99b89fea71b tempest-SnapshotDependencyTests-1114162996 None] Flow 'volume_create_manager' (2ee595b4-bfbf-4a5e-bd1c-42cafbb9fc31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:08:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a5045ee6-5ad8-432d-90d6-e99b89fea71b tempest-SnapshotDependencyTests-1114162996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a8c35a7-6124-4bde-8d59-587a80e13770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:08:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a5045ee6-5ad8-432d-90d6-e99b89fea71b tempest-SnapshotDependencyTests-1114162996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a8c35a7-6124-4bde-8d59-587a80e13770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:08:45Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23fedc7f-2949-4e71-8ed4-347db74b6cc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88c92252047c4d629620ef4d8a348724',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:08:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=08a28661-e2a6-4f34-a69e-b68c9f320a47,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:08:45Z,use_quota=True,user_id='0cc455b30f64452cb3ff48c62a9bdeba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae98c7ad-10da-4933-8848-12b166e26e15),volume_type_id=ae98c7ad-10da-4933-8848-12b166e26e15)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:08:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a5045ee6-5ad8-432d-90d6-e99b89fea71b tempest-SnapshotDependencyTests-1114162996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a461b635-6343-4de6-b8cd-79dc46c14f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:08:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a5045ee6-5ad8-432d-90d6-e99b89fea71b tempest-SnapshotDependencyTests-1114162996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a461b635-6343-4de6-b8cd-79dc46c14f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:08:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a5045ee6-5ad8-432d-90d6-e99b89fea71b tempest-SnapshotDependencyTests-1114162996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8ce1966-a310-47ac-bc9b-f4fd038f9095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:08:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a5045ee6-5ad8-432d-90d6-e99b89fea71b tempest-SnapshotDependencyTests-1114162996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8ce1966-a310-47ac-bc9b-f4fd038f9095) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '23fedc7f-2949-4e71-8ed4-347db74b6cc2', 'volume_name': 'volume-23fedc7f-2949-4e71-8ed4-347db74b6cc2', 'volume_size': 1, 'snapshot_id': '08a28661-e2a6-4f34-a69e-b68c9f320a47'}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:08:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a5045ee6-5ad8-432d-90d6-e99b89fea71b tempest-SnapshotDependencyTests-1114162996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41e3b964-f6c2-4980-9170-50b29072f4bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:08:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a5045ee6-5ad8-432d-90d6-e99b89fea71b tempest-SnapshotDependencyTests-1114162996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41e3b964-f6c2-4980-9170-50b29072f4bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:08:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a5045ee6-5ad8-432d-90d6-e99b89fea71b tempest-SnapshotDependencyTests-1114162996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be8219ca-ecf5-4da4-9bd1-b64f8891da85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:08:44 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-a5045ee6-5ad8-432d-90d6-e99b89fea71b tempest-SnapshotDependencyTests-1114162996 None] Volume 23fedc7f-2949-4e71-8ed4-347db74b6cc2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-23fedc7f-2949-4e71-8ed4-347db74b6cc2', 'volume_size': 1, 'snapshot_id': '08a28661-e2a6-4f34-a69e-b68c9f320a47'} Sep 28 12:08:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a5045ee6-5ad8-432d-90d6-e99b89fea71b tempest-SnapshotDependencyTests-1114162996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:08:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a5045ee6-5ad8-432d-90d6-e99b89fea71b tempest-SnapshotDependencyTests-1114162996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:08:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a5045ee6-5ad8-432d-90d6-e99b89fea71b tempest-SnapshotDependencyTests-1114162996 None] Acquiring lock "cinder-quobyte-08a28661-e2a6-4f34-a69e-b68c9f320a47-23fedc7f-2949-4e71-8ed4-347db74b6cc2" by "_create_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:08:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a5045ee6-5ad8-432d-90d6-e99b89fea71b tempest-SnapshotDependencyTests-1114162996 None] Lock "cinder-quobyte-08a28661-e2a6-4f34-a69e-b68c9f320a47-23fedc7f-2949-4e71-8ed4-347db74b6cc2" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:08:44 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a5045ee6-5ad8-432d-90d6-e99b89fea71b tempest-SnapshotDependencyTests-1114162996 None] Creating volume 23fedc7f-2949-4e71-8ed4-347db74b6cc2 from snapshot 08a28661-e2a6-4f34-a69e-b68c9f320a47 {{(pid=86916) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 12:08:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a5045ee6-5ad8-432d-90d6-e99b89fea71b tempest-SnapshotDependencyTests-1114162996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:08:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a5045ee6-5ad8-432d-90d6-e99b89fea71b tempest-SnapshotDependencyTests-1114162996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:08:44 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a5045ee6-5ad8-432d-90d6-e99b89fea71b tempest-SnapshotDependencyTests-1114162996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:08:44 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a5045ee6-5ad8-432d-90d6-e99b89fea71b tempest-SnapshotDependencyTests-1114162996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:08:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a5045ee6-5ad8-432d-90d6-e99b89fea71b tempest-SnapshotDependencyTests-1114162996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:08:44 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a5045ee6-5ad8-432d-90d6-e99b89fea71b tempest-SnapshotDependencyTests-1114162996 None] Selected osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0 as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:08:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a5045ee6-5ad8-432d-90d6-e99b89fea71b tempest-SnapshotDependencyTests-1114162996 None] Acquiring lock "cinder-quobyte-23fedc7f-2949-4e71-8ed4-347db74b6cc2" by "_copy_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:08:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a5045ee6-5ad8-432d-90d6-e99b89fea71b tempest-SnapshotDependencyTests-1114162996 None] Lock "cinder-quobyte-23fedc7f-2949-4e71-8ed4-347db74b6cc2" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:08:44 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a5045ee6-5ad8-432d-90d6-e99b89fea71b tempest-SnapshotDependencyTests-1114162996 None] snapshot: 08a28661-e2a6-4f34-a69e-b68c9f320a47, volume: 23fedc7f-2949-4e71-8ed4-347db74b6cc2, {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 12:08:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a5045ee6-5ad8-432d-90d6-e99b89fea71b tempest-SnapshotDependencyTests-1114162996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:08:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a5045ee6-5ad8-432d-90d6-e99b89fea71b tempest-SnapshotDependencyTests-1114162996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:08:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a5045ee6-5ad8-432d-90d6-e99b89fea71b tempest-SnapshotDependencyTests-1114162996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:08:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a5045ee6-5ad8-432d-90d6-e99b89fea71b tempest-SnapshotDependencyTests-1114162996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:08:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a5045ee6-5ad8-432d-90d6-e99b89fea71b tempest-SnapshotDependencyTests-1114162996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:08:45 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a470ad-0fee-44ca-91f8-1c21a732297e]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:08:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a5045ee6-5ad8-432d-90d6-e99b89fea71b tempest-SnapshotDependencyTests-1114162996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b999e947-663f-44c1-b4af-fb2bb373b328.08a28661-e2a6-4f34-a69e-b68c9f320a47 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:45 devstack sudo[109003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b999e947-663f-44c1-b4af-fb2bb373b328.08a28661-e2a6-4f34-a69e-b68c9f320a47 Sep 28 12:08:45 devstack sudo[109003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:45 devstack sudo[109003]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a5045ee6-5ad8-432d-90d6-e99b89fea71b tempest-SnapshotDependencyTests-1114162996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b999e947-663f-44c1-b4af-fb2bb373b328.08a28661-e2a6-4f34-a69e-b68c9f320a47" returned: 0 in 0.358s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-a5045ee6-5ad8-432d-90d6-e99b89fea71b tempest-SnapshotDependencyTests-1114162996 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b999e947-663f-44c1-b4af-fb2bb373b328(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:08:45 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3bcd30f-6740-41e1-9ef2-a480b1361731]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:08:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a5045ee6-5ad8-432d-90d6-e99b89fea71b tempest-SnapshotDependencyTests-1114162996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b999e947-663f-44c1-b4af-fb2bb373b328 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:45 devstack sudo[109008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b999e947-663f-44c1-b4af-fb2bb373b328 Sep 28 12:08:45 devstack sudo[109008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:45 devstack sudo[109008]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a5045ee6-5ad8-432d-90d6-e99b89fea71b tempest-SnapshotDependencyTests-1114162996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b999e947-663f-44c1-b4af-fb2bb373b328" returned: 0 in 0.375s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a5045ee6-5ad8-432d-90d6-e99b89fea71b tempest-SnapshotDependencyTests-1114162996 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b999e947-663f-44c1-b4af-fb2bb373b328 {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 12:08:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a5045ee6-5ad8-432d-90d6-e99b89fea71b tempest-SnapshotDependencyTests-1114162996 None] Creating direct copy from snapshot {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 12:08:45 devstack cinder-volume[86916]: DEBUG cinder.utils [None req-a5045ee6-5ad8-432d-90d6-e99b89fea71b tempest-SnapshotDependencyTests-1114162996 None] Path /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-23fedc7f-2949-4e71-8ed4-347db74b6cc2 not found in is_blk_device check {{(pid=86916) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 12:08:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a5045ee6-5ad8-432d-90d6-e99b89fea71b tempest-SnapshotDependencyTests-1114162996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b999e947-663f-44c1-b4af-fb2bb373b328 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-23fedc7f-2949-4e71-8ed4-347db74b6cc2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:45 devstack sudo[109013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b999e947-663f-44c1-b4af-fb2bb373b328 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-23fedc7f-2949-4e71-8ed4-347db74b6cc2 Sep 28 12:08:45 devstack sudo[109013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:51 devstack sudo[109013]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a5045ee6-5ad8-432d-90d6-e99b89fea71b tempest-SnapshotDependencyTests-1114162996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b999e947-663f-44c1-b4af-fb2bb373b328 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-23fedc7f-2949-4e71-8ed4-347db74b6cc2" returned: 0 in 5.613s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:51 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-a5045ee6-5ad8-432d-90d6-e99b89fea71b tempest-SnapshotDependencyTests-1114162996 None] Image conversion details: src /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b999e947-663f-44c1-b4af-fb2bb373b328, size 1024.00 MB, duration 5.61 sec, destination /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-23fedc7f-2949-4e71-8ed4-347db74b6cc2 {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:08:51 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-a5045ee6-5ad8-432d-90d6-e99b89fea71b tempest-SnapshotDependencyTests-1114162996 None] Converted 1024.00 MB image at 182.40 MB/s Sep 28 12:08:51 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-a5045ee6-5ad8-432d-90d6-e99b89fea71b tempest-SnapshotDependencyTests-1114162996 None] /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-23fedc7f-2949-4e71-8ed4-347db74b6cc2 is being set with open permissions: ugo+rw Sep 28 12:08:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a5045ee6-5ad8-432d-90d6-e99b89fea71b tempest-SnapshotDependencyTests-1114162996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-23fedc7f-2949-4e71-8ed4-347db74b6cc2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:51 devstack sudo[109027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-23fedc7f-2949-4e71-8ed4-347db74b6cc2 Sep 28 12:08:51 devstack sudo[109027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:51 devstack sudo[109027]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a5045ee6-5ad8-432d-90d6-e99b89fea71b tempest-SnapshotDependencyTests-1114162996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-23fedc7f-2949-4e71-8ed4-347db74b6cc2" returned: 0 in 0.260s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a5045ee6-5ad8-432d-90d6-e99b89fea71b tempest-SnapshotDependencyTests-1114162996 None] Lock "cinder-quobyte-23fedc7f-2949-4e71-8ed4-347db74b6cc2" released by "_copy_volume_from_snapshot" :: held 6.688s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:08:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a5045ee6-5ad8-432d-90d6-e99b89fea71b tempest-SnapshotDependencyTests-1114162996 None] Lock "cinder-quobyte-08a28661-e2a6-4f34-a69e-b68c9f320a47-23fedc7f-2949-4e71-8ed4-347db74b6cc2" released by "_create_volume_from_snapshot" :: held 6.746s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:08:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a5045ee6-5ad8-432d-90d6-e99b89fea71b tempest-SnapshotDependencyTests-1114162996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.761s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:08:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a5045ee6-5ad8-432d-90d6-e99b89fea71b tempest-SnapshotDependencyTests-1114162996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be8219ca-ecf5-4da4-9bd1-b64f8891da85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23fedc7f-2949-4e71-8ed4-347db74b6cc2', 'volume_size': 1, 'snapshot_id': '08a28661-e2a6-4f34-a69e-b68c9f320a47'}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:08:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a5045ee6-5ad8-432d-90d6-e99b89fea71b tempest-SnapshotDependencyTests-1114162996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8483637-d47d-4ff4-81b3-7568836241f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:08:51 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-a5045ee6-5ad8-432d-90d6-e99b89fea71b tempest-SnapshotDependencyTests-1114162996 None] Volume volume-23fedc7f-2949-4e71-8ed4-347db74b6cc2 (23fedc7f-2949-4e71-8ed4-347db74b6cc2): created successfully Sep 28 12:08:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a5045ee6-5ad8-432d-90d6-e99b89fea71b tempest-SnapshotDependencyTests-1114162996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8483637-d47d-4ff4-81b3-7568836241f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:08:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a5045ee6-5ad8-432d-90d6-e99b89fea71b tempest-SnapshotDependencyTests-1114162996 None] Flow 'volume_create_manager' (2ee595b4-bfbf-4a5e-bd1c-42cafbb9fc31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:08:51 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-a5045ee6-5ad8-432d-90d6-e99b89fea71b tempest-SnapshotDependencyTests-1114162996 None] Created volume successfully. Sep 28 12:08:52 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-cff5c457-a5f0-41a9-b9a8-e263d9877811 tempest-SnapshotDependencyTests-1114162996 None] Acquiring lock "cinder-08a28661-e2a6-4f34-a69e-b68c9f320a47-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:08:52 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-cff5c457-a5f0-41a9-b9a8-e263d9877811 tempest-SnapshotDependencyTests-1114162996 None] Lock "cinder-08a28661-e2a6-4f34-a69e-b68c9f320a47-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:08:52 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-cff5c457-a5f0-41a9-b9a8-e263d9877811 tempest-SnapshotDependencyTests-1114162996 None] Acquiring lock "cinder-quobyte-b999e947-663f-44c1-b4af-fb2bb373b328" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:08:52 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-cff5c457-a5f0-41a9-b9a8-e263d9877811 tempest-SnapshotDependencyTests-1114162996 None] Lock "cinder-quobyte-b999e947-663f-44c1-b4af-fb2bb373b328" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:08:52 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-cff5c457-a5f0-41a9-b9a8-e263d9877811 tempest-SnapshotDependencyTests-1114162996 None] Acquiring lock "cinder-quobyte-08a28661-e2a6-4f34-a69e-b68c9f320a47" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:08:52 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-cff5c457-a5f0-41a9-b9a8-e263d9877811 tempest-SnapshotDependencyTests-1114162996 None] Lock "cinder-quobyte-08a28661-e2a6-4f34-a69e-b68c9f320a47" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:08:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-cff5c457-a5f0-41a9-b9a8-e263d9877811 tempest-SnapshotDependencyTests-1114162996 None] Deleting offline snapshot 08a28661-e2a6-4f34-a69e-b68c9f320a47 of volume b999e947-663f-44c1-b4af-fb2bb373b328 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:08:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-cff5c457-a5f0-41a9-b9a8-e263d9877811 tempest-SnapshotDependencyTests-1114162996 None] snapshot_file for this snap is: volume-b999e947-663f-44c1-b4af-fb2bb373b328.08a28661-e2a6-4f34-a69e-b68c9f320a47 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:08:52 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[18edded7-45e3-466e-91d7-e7eebe7b7f77]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:08:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cff5c457-a5f0-41a9-b9a8-e263d9877811 tempest-SnapshotDependencyTests-1114162996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b999e947-663f-44c1-b4af-fb2bb373b328.08a28661-e2a6-4f34-a69e-b68c9f320a47 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:52 devstack sudo[109030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b999e947-663f-44c1-b4af-fb2bb373b328.08a28661-e2a6-4f34-a69e-b68c9f320a47 Sep 28 12:08:52 devstack sudo[109030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:52 devstack sudo[109030]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cff5c457-a5f0-41a9-b9a8-e263d9877811 tempest-SnapshotDependencyTests-1114162996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b999e947-663f-44c1-b4af-fb2bb373b328.08a28661-e2a6-4f34-a69e-b68c9f320a47" returned: 0 in 0.361s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-cff5c457-a5f0-41a9-b9a8-e263d9877811 tempest-SnapshotDependencyTests-1114162996 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b999e947-663f-44c1-b4af-fb2bb373b328(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:08:52 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf29f25-9e09-41d1-a910-b511e35d391c]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:08:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cff5c457-a5f0-41a9-b9a8-e263d9877811 tempest-SnapshotDependencyTests-1114162996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b999e947-663f-44c1-b4af-fb2bb373b328 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:53 devstack sudo[109035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b999e947-663f-44c1-b4af-fb2bb373b328 Sep 28 12:08:53 devstack sudo[109035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:53 devstack sudo[109035]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cff5c457-a5f0-41a9-b9a8-e263d9877811 tempest-SnapshotDependencyTests-1114162996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b999e947-663f-44c1-b4af-fb2bb373b328" returned: 0 in 0.526s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cff5c457-a5f0-41a9-b9a8-e263d9877811 tempest-SnapshotDependencyTests-1114162996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b999e947-663f-44c1-b4af-fb2bb373b328.08a28661-e2a6-4f34-a69e-b68c9f320a47 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:53 devstack sudo[109041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b999e947-663f-44c1-b4af-fb2bb373b328.08a28661-e2a6-4f34-a69e-b68c9f320a47 Sep 28 12:08:53 devstack sudo[109041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:53 devstack sudo[109041]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cff5c457-a5f0-41a9-b9a8-e263d9877811 tempest-SnapshotDependencyTests-1114162996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b999e947-663f-44c1-b4af-fb2bb373b328.08a28661-e2a6-4f34-a69e-b68c9f320a47" returned: 0 in 0.335s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cff5c457-a5f0-41a9-b9a8-e263d9877811 tempest-SnapshotDependencyTests-1114162996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b999e947-663f-44c1-b4af-fb2bb373b328.08a28661-e2a6-4f34-a69e-b68c9f320a47 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:53 devstack sudo[109046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b999e947-663f-44c1-b4af-fb2bb373b328.08a28661-e2a6-4f34-a69e-b68c9f320a47 Sep 28 12:08:53 devstack sudo[109046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:54 devstack sudo[109046]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cff5c457-a5f0-41a9-b9a8-e263d9877811 tempest-SnapshotDependencyTests-1114162996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b999e947-663f-44c1-b4af-fb2bb373b328.08a28661-e2a6-4f34-a69e-b68c9f320a47" returned: 0 in 0.243s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-cff5c457-a5f0-41a9-b9a8-e263d9877811 tempest-SnapshotDependencyTests-1114162996 None] Lock "cinder-quobyte-08a28661-e2a6-4f34-a69e-b68c9f320a47" released by "_delete_snapshot" :: held 1.568s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:08:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-cff5c457-a5f0-41a9-b9a8-e263d9877811 tempest-SnapshotDependencyTests-1114162996 None] Lock "cinder-quobyte-b999e947-663f-44c1-b4af-fb2bb373b328" released by "delete_snapshot" :: held 1.594s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:08:54 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-cff5c457-a5f0-41a9-b9a8-e263d9877811 tempest-SnapshotDependencyTests-1114162996 None] Created reservations ['2f451e4c-45bd-46ba-9cc2-9546ece51689', '8f8b8bbf-dc61-4699-bdb4-75b79677acdf', '0fdacf81-f774-4dc6-8ccc-bf8416d22220', '372e871e-7241-4830-986b-609b24bb95ad'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:08:54 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-cff5c457-a5f0-41a9-b9a8-e263d9877811 tempest-SnapshotDependencyTests-1114162996 None] Delete snapshot completed successfully. Sep 28 12:08:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-cff5c457-a5f0-41a9-b9a8-e263d9877811 tempest-SnapshotDependencyTests-1114162996 None] Lock "cinder-08a28661-e2a6-4f34-a69e-b68c9f320a47-delete_snapshot" released by "delete_snapshot" :: held 1.733s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:08:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a3607060-a323-4a0e-9d1e-3543955e0c18 tempest-SnapshotDependencyTests-1114162996 None] Acquiring lock "cinder-b999e947-663f-44c1-b4af-fb2bb373b328-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:08:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a3607060-a323-4a0e-9d1e-3543955e0c18 tempest-SnapshotDependencyTests-1114162996 None] Lock "cinder-b999e947-663f-44c1-b4af-fb2bb373b328-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:08:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a3607060-a323-4a0e-9d1e-3543955e0c18 tempest-SnapshotDependencyTests-1114162996 None] Acquiring lock "cinder-quobyte-b999e947-663f-44c1-b4af-fb2bb373b328" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:08:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a3607060-a323-4a0e-9d1e-3543955e0c18 tempest-SnapshotDependencyTests-1114162996 None] Lock "cinder-quobyte-b999e947-663f-44c1-b4af-fb2bb373b328" acquired by "delete_volume" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:08:54 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ba0a08-5ef3-4b23-8c5f-d459519badce]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:08:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3607060-a323-4a0e-9d1e-3543955e0c18 tempest-SnapshotDependencyTests-1114162996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b999e947-663f-44c1-b4af-fb2bb373b328 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:54 devstack sudo[109049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b999e947-663f-44c1-b4af-fb2bb373b328 Sep 28 12:08:54 devstack sudo[109049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:55 devstack sudo[109049]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3607060-a323-4a0e-9d1e-3543955e0c18 tempest-SnapshotDependencyTests-1114162996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b999e947-663f-44c1-b4af-fb2bb373b328" returned: 0 in 0.386s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3607060-a323-4a0e-9d1e-3543955e0c18 tempest-SnapshotDependencyTests-1114162996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b999e947-663f-44c1-b4af-fb2bb373b328 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:55 devstack sudo[109055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b999e947-663f-44c1-b4af-fb2bb373b328 Sep 28 12:08:55 devstack sudo[109055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:55 devstack sudo[109055]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3607060-a323-4a0e-9d1e-3543955e0c18 tempest-SnapshotDependencyTests-1114162996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-b999e947-663f-44c1-b4af-fb2bb373b328" returned: 0 in 0.250s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a3607060-a323-4a0e-9d1e-3543955e0c18 tempest-SnapshotDependencyTests-1114162996 None] Lock "cinder-quobyte-b999e947-663f-44c1-b4af-fb2bb373b328" released by "delete_volume" :: held 0.696s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:08:55 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-a3607060-a323-4a0e-9d1e-3543955e0c18 tempest-SnapshotDependencyTests-1114162996 None] Created reservations ['2933dfe0-c0c3-4641-b40f-84f9c96796dc', '17b75d3e-8e80-445b-934d-ca1230271382', '93177702-71df-4d98-94ac-bc8f0b0f483a', '7f2387f8-6719-416d-b937-42ed3a8ef8d6'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:08:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3607060-a323-4a0e-9d1e-3543955e0c18 tempest-SnapshotDependencyTests-1114162996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:08:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3607060-a323-4a0e-9d1e-3543955e0c18 tempest-SnapshotDependencyTests-1114162996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:08:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a3607060-a323-4a0e-9d1e-3543955e0c18 tempest-SnapshotDependencyTests-1114162996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:08:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a3607060-a323-4a0e-9d1e-3543955e0c18 tempest-SnapshotDependencyTests-1114162996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:08:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3607060-a323-4a0e-9d1e-3543955e0c18 tempest-SnapshotDependencyTests-1114162996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:08:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3607060-a323-4a0e-9d1e-3543955e0c18 tempest-SnapshotDependencyTests-1114162996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:55 devstack sudo[109058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:08:55 devstack sudo[109058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:55 devstack sudo[109058]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b352dfbd-c32a-45e7-b31a-6dab7f815c07 tempest-SnapshotDependencyTests-1114162996 None] Acquiring lock "cinder-23fedc7f-2949-4e71-8ed4-347db74b6cc2-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:08:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3607060-a323-4a0e-9d1e-3543955e0c18 tempest-SnapshotDependencyTests-1114162996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.265s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:55 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a3607060-a323-4a0e-9d1e-3543955e0c18 tempest-SnapshotDependencyTests-1114162996 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:08:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b352dfbd-c32a-45e7-b31a-6dab7f815c07 tempest-SnapshotDependencyTests-1114162996 None] Lock "cinder-23fedc7f-2949-4e71-8ed4-347db74b6cc2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:08:55 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-a3607060-a323-4a0e-9d1e-3543955e0c18 tempest-SnapshotDependencyTests-1114162996 None] Deleted volume successfully. Sep 28 12:08:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a3607060-a323-4a0e-9d1e-3543955e0c18 tempest-SnapshotDependencyTests-1114162996 None] Lock "cinder-b999e947-663f-44c1-b4af-fb2bb373b328-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:08:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b352dfbd-c32a-45e7-b31a-6dab7f815c07 tempest-SnapshotDependencyTests-1114162996 None] Acquiring lock "cinder-quobyte-23fedc7f-2949-4e71-8ed4-347db74b6cc2" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:08:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b352dfbd-c32a-45e7-b31a-6dab7f815c07 tempest-SnapshotDependencyTests-1114162996 None] Lock "cinder-quobyte-23fedc7f-2949-4e71-8ed4-347db74b6cc2" acquired by "delete_volume" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:08:55 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b6e32c-40ac-4058-beee-9add2538543e]: (4, 'qcow2') {{(pid=87567) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:08:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b352dfbd-c32a-45e7-b31a-6dab7f815c07 tempest-SnapshotDependencyTests-1114162996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-23fedc7f-2949-4e71-8ed4-347db74b6cc2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:56 devstack sudo[109061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-23fedc7f-2949-4e71-8ed4-347db74b6cc2 Sep 28 12:08:56 devstack sudo[109061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:56 devstack sudo[109061]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b352dfbd-c32a-45e7-b31a-6dab7f815c07 tempest-SnapshotDependencyTests-1114162996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-23fedc7f-2949-4e71-8ed4-347db74b6cc2" returned: 0 in 0.371s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b352dfbd-c32a-45e7-b31a-6dab7f815c07 tempest-SnapshotDependencyTests-1114162996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-23fedc7f-2949-4e71-8ed4-347db74b6cc2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:56 devstack sudo[109068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-23fedc7f-2949-4e71-8ed4-347db74b6cc2 Sep 28 12:08:56 devstack sudo[109068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:56 devstack sudo[109068]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b352dfbd-c32a-45e7-b31a-6dab7f815c07 tempest-SnapshotDependencyTests-1114162996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409/volume-23fedc7f-2949-4e71-8ed4-347db74b6cc2" returned: 0 in 0.258s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b352dfbd-c32a-45e7-b31a-6dab7f815c07 tempest-SnapshotDependencyTests-1114162996 None] Lock "cinder-quobyte-23fedc7f-2949-4e71-8ed4-347db74b6cc2" released by "delete_volume" :: held 0.678s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:08:56 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-b352dfbd-c32a-45e7-b31a-6dab7f815c07 tempest-SnapshotDependencyTests-1114162996 None] Created reservations ['56d264a1-7fa4-4c5c-9dd2-4a821b670d68', 'ee1d17d9-5ea6-4575-99df-ec906626f5f8', '75868a04-6667-4650-8032-0edf5611b777', '057f2355-e69d-4e7b-9780-52fd9fe6e964'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:08:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b352dfbd-c32a-45e7-b31a-6dab7f815c07 tempest-SnapshotDependencyTests-1114162996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:08:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b352dfbd-c32a-45e7-b31a-6dab7f815c07 tempest-SnapshotDependencyTests-1114162996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:08:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b352dfbd-c32a-45e7-b31a-6dab7f815c07 tempest-SnapshotDependencyTests-1114162996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:08:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b352dfbd-c32a-45e7-b31a-6dab7f815c07 tempest-SnapshotDependencyTests-1114162996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-798a8e44-ecec-4c3e-984e-d83acb1af9f0'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:08:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b352dfbd-c32a-45e7-b31a-6dab7f815c07 tempest-SnapshotDependencyTests-1114162996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:08:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b352dfbd-c32a-45e7-b31a-6dab7f815c07 tempest-SnapshotDependencyTests-1114162996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:56 devstack sudo[109071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409 Sep 28 12:08:56 devstack sudo[109071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:56 devstack sudo[109071]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b352dfbd-c32a-45e7-b31a-6dab7f815c07 tempest-SnapshotDependencyTests-1114162996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9dd4e3d2d4b0f8797892c6aa2053d409" returned: 0 in 0.265s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:56 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-b352dfbd-c32a-45e7-b31a-6dab7f815c07 tempest-SnapshotDependencyTests-1114162996 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:08:56 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b352dfbd-c32a-45e7-b31a-6dab7f815c07 tempest-SnapshotDependencyTests-1114162996 None] Deleted volume successfully. Sep 28 12:08:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b352dfbd-c32a-45e7-b31a-6dab7f815c07 tempest-SnapshotDependencyTests-1114162996 None] Lock "cinder-23fedc7f-2949-4e71-8ed4-347db74b6cc2-delete_volume" released by "delete_volume" :: held 1.168s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:09:06 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=29,cinder:UPDATE=30,cinder:INSERT=8 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:09:06 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:UPDATE=28,cinder:SELECT=20,cinder:DELETE=5,cinder:INSERT=7 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}